|Type: Field operational test|
|Tested system/service: Autonomous Systems, Cooperative Systems|
|Countries: Finland, Sweden, Germany, UK, France, Greece, Italy, Spain||3000 test users|
|23 partners||? vehicles|
|Active from 2008/06/01 to 2012/06/01|
|VTT Technical Research Centre of Finland|
|Data catalogue||Tools catalogue|
|Data sets used in this FOT:
||The following tools|
were used in this FOT:
TeleFOT constitutes the largest pan-European Field Operational Test of functions provided by in-vehicle aftermarket and nomadic devices that has been conducted to date. TeleFOT started in 2008 and ended in November 2012. During its lifetime, the project utilised and further developed the methodology of Field Operational Tests (FOT) to assess the impacts of functions provided by these devices on several transport domains, including safety, efficiency, environment, mobility and user uptake.
Some of the issues addressed within the FOTs include whether the functions cause distraction, improve traffic efficiency, increase travel speeds and help the driver to avoid congestion.
A series of field tests have been conducted in different phases:
- Piloting of data collection was conducted at an interim stage to ensure that the methodology would generate results that were capable of addressing the individual research questions and associated hypotheses.
- Large-scale trials were then conducted with a significant number of vehicles instrumented with data loggers. Large-scale FOTs (LFOTs) were carried out at 8 individual test-sites within the southern, central and northern regions of Europe (Finland, Sweden, Germany, UK, Greece, Italy and Spain). A special FOT at the French test-site was dedicated to evaluating a ‘nomadic eCall’ device.
Where necessary, the data collected within the large-scale tests was augmented with additional data from Detailed FOTs (DFOTs). These were conducted in situations whereby the research questions could only be answered using sophisticated data acquisition techniques that provided more detailed data.
TeleFOT collected a huge amount of data through in-vehicle data loggers and participant questionnaires. The data was further enriched by map matching and metadata which provided specific contextual details about each individual test. Before the data was provided for analysis, it was post-processed to create uniform summary tables for each FOT to extract performance indicators. A secure web-based server located in Finland was available for the TeleFOT data analysts to download individual data-files as needed. The database contained FOT data, summary data and related metadata, such as detailed description of data formats and contextual information. These files were used by the analysts for further processing, analysis and interpretation through use of statistical tools.
Key milestones of the projects: Testing & evaluation strategy (Month11), FOT launch (M14), Mid-term evaluation (M21), Long-term evaluation (M40)
European Project funded under Framework Program FP7 of Information and Communication Technologies FP7-ICT-2007-2
Details of Field Operational Test
Start date and duration of FOT execution
Test sites are in three regional European ‘communities’ Northern (Finland, Sweden); Central (Germany, UK, France); and Southern (Greece, Italy, Spain)
Parallel and otherwise relevant activities: EuroFOT, FOT-Net (TeleFOT is a partner), General framework development (e.g. ESoP, standards, etc), NDWG
Assess usability, safety, efficiency and environmental impacts of aftermarket and nomadic devices' functions and services in vehicles.
Raise wide awareness of the potential these devices offer.
Accelerate the take up of ICT systems for driver support.
Project in progress
Project in progress
Summary, type of funding and budget
14.5 Mio EUR
European Commission contribution: 9.7 Mio EUR
Cooperation partners and contact persons
- Public Authorities: Swedish Road Administration
- Vehicle Manufacturer: Centro Ricerche FIAT
- Supplier: Blom, BroadBit, Emtele, Electronic Trafic S.A., Logica Suomi Oy, Magneti Marelli, Metasystem, Navteq
- Users: ADAC, Allgemeiner Deutscher Automobil Club
- Universities: ICCS, IKA, Loughborough University, University of Modena and Reggio Emilia, Chalmers
- Research Institutes: VTT Technical Research Centre of Finland, CERTH, CIDAUT
- Others: Destia (infrastructure service), MIRA Ltd (consultancy & research), Rücker Lypsa (consultancy)
Main Contact person
Mr. Petri Mononen VTT Technical Research Centre of Finland Project Coordinator firstname.lastname@example.org Tel. +358 40 515 5808
Current contact (2014):
Dr. Sami Koskinen email@example.com
Project Officer: Myriam Coulon-Cantuer, from the European Commission, DG Information Society and Media.
Applications and equipment
Aftermarket and Nomadic Devices in Vehicles
Different functions are going to be tested in the different FOTs, covering two main areas: safe driving and economic and fuel efficient driving:
- Speed limit information
- Speed alert
- Navigation support (static)
- Navigation support (dynamic)
- Green driving support
- Forward Collision Warning
- Lane Departure Warning
Their impact is to be assessed with reference to four impact areas:
- User up-take.
Before starting the tests, it is necessary to make a final technical and logistic assessment of the tools to be used in the trials, as well as to ensure good-quality dataflow throughout the tests.
Pilot Tests are conceived as mini-FOTs, where the whole FOT process is reproduced although in a limited scale, in terms of conditions, tools, questionnaires, support line etc.
TeleFOT field tests are planned in two phases:
- Large Scale FOTs: initial short and long term testing will be done with a large number of drivers using their own vehicles in their daily travel. These vehicles are equipped with testing (aftermarket/nomadic, e.g. PND) and recording devices, measuring speed, position and some vehicles dynamics. There will also be a control group not using any devices.
- Detailed FOTs: in the second phase, detailed testing with a limited number of subjects with instrumented cars will be carried out.
In the tests, drivers have access to smart phones and navigators and the effects of the services they provide to support driving are tested. Prior to any field operational tests, the usability and safety of the devices and services are studied carefully in laboratory conditions.
Equipment carried by test users
Vehicles in large scale FOTs will be equipped with data loggers (not connected to vehicle systems).
During detailed FOTs instrumented vehicles are used, which have e.g. video cameras for driver monitoring and for environmental observation.
Pre-simulation / Piloting of the FOT
Prior to running any large scale FOTs, each FOT within TeleFOT will be
- benchmarked (e.g. , usability, including crash tests to rule out inherently unsafe installations, …) and
- piloted on a smaller fleet to test the overall technical implementation, data collection, etc.
Method for the baseline
Techniques for measurement and data collection
The core of TeleFOT, to conduct Field Operational Tests, is based on a large number of drivers using their mobile devices in their own vehicles, where they interact with the functions and services provided to them. Their reactions and behaviour are recorded with data loggers mounted on their vehicles. Tentatively, there will be about 3000 drivers. From these drivers, data on general reactions and behaviour are recorded through loggers and transferred to the centralised server for the analysis.
Data are collected in different phases of the project:
Pre-test phase: Data about the user will be collected, e.g. gender, age, driving experience, experience with ADAS or similar.
During the tests: The objective data are logged inside the car. These data will be completed by additional subjective data (to be provided via Travel Diaries and Questionnaires).
Post-test phase: A subjective evaluation of the system by the user will be completed.
Recruitment goals and methods
Up to 3000 drivers in TeleFOT-equipped vehicles will be driving around in eight of the Member Countries involved in the project (Finland, Sweden, Germany, UK, France, Greece, Italy and Spain).
Methods for the liaison with the drivers during the FOT execution
(Detailed planning of this still in progress.)
Methods for data analysis, evaluation, synthesis and conclusions
The Experimental design to be used in the tests means setting up two groups of drivers: test groups and control groups The test group (T) will use aftermarket and nomadic devices serving as (i) HMI for (ii) functions and services brought to the test vehicles. The second group without these devices and services serve as control drivers (C).
In very long tests like the ones performed in TeleFOT, a use of a separate control group is essential because otherwise it would be extremely difficult to filter out the the effects of external slow long term changes (e.g. change in fuel prices) or other confounding variables (e.g. extreme or adverse weather conditions) from the effects of the tested services and functions.
(Detailed planning of this still in progress.)