VENTURER Trial 2 Participant Experiments

During the months of June and July, VENTURER undertook the second tranche of experiments. Trial 2, held at the Bristol Robotics Laboratory, involved examining human reactions to the decisions made by an autonomous vehicle at junctions and while interacting with conventional vehicles.

Participants engaged in a series of repeated scenarios in both the Wildcat and VENTURER Simulator, and were asked to rate their ability to trust the decisions made by the vehicle.

The scenarios were designed to mirror the experiences of an everyday driver on UK roads and included overtaking a parked vehicle with a vehicle oncoming and turning left and right into and out of junctions while detecting passing vehicles.

It is expected that the findings from Trial 2 will help to inform future research around Connected and Autonomous Vehicles’ (CAVs) abilities to integrate with other traffic on UK roads.

Two of the participants that took part in the Trial 2 experiments were Kurt, who has 28 years driving experience and Megan, who has just 5 years of experience.

Kurt, when asked to reflect on his time in the Wildcat vehicle, stated that “what was interesting was that I trusted the car even though it makes different decisions to what I would have made if I was driving” and importantly, he never felt that the vehicle’s decisions were unsafe. Regarding the interactions with other vehicles, he felt that the car was “perfectly fine with cars crossing its path”.

Although he could see how the Wildcat and VENTURER simulator experiments were comparable, he felt more at ease in the Wildcat than the simulator as he found it easier to concentrate on the vehicle’s movements due to the sensations of the engine and the scenarios felt more real-life.

Megan also felt safe in both the simulator and the road-vehicle claiming that “at no point did I think it was going to crash or it was going to be unsafe”. She felt that although the vehicle was often “cautious around junctions”, she didn’t feel nervous at all and thought that the CAV “made decisions that a normal driver would have in certain situations”.

When asked to consider the biggest barriers to wide scale CAV adoption, Kurt and Megan had differing views. Through Kurt’s exploration of CAV trials in the news and through technology blogs he is aware that projects like VENTURER and the existence of technologies such as adaptive cruise control are proving that technological progress is occurring at a rapid rate. As such, Kurt felt that “human attitudes and behaviours towards driverless cars are the biggest barrier” currently preventing wide scale adoption of CAVs rather than the technology enabling them. Megan, on the other hand, stated that she felt the most challenging aspect would be stepping-up the technology’s abilities from functioning in a controlled environment to functioning in the real road.

Neither Megan or Kurt felt that CAVs are yet fully equipped to anticipate and react to the unpredictable driving behaviours that human drivers exhibit on UK roads and can see why projects like VENTURER are so important in improving this.

Kurt also suggested that pedestrian attitudes towards CAVs might be counter intuitive as their greater confidence when stepping into the road in front of autonomous vehicles may lead to increased jaywalking. While this may be positive for the safety of pedestrians and other road users, this could result in delays on the road network and slower journeys. Despite these issues, he agrees that it may be possible to mitigate against the issues surrounding pedestrians taking advantage of driverless vehicles by making CAVs indistinguishable from normal cars.

Both Kurt and Megan identified an autonomous vehicle’s ability to interact with pedestrians as a concern. This is something that VENTURER will explore extensively during Trial 3 as it is a crucial issue that needs to be assessed before driverless cars can be safely deployed onto UK roads. Furthermore, CAV technology’s ability to cope in real world will also be put to the test in Trial 3 when VENTURER will demonstrate an autonomous vehicle in more complex scenarios in the Bristol and South Gloucestershire region.

VENTURER Trial 1 Results: Press Release

VENTURER driverless car project publishes results of first trial:

‘Planned handover’ key to development of driverless car technology say researchers

VENTURER is the first Connected and Autonomous Vehicle project to start in the UK. The results of VENTURER’s preliminary trials show that the handover process is a safety critical issue in the development of Autonomous Vehicles (AVs).

The first VENTURER trials set out to investigate ‘takeover’ (time taken to reengage with vehicle controls) and ‘handover’ (time taken to regain a baseline/normal level of driving behaviour and performance) when switching frequently between automated and manual driving modes within urban and extra-urban settings.  This trial is believed to be the first to directly compare handover to human driver-control from autonomous mode in both simulator and autonomous road vehicle platforms.

The handover process is important from a legal and insurance perspective – the length of time it takes people to regain full control of the vehicle represents a meaningful risk to insurers and understanding when control is transferred between the vehicle and the driver has liability implications.

David Williams from AXA outlined that “The results of this trial have been very useful as we consider the issues that the handover process raises for insurers. Although some motor manufacturers have said they will skip SAE Level 3, some are progressing with vehicles that will require the driver to take back control of the vehicle. The insurance industry will need to assess the relative safety of the handover systems as they come to market but VENTURER’s trial 1 results show that with robust testing we can properly assess how humans and autonomous vehicles interact during this crucial phase of the technologies’ evolution.”

VENTURER designed, tested and analysed both simulator and road vehicle-based handover trials.

50 participants were tested in a simulator and/or in the autonomous vehicle on roads on UWE Bristol campus. The tests were at speeds of 20, 30, 40 and 50 mph in the simulator and 20 mph in the autonomous vehicle; speeds common in urban and extra-urban settings. Baseline driving behaviour of participants was also tested, and then the length of time it took them to return to this baseline following handover.

During the trial, the driver was aware that they might be alerted to take control of the vehicle at any moment, either due to the decisions made by the driver, or the capabilities of the vehicle in particular situations. VENTURER has classified this as planned handover.

The 20- and 30- mph scenarios involved town/city urban driving and the 40- and 50- mph scenarios involved outer-town/city extra-urban driving. Driving speed, lateral lane position, and braking behaviour (amongst other measures) were taken.

A key finding is that it took 2-3 seconds for participants to ‘takeover’ manual controls and resume active driving after short periods of autonomous driving in urban environments.

They also found that participants drove more slowly than the recommended speed limit for up to 55 seconds following a handover request, which suggests more cautious, but not necessarily safer, driving. This could be important for traffic management – if drivers on the road replicated this behaviour it might impact the flow of traffic and mitigate some of the predicated benefits of AVs.

In addition, participants returned to their baseline manual driving behaviour after handover within 10-20 seconds, with most measures including speed, stabilising after 20-30 seconds. This was not the case within the highest speed simulator condition where stabilisation did not seem to occur on most measures within the 55 second measured handover period.

The team says these results have implications for the designers of autonomous vehicles with handback functionality, for example, in terms of phased handover systems. The results also inform the emerging market for insurance for autonomous vehicles.

Chair of the project, Lee Woodcock (Atkins) said, “The outcome of this research for trial one is significant and must provide food for thought as the market develops for driverless cars and how we progress through the different levels of automation. Further research must also explore interaction not just between vehicles but also with network operations and city management systems.”

Dr Phillip Morgan (UWE Bristol) said, “Designers need to proceed with caution and consider human performance under multiple driving conditions and scenarios in order to plot accurate takeover and handover time safety curves. In the time it takes for drivers to reach their baseline behaviour, the vehicle may have travelled some distance, depending on the speed. These initial trials show that there are some risk elements in the handover process and bigger studies with more participants may be needed to ensure there is sufficient data to build safe handover support systems.”

Professor Graham Parkhurst (UWE Bristol) said, “The results of these tests suggest that autonomous vehicles on highways should slow to a safe speed before handover is attempted. Further research is required to clarify what that safe speed is, but it would be substantially slower than the 70 mph motorway limit, and somewhat lower than the highest speed (50 mph) considered in our simulator trials.”

The trial clearly demonstrated that there were no major differences between control of the simulator and the Wildcat platforms used within the trial, validating the future use of simulators for the development of autonomous vehicles and associated technologies.

 

The full report can be found here: http://www.venturer-cars.com/trial-1-results/