This page in Swedish

Centre for Applied Autonomous Sensor Systems (AASS)

New AI method makes self-driving vehicles better drivers

Self-driving vehicle cockpit.

A cyclist drops out of sight for a few seconds behind a car – a not-so-uncommon traffic situation for us humans. But for a self-driving vehicle, the cyclist ceases to exist.
“We have succeeded in developing a new way for self-driving vehicles to understand and explain the dynamics of our world just like people do,” says Mehul Bhatt, professor of computer science at Örebro University.

The study was published in the esteemed Artificial Intelligence Journal (AIJ).

Jakob Suchan, Mehul Bhatt, Srikrishna Varadarajan,
Commonsense visual sensemaking for autonomous driving – On generalised neurosymbolic online abduction integrating vision and semantics,
Artificial Intelligence, Volume 299, 2021.

To the article at ScienceDirect

In traffic, humans are used to constantly anticipating what will happen next. This reasoning ability is something that today’s self-driving vehicles and AI systems in general are lacking. In a recent study, together with colleagues in Germany and India, Mehul Bhatt has shown that combining modern neural learning with common-sense reasoning can overcome some of the pitfalls ailing self-driving vehicles today. The study was published in the Artificial Intelligence Journal (AIJ).

“The developed AI method results in self-driving vehicles learning to understand the world much like humans. With understanding also comes the ability to explain decisions,” says Mehul Bhatt.

As a result, self-driving vehicles can recognise that a cyclist hidden behind a car for a few seconds still exists until it reappears. The approach enables self-driving vehicles to demonstrate a wide range of similar human-like common-sense capabilities. Such capabilities have not been achievable in self-driving vehicles or other AI technologies that are based on machine learning alone.

“Our method lets a self-driving vehicle understand a course of events, in this case, that visibility is blocked by a car and that after the car has passed, the cyclist will be visible again. This level of understanding is essential for self-driving vehicles to be traffic-ready under different driving conditions and environments.”

Out of sight but not out of mind; the case of hidden entities, for example an occluded cyclist.

Out of sight but not out of mind; the case of hidden entities, for example occluded cyclist.

Inclusion, safety, and trust

Security is another significant advantage of developing AI technologies that see and understand the world as humans do. This new AI method enables autonomous vehicles to show why they have made a particular decision in traffic – such as sudden braking – something that today’s autonomous vehicles cannot.

Mehul Bhatt stresses, “It is of utmost importance that we do not have non-transparent technologies driving us around that no one fully understands, neither the developers of the AI, nor the manufacturer or engineers of the vehicles themselves. If self-driving cars are to share the same space as people, we need to understand how these cars are making decisions.”

This is also crucial, not the least in studying accidents, resolving insurance issues, and assisting those with special needs.

“At the end of the day, standardisation is crucial. We need to achieve a shared understanding of the technologies in self-driving cars – as we do with the technologies in airplanes. At the moment, we’re far from it. This will only happen if we fully understand the technologies we’re developing,” says Mehul Bhatt.

Mehul Bhatt.

Mehul Bhatt.

Developing technology for people

In addition to developing AI technology, Mehul Bhatt and doctoral student Vasiliki Kondyli at Örebro are studying how humans behave in traffic by allowing test subjects to drive cars in virtual worlds under experimentally controlled traffic situations.

“Results from such human behaviour studies are utilised to develop human-centred AI technology for self-driving vehicles that can perform at a level meeting human expectations,” explains Mehul Bhatt.

Influencing traffic of the future

The development of autonomous vehicles is in full swing, and according to Mehul Bhatt, now is the time to influence the future of smart mobility systems.

“I want to contribute to the development of autonomous vehicle technologies that safely and legally take us from point A to point B while also fulfilling accessibility requirements and societal norms. Since we’d never allow a human to drive a car without a driver’s licence, I think we should put at least the same demands on autonomous vehicles,” concludes Mehul Bhatt.

Text: Jasenka Dobric
Translation: Jerry Gray
Photo: Jasenka Dobric, iStock & Mehul Bhatt