Learning MPC for Interaction-Aware Autonomous Driving:
A Game-Theoretic Approach
Brecht Evens
Mathijs Schuurmans
Panagiotis Patrinos
[Preprint]
[Code]

Abstract

We present a novel control strategy for controlling autonomous vehicles in general traffic situations which accounts for the mutual interactions between the controlled vehicle and other road users. More specifically, the interaction is modelled as a generalized potential game, where each road user is assumed to minimize a shared cost function subject to shared (collision avoidance) constraints. The shared cost allows the controlled vehicle to cooperate with other road users, while safety guarantees follow from the imposed hard collision avoidance constraints and the introduction of a model predictive control feedback scheme. In the case where the incentives and constraints of other road users, i.e., human drivers, are unknown, we propose a natural and practical methodology for learning this information online from observed data, and incorporating it directly into the solution methodology for the game formulation. Extensive numerical simulations in a realistic highway merging scenario have been performed, verifying the practical usability of the developed methodologies.


Videos

Experiments without learning

Experiments with courteous human
Courteous belief

Stubborn belief

Experiments with stubborn human
Stubborn belief

Courteous belief

Experiments with learning

Experiments with courteous human
Courteous belief

Stubborn belief

Experiments with stubborn human
Stubborn belief

Courteous belief

Code

The code of the driving simulator is available on GitHub.



Paper

B. Evens, M. Schuurmans, P. Patrinos
Learning MPC for Interaction-Aware Autonomous Driving: A Game-Theoretic Approach.
(Preprint)
(hosted on ArXiv)


[Bibtex]


Acknowledgements

The template for this page was originally made by Phillip Isola and Richard Zhang for a colorful ECCV project; the code can be found here.