Autonomous Driving

All Publication Topics Autonomous Driving Autonomous Exploration Benchmarks Compression Computer Vision First-Person Video Forecasting Generative Models Imitation Learning Intrinsic Control Machine Learning Manipulation Model-Based Control Offroad Navigation Paper Award Reinforcement Learning Reward Learning Robotics Social Navigation
Tianran Liu, Shengwen Zhao, Mozhgan Pourkeshavarz, Weican Li, Nicholas Rhinehart.
OccSim: Multi-kilometer Simulation with Long-horizon Occupancy World Models.
arXiv:2603.28887, (arXiv), 2026.
DOI PDF Cite Project
Autonomous Driving Computer Vision Forecasting Generative Models Machine Learning Robotics
Mozhgan Pourkeshavarz, Tianran Liu, Nicholas Rhinehart.
AutoWorld: Scaling Multi-Agent Traffic Simulation with Self-Supervised World Models.
arXiv:2603.28963, (arXiv), 2026.
DOI PDF Cite Project
Autonomous Driving Computer Vision Forecasting Machine Learning Robotics Generative Models
CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting
Jiezhi Yang, Khushi Desai, Charles Packer, Harshil Bhatia, Nicholas Rhinehart, Rowan McAllister, Joseph Gonzalez.
CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting.
European Conference on Computer Vision, (ECCV), 2024.
DOI PDF Cite Project Code
Autonomous Driving Computer Vision Forecasting Generative Models Machine Learning Robotics
The Waymo Open Sim Agents Challenge
Nico Montali, John Lambert, Paul Mougin, Alex Kuefler, Nicholas Rhinehart, Michelle Li, Cole Gulino, Tristan Emrich, Zoey Yang, Shimon Whiteson, Brandyn White, Dragomir Anguelov.
The Waymo Open Sim Agents Challenge.
Advances in Neural Information Processing Systems, (NeurIPS), 2023.
DOI PDF Cite Project
Autonomous Driving Benchmarks Computer Vision Forecasting Imitation Learning Machine Learning Robotics
Charles Packer, Nicholas Rhinehart, Rowan McAllister, Matthew a Wright, Xin Wang, Jeff He, Sergey Levine, Joseph E Gonzalez.
Is anyone there? learning a planner contingent on perceptual uncertainty.
Conference on Robot Learning, (CoRL), 2023.
DOI PDF Cite
Autonomous Driving Computer Vision Forecasting Generative Models Machine Learning Model-Based Control Robotics
S2Net: Stochastic Sequential Pointcloud Forecasting
Xinshuo Weng, Junyu Nan, Kuan-Hui Lee, Rowan McAllister, Adrien Gaidon, Nicholas Rhinehart, Kris Kitani.
S2Net: Stochastic Sequential Pointcloud Forecasting.
European Conference on Computer Vision, (ECCV), 2022.
DOI PDF Cite
Autonomous Driving Forecasting Generative Models Machine Learning
placeholder
Paul Vernaza, Nicholas Rhinehart.
Traffic prediction with reparameterized pushforward policy for autonomous vehicles.
U.S. Patent No. 11,189,171, 2021.
PDF Cite
Autonomous Driving Forecasting Generative Models Machine Learning
Sequential pointcloud forecasting result animation
Xinshuo Weng, Jianren Wang, Sergey Levine, Kris Kitani, Nicholas Rhinehart.
Inverting the pose forecasting pipeline with SPF2: Sequential pointcloud forecasting for sequential pose forecasting.
Conference on robot learning, (CoRL), 2021.
DOI PDF Cite Project Code
Autonomous Driving Computer Vision Generative Models Machine Learning Robotics
Nicholas Rhinehart, Jeff He, Charles Packer, Matthew a Wright, Rowan McAllister, Joseph E Gonzalez, Sergey Levine.
Contingencies from observations: Tractable contingency planning with learned behavior models.
IEEE International Conference on Robotics and Automation, (ICRA), 2021.
DOI PDF Cite Project Code
Autonomous Driving Computer Vision Forecasting Imitation Learning Machine Learning Model-Based Control Robotics
placeholder
Paul Vernaza, Wongun Choi, Nicholas Rhinehart.
Generative adversarial inverse trajectory optimization for probabilistic vehicle forecasting.
U.S. Patent 10,739,773, 2020.
PDF Cite
Autonomous Driving Forecasting Generative Models Machine Learning
Nicholas Rhinehart, Rowan McAllister, Sergey Levine.
Deep Imitative Models for Flexible Inference, Planning, and Control.
International Conference on Learning Representations, (ICLR), 2020.
DOI PDF Cite Project Code
Autonomous Driving Computer Vision Forecasting Generative Models Imitation Learning Model-Based Control Reward Learning
Robust imitative planning result animation
Angelos Filos, Panagiotis Tigkas, Rowan McAllister, Nicholas Rhinehart, Sergey Levine, Yarin Gal.
Can autonomous vehicles identify, recover from, and adapt to distribution shifts?.
International Conference on Machine Learning, (ICML), 2020.
DOI PDF Cite Project
Autonomous Driving Computer Vision Imitation Learning Model-Based Control Machine Learning
Nicholas Rhinehart, Rowan McAllister, Kris Kitani, Sergey Levine.
PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settings.
Proceedings of the IEEE International Conference on Computer Vision, (ICCV), 2019.
Best Paper Award @ ICML 2019 Workshop on AI for Autonomous Driving
DOI PDF Cite Project Code
Paper Award Forecasting Generative Models Autonomous Driving
Jointly Forecasting and Controlling Behavior by Learning from High-Dimensional Data
Nicholas Rhinehart.
Jointly Forecasting and Controlling Behavior by Learning from High-Dimensional Data.
2019.
DOI PDF Cite Project
Autonomous Driving Forecasting Generative Models Imitation Learning Model-Based Control Reinforcement Learning Reward Learning
Nicholas Rhinehart, Kris M. Kitani, Paul Vernaza.
R2P2: A Reparameterized Pushforward Policy for Diverse, Precise Generative Path Forecasting.
Proceedings of the European Conference on Computer Vision, (ECCV), 2018.
DOI PDF Cite
Autonomous Driving Imitation Learning Forecasting Generative Models Machine Learning Reward Learning