Autonomous Driving

All Publication Topics Autonomous Driving Autonomous Exploration Benchmarks Compression Computer Vision First-Person Video Forecasting Generative Models Imitation Learning Intrinsic Control Machine Learning Offroad Navigation Paper Award Planning Reinforcement Learning Reward Learning Robotics

CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting

Jiezhi Yang, Khushi Desai, Charles Packer, Harshil Bhatia, Nicholas Rhinehart, Rowan McAllister, Joseph Gonzalez.
CARFF: Conditional Auto-encoded Radiance Field for 3D Scene Forecasting.
European Conference on Computer Vision, (ECCV), 2024.

Autonomous Driving Computer Vision Forecasting Generative Models Machine Learning Robotics

The Waymo Open Sim Agents Challenge

Nico Montali, John Lambert, Paul Mougin, Alex Kuefler, Nicholas Rhinehart, Michelle Li, Cole Gulino, Tristan Emrich, Zoey Yang, Shimon Whiteson, Brandyn White, Dragomir Anguelov.
The Waymo Open Sim Agents Challenge.
Advances in Neural Information Processing Systems, (NeurIPS), 2023.

Autonomous Driving Benchmarks Computer Vision Forecasting Imitation Learning Machine Learning Robotics

Is anyone there? learning a planner contingent on perceptual uncertainty

Charles Packer, Nicholas Rhinehart, Rowan McAllister, Matthew a Wright, Xin Wang, Jeff He, Sergey Levine, Joseph E Gonzalez.
Is anyone there? learning a planner contingent on perceptual uncertainty.
Conference on Robot Learning, (CoRL), 2023.

Autonomous Driving Computer Vision Forecasting Generative Models Machine Learning Planning Robotics

S2Net: Stochastic Sequential Pointcloud Forecasting

Xinshuo Weng, Junyu Nan, Kuan-Hui Lee, Rowan McAllister, Adrien Gaidon, Nicholas Rhinehart, Kris Kitani.
S2Net: Stochastic Sequential Pointcloud Forecasting.
European Conference on Computer Vision, (ECCV), 2022.

Autonomous Driving Forecasting Generative Models Machine Learning

Ving: Learning open-world navigation with visual goals

Dhruv Shah, Benjamin Eysenbach, Gregory Kahn, Nicholas Rhinehart, Sergey Levine.
Ving: Learning open-world navigation with visual goals.
IEEE International Conference on Robotics and Automation, (ICRA), 2021.

Autonomous Driving Computer Vision Machine Learning Offroad Navigation Planning Robotics

Inverting the pose forecasting pipeline with SPF2: Sequential pointcloud forecasting for sequential pose forecasting

Xinshuo Weng, Jianren Wang, Sergey Levine, Kris Kitani, Nicholas Rhinehart.
Inverting the pose forecasting pipeline with SPF2: Sequential pointcloud forecasting for sequential pose forecasting.
Conference on robot learning, (CoRL), 2021.

Autonomous Driving Computer Vision Generative Models Machine Learning Robotics

Contingencies from observations: Tractable contingency planning with learned behavior models

Nicholas Rhinehart, Jeff He, Charles Packer, Matthew a Wright, Rowan McAllister, Joseph E Gonzalez, Sergey Levine.
Contingencies from observations: Tractable contingency planning with learned behavior models.
IEEE International Conference on Robotics and Automation, (ICRA), 2021.

Autonomous Driving Computer Vision Forecasting Imitation Learning Machine Learning Planning Robotics

Deep Imitative Models for Flexible Inference, Planning, and Control

Nicholas Rhinehart, Rowan McAllister, Sergey Levine.
Deep Imitative Models for Flexible Inference, Planning, and Control.
International Conference on Learning Representations, (ICLR), 2020.

Autonomous Driving Computer Vision Forecasting Generative Models Imitation Learning Planning Reward Learning

Can autonomous vehicles identify, recover from, and adapt to distribution shifts?

Angelos Filos, Panagiotis Tigkas, Rowan McAllister, Nicholas Rhinehart, Sergey Levine, Yarin Gal.
Can autonomous vehicles identify, recover from, and adapt to distribution shifts?.
International Conference on Machine Learning, (ICML), 2020.

Autonomous Driving Computer Vision Imitation Learning Planning Machine Learning

PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settings

Nicholas Rhinehart, Rowan McAllister, Kris Kitani, Sergey Levine.
PRECOG: PREdiction Conditioned On Goals in Visual Multi-Agent Settings.
Proceedings of the IEEE International Conference on Computer Vision, (ICCV), 2019.
Best Paper Award @ ICML 2019 Workshop on AI for Autonomous Driving

Paper Award Forecasting Generative Models Autonomous Driving

Jointly Forecasting and Controlling Behavior by Learning from High-Dimensional Data

Nicholas Rhinehart.
Jointly Forecasting and Controlling Behavior by Learning from High-Dimensional Data.
2019.

Autonomous Driving Forecasting Generative Models Imitation Learning Planning Reinforcement Learning Reward Learning

R2P2: A Reparameterized Pushforward Policy for Diverse, Precise Generative Path Forecasting

Nicholas Rhinehart, Kris M. Kitani, Paul Vernaza.
R2P2: A Reparameterized Pushforward Policy for Diverse, Precise Generative Path Forecasting.
Proceedings of the European Conference on Computer Vision, (ECCV), 2018.

Autonomous Driving Imitation Learning Forecasting Generative Models Machine Learning Reward Learning