Home

Awesome

<p align="center"> <img width="1000" src="./assets/teaser.png"/> </p>

Paper List in the survey paper

The papers that we are surveying are listed in this file. The papers are grouped by the following categories:

The taxonomy is shown in this figure,

<p align="center"> <img width="1000" src="./assets/taxonomy.png"/> </p>

We list all the papers surveyed in our paper. The dates are based on the first released date on arxiv. This list will be constantly updated.

NOTE: We only include papers with experiments on real physical robotics, in high-fidelity robotic simulation environments, or using real robotics datasets.

Foundation models used in Robotics

Perception

Task Planning

<!-- - **Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agents**, 2022 [paper link](https://arxiv.org/pdf/2201.07207.pdf) -->

Action Generation

Data Generation

Robotic Foundation Models

Single-Purpose

Action Generation

<!-- - **Pre-Trained Language Models for Interactive Decision-Making**, 2022, [paper link](https://arxiv.org/pdf/2202.01771.pdf) -->

General-Purpose

Related Surveys and repositories

Robotics surveys

Foundation models surveys

Foundation models and robotics

BibTex

If you find our survey paper helpful, please kindly consider citing us:

@article{hu2023robofm,
      author = {Yafei Hu and Quanting Xie and Vidhi Jain and Jonathan Francis and Jay Patrikar and 
                  Nikhil Keetha and Seungchan Kim and Yaqi Xie and Tianyi Zhang and Hao-Shu Fang and Shibo Zhao 
                  and Shayegan Omidshafiei and Dong-Ki Kim and Ali-akbar Agha-mohammadi and Katia Sycara and 
                  Matthew Johnson-Roberson and Dhruv Batra and Xiaolong Wang and Sebastian Scherer and Chen Wang 
                  and Zsolt Kira and Fei Xia and Yonatan Bisk},
      title = {Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis},
      booktitle = {arXiv preprint: arXiv:2312.08782 },
      year = {2023},
}