Awesome
PlaTe: Visually-Grounded Planning with Transformers in Procedural Tasks
[ šŗ Website | š Github Repo | š Paper ]
Requirements
- PyTorch >= 1.4
- CrossTask Dataset
Data Preparation
Follow this folder structure to prepare the dataset:
.
āāā crosstask
āāā crosstask_features
āāā crosstask_release
āāā tasks_primary.txt
āāā videos.csv
āāā videos_val.csv
The data root is set here train_gpt.py.
How to Run
conda create -f environment.yml
bash srun.sh
Acknowledgement
We appreciate the following github repos a lot for their valuable code base implementations: joaanna/something_else, karpathy/minGPT.
Citation
@ARTICLE{PlaTe_RAL_2022,
author={Sun, Jiankai and Huang, De-An and Lu, Bo and Liu, Yun-Hui and Zhou, Bolei and Garg, Animesh},
journal={IEEE Robotics and Automation Letters},
title={PlaTe: Visually-Grounded Planning With Transformers in Procedural Tasks},
year={2022}, volume={7}, number={2}, pages={4924-4930},
doi={10.1109/LRA.2022.3150855}}