[ ๐บ Website | ๐ Github Repo | ๐ Paper ]
- PyTorch >= 1.4
- CrossTask Dataset
Follow this folder structure to prepare the dataset:
.
โโโ crosstask
โโโ crosstask_features
โโโ crosstask_release
โโโ tasks_primary.txt
โโโ videos.csv
โโโ videos_val.csv
The data root is set here train_gpt.py.
conda create -f environment.yml
bash srun.sh
We appreciate the following github repos a lot for their valuable code base implementations: joaanna/something_else, karpathy/minGPT.
@ARTICLE{PlaTe_RAL_2022,
author={Sun, Jiankai and Huang, De-An and Lu, Bo and Liu, Yun-Hui and Zhou, Bolei and Garg, Animesh},
journal={IEEE Robotics and Automation Letters},
title={PlaTe: Visually-Grounded Planning With Transformers in Procedural Tasks},
year={2022}, volume={7}, number={2}, pages={4924-4930},
doi={10.1109/LRA.2022.3150855}}