Awesome

Presto & WorldCereal

How to run

Install dependencies:

pip install -r requirements.txt

Follow instructions in data/README.md to get data.

Run MAE pretraining from random init:

python train.py

Run MAE pretraining starting from pretrained (on Presto data) params:

python train.py --warm_start

To skip MAE training and only run evaluation (including supervised finetuning), starting from pretrained Presto weights, use --n_epochs 0 and --warm_start:

python train.py --n_epochs 0 --warm_start

To skip MAE training and only run evaluation (including supervised finetuning), starting from randomly initialized weights, use --n_epochs 0:

python train.py --n_epochs 0