Awesome
HUAL
CVPR 2023 "Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-based Active Learning"
Prerequisites
- pip install
Preparation
The visual features of Charades-STA
and ActivityNet Captions
are available at Box Drive.
Download the word embeddings from here. Modify the path setting in ./configs/charades/SeqPAN.yaml
.
Download the anet initiate pkl from Box Drive. , put it to ./results/anet/re0.pkl
Directory hierarchies are shown below:
HUAL
|____ ckpt/
|____ logs/
|____ data_pkl/
|____ data/
|____ anet_gt/
|____ anet_re0/
|____ anet_re1/
...
|____ anet_re10/
|___ results/
|____ anet/re0.pkl
|____ charades/re0.pkl
...
Quick Start
Train
python run_charades.py
python run_anet.py
# it include three step:
# 1. Update pseudo label.
# 2. Train model.
# 3. Infer prediction of train dataset.
Citation
If you feel this project is helpful to your research, please cite our work.
@InProceedings{Ji_2023_CVPR,
author = {Ji, Wei and Liang, Renjie and Zheng, Zhedong and Zhang, Wenqiao and Zhang, Shengyu and Li, Juncheng and Li, Mengze and Chua, Tat-seng},
title = {Are Binary Annotations Sufficient? Video Moment Retrieval via Hierarchical Uncertainty-Based Active Learning},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
month = {June},
year = {2023},
pages = {23013-23022}
}