Home

Awesome

<div align="center">

Instances as Queries

</div> <!-- [![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/queryinst-parallelly-supervised-mask-query/instance-segmentation-on-coco-minival)](https://paperswithcode.com/sota/instance-segmentation-on-coco-minival?p=queryinst-parallelly-supervised-mask-query) [![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/queryinst-parallelly-supervised-mask-query/instance-segmentation-on-coco)](https://paperswithcode.com/sota/instance-segmentation-on-coco?p=queryinst-parallelly-supervised-mask-query) [![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/queryinst-parallelly-supervised-mask-query/object-detection-on-coco-minival)](https://paperswithcode.com/sota/object-detection-on-coco-minival?p=queryinst-parallelly-supervised-mask-query) [![PWC](https://img.shields.io/endpoint.svg?url=https://paperswithcode.com/badge/queryinst-parallelly-supervised-mask-query/object-detection-on-coco)](https://paperswithcode.com/sota/object-detection-on-coco?p=queryinst-parallelly-supervised-mask-query) --> <div align="center"> <img width="100%" alt="QueryInst-VIS Demo" src="https://user-images.githubusercontent.com/45201863/120617230-7d34a600-c48c-11eb-8a43-d61689a050be.gif"> </div>

Instances as Queries

by Yuxin Fang*, Shusheng Yang*, Xinggang Wang†, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu.

(*) equal contribution, (†) corresponding author.

ICCV2021 Paper

QueryInst

Main Results on COCO test-dev

ConfigsAug.WeightsBox APMask AP
QueryInst_Swin_L_300_queries (single scale testing)400 ~ 1200, w/ Cropbaidu / google56.149.1

Main Results on COCO val

ConfigsAug.WeightsBox APMask AP
QueryInst_R50_3x_300_queries480 ~ 800, w/ Cropbaidu / google46.941.4
QueryInst_R101_3x_300_queries480 ~ 800, w/ Cropbaidu / google48.042.4
QueryInst_X101-DCN_3x_300_queries480 ~ 800, w/ Crop-50.344.2
QueryInst_Swin_L_300_queries (single scale testing)400 ~ 1200, w/ Cropbaidu / google56.148.9

Notes:

Getting Started

python setup.py develop
mkdir data && cd data
ln -s /path/to/coco coco
python tools/train.py configs/queryinst/queryinst_r50_fpn_1x_coco.py
./tools/dist_train.sh configs/queryinst/queryinst_r50_fpn_1x_coco.py 8
python tools/test.py configs/queryinst/queryinst_r50_fpn_1x_coco.py PATH/TO/CKPT.pth --eval bbox segm
./tools/dist_test.sh configs/queryinst/queryinst_r50_fpn_1x_coco.py PATH/TO/CKPT.pth 8 --eval bbox segm

Citation

If you find our paper and code useful in your research, please consider giving a star :star: and citation :pencil: :

@InProceedings{Fang_2021_ICCV,
    author    = {Fang, Yuxin and Yang, Shusheng and Wang, Xinggang and Li, Yu and Fang, Chen and Shan, Ying and Feng, Bin and Liu, Wenyu},
    title     = {Instances As Queries},
    booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
    month     = {October},
    year      = {2021},
    pages     = {6910-6919}
}
@article{QueryTrack,
  title={Tracking Instances as Queries},
  author={Yang, Shusheng and Fang, Yuxin and Wang, Xinggang and Li, Yu and Shan, Ying and Feng, Bin and Liu, Wenyu},
  journal={arXiv preprint arXiv:2106.11963},
  year={2021}
}

TODO