Home

Awesome

<div align="center"> <h1>Far3D</h1> <h3> [AAAI2024] Expanding the Horizon for Surround-view 3D Object Detection </h3> </div>

PWC arXiv

Introduction

This repository is an official implementation of Far3D.

Expanding existing methods directly to cover long distances poses challenges such as heavy computation costs and unstable convergence. To address these limitations, we proposes a novel sparse query-based framework, dubbed Far3D. By utilizing high-quality 2D object priors, we generate 3D adaptive queries that complement the 3D global queries. To efficiently capture discriminative features across different views and scales for long-range objects, we introduce a perspective-aware aggregation module. Additionally, we propose a range-modulated 3D denoising approach to address query error propagation and mitigate convergence issues in long-range tasks.

News

Getting Started

Our pipeline follows StreamPETR, and you can follow Get Started step by step.

Quick Train & Evaluation

Train the model

tools/dist_train.sh projects/configs/far3d.py 8 --work-dir work_dirs/far3d/

Evaluation

tools/dist_test.sh projects/configs/far3d.py work_dirs/far3d/iter_82548.pth 8 --eval bbox

Results on Argoverse 2 Val Set.

ModelBackboneInput sizemAPCDSConfigDownload
BEVStereoVoV-99(960, 640)0.1460.104----
SOLOFusionVoV-99(960, 640)0.1490.106----
PETRVoV-99(960, 640)0.1760.122----
Sparse4Dv2VoV-99(960, 640)0.1890.134----
StreamPETRVoV-99(960, 640)0.2030.146----
Far3DVoV-99(960, 640)0.2440.181configmodel/log

Notes

Acknowledgements

We thank these great works and open-source codebases:

Citation

If you find Far3D is useful in your research or applications, please consider giving us a star 🌟 and citing it by the following BibTeX entry.

@article{jiang2023far3d,
  title={Far3D: Expanding the Horizon for Surround-view 3D Object Detection},
  author={Jiang, Xiaohui and Li, Shuailin and Liu, Yingfei and Wang, Shihao and Jia, Fan and Wang, Tiancai and Han, Lijin and Zhang, Xiangyu},
  journal={arXiv preprint arXiv:2308.09616},
  year={2023}
}