Home

Awesome

<div align="center"> <h1>SimPB</h1> <h3> [ECCV 2024] SimPB: A Single Model for 2D and 3D Object Detection from Multiple Cameras </h3>

arXiv

</div>

method

Introduction

This repository is an official implementation of SimPB, which Simultaneously detects 2D objects in the Perspective view and 3D objects in the BEV space from multiple cameras.

Getting started

Model Zoo

Results on NuScenes validation

methodbackbonepretrainimg sizemAPNDSconfigckptlog
SimPB+ResNet50ImageNet704x2560.4790.586configckptlog
SimPB+ResNet50nuImg704x2560.4890.591configckptlog
SimPBResNet101nuImg1408x5120.5390.629

Note: SimPB+ is a modified architecture that introduces 2d denoise and removes the encoder. This slightly reduces the runtime while maintaining comparable performance compared to the released script.

Acknowledgement

Thanks to these excellent open-source works:

Sparse4Dv3, StreamPETR, SparseBEV, Far3D, MMDetection3D

Citation

 @article{simpb,
  title={SimPB: A Single Model for 2D and 3D Object Detection from Multiple Cameras},
  author={Yingqi Tang and Zhaotie Meng and Guoliang Chen and Erkang Cheng},
  journal={ECCV},
  year={2024}
}