Awesome
<div align="center"> <h1>RecurrentBEV</h1> <h3>[ECCV 2024] RecurrentBEV: A Long-term Temporal Fusion Framework for Multi-view 3D Detection</h3> </div> <div align="center"> <img src="resources/paper_paradigm.jpg" width="800"/> </div><br/>Introduction
This repository is an official implementation of RecurrentBEV. It is built based on MMDetection3D.
Main Results
<img title="" src="resources/res50_bench.jpg" alt="" data-align="left" width="600">NuScenes Val Set
| Backbone | Img Size | Pretrain | NDS | mAP | Config | Download |
|---|---|---|---|---|---|---|
| Res50 | 256x704 | ImageNet | 54.9 | 44.5 | config | model |
| Res101 | 512x1408 | ImageNet | 59.9 | 50.9 | config | - |
| Res101 | 512x1408 | NuImages | 61.2 | 52.8 | config | model |
NuScenes Test Set
| Backbone | Img Size | Pretrain | NDS | mAP | Config | Download |
|---|---|---|---|---|---|---|
| V2-99 | 640x1600 | DD3D | 65.1 | 57.3 | config | model |
| ConvNeXt-B | 640x1600 | COCO | 65.1 | 57.4 | config | - |
Inference Speed
The below table shows end-to-end FPS (Frames Per Second) of RecurrentBEV measured with a single RTX-3090.
| Method | Pytorch-FP32 | TensorRT-FP32 | TensorRT-FP16 | TensorRT-INT8 |
|---|---|---|---|---|
| RecurrentBEV | 25.6 | 46.3 | 129.3 | 234.8 |
| StreamPETR | 26.7 | 53.9 | 134.6 | 167.4 |
Getting Started
Please follow our documentation step by step. If you like our work, please recommend it to your colleagues and friends.
Features List
- RecurretBEV code
- Visualization
- Convert to TRT model
- TensorRT inference
Acknowledgements
We thank these great works and open-source codebases:
Citation
If you find RecurrentBEV is useful in your research or applications, please consider giving us a star 🌟 and citing it by the following BibTeX entry.