Awesome
Deep Learning for 3D Point Clouds: A Survey (IEEE TPAMI, 2020)
This is the official repository of Deep Learning for 3D Point Clouds: A Survey (IEEE TPAMI), a comprehensive survey of recent progress in deep learning methods for point clouds. For details, please refer to:
Deep Learning for 3D Point Clouds: A Survey <br />
Yulan Guo<sup>∗</sup>, Hanyun Wang<sup>∗</sup>, Qingyong Hu<sup>∗</sup>, Hao Liu<sup>∗</sup>, Li Liu, and Mohammed Bennamoun. <br /> (* indicates equal contribution)
<p align="center"> <img src="./taxonomy.png" width="95%"> </p>Introduction
We present a comprehensive review of recent deep learning methods for point clouds. It covers major tasks in 3D point cloud analysis, including 3D shape classification, 3D object detection, and 3D point cloud segmentation. It also presents comparative results on several publicly available datasets, together with insightful observations and inspiring future research directions. Please feel free to <a href="mailto:qingyong.hu@cs.ox.ac.uk">contact me</a> or create an issue on this page if you have new results to add or any suggestions!
We will update this page on a regular basis! So stay tuned~ :tada::tada::tada:
(1) Datasets
<p align="center"> <img src="./Dataset.png" width="95%"> </p>(2) 3D Shape Classification
Public Datasets
- ModelNet (CVPR'15) [paper] [project page]
- PartNet (CVPR'19) [paper] [data] [project page]
- ScanObjectNN (ICCV'19) [paper] [data] [project page]
Benchmark Results
<p align="center"> <img src="./classification.png" width="95%"> </p>(3) 3D Object Detection
Public Datasets
- KITTI (CVPR'12) [paper] [project page]
- ApolloScape (TPAMI'19) [paper] [data] [results]
- Argoverse (CVPR'19) [paper] [data] [project page]
- A*3D (arXiv'19) [paper] [data] [project page]
- Waymo (arXiv'19) [paper] [data] [project page]
Benchmark Results
<p align="center"> <img src="./detection.png" width="95%"> </p> <p align="center"> <img src="./detection_bev.png" width="95%"> </p>(4) 3D Point Cloud Segmentation
Public Datasets
- Semantic3D (ISPRS'17) [paper] [project page]
- S3DIS (CVPR'17) [paper] [data] [project page]
- ScanNet (CVPR'17) [paper] [data] [project page] [results]
- NPM3D (IJRR'18) [paper] [data] [project page] [results]
- DublinCity (BMVC'19) [paper] [data] [project page]
- SemanticKITTI (ICCV'19) [paper] [data] [project page] [results]
- nuScenes (CVPR'20) [paper] [data] [project page] [results]
- Toronto-3D (CVPRW'20) [paper] [data] [project page] [results]
- DALES (CVPRW'20) [paper] [data] [project page] [results]
- Campus3D (ACM MM'20) [paper] [data] [project page] [results]
- SensatUrban (CVPR'21) [paper] [data][project page] [results]
Benchmark Results
<p align="center"> <img src="./Segmentation.png" width="95%"> </p>Citation
If you find our work useful in your research, please consider citing:
@article{guo2020deep,
title={Deep learning for 3d point clouds: A survey},
author={Guo, Yulan and Wang, Hanyun and Hu, Qingyong and Liu, Hao and Liu, Li and Bennamoun, Mohammed},
journal={IEEE transactions on pattern analysis and machine intelligence},
year={2020},
publisher={IEEE}
}
Updates
- 26/02/2020: Adding the dataset information
- 27/12/2019: Initial release.
Related Repos
- RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds
- SensatUrban: Learning Semantics from Urban-Scale Photogrammetric Point Clouds
- 3D-BoNet: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds
- SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration
- SQN: Weakly-Supervised Semantic Segmentation of Large-Scale 3D Point Clouds with 1000x Fewer Labels