Awesome
PointGLR
This repository contains the PyTorch implementation for paper Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds (CVPR 2020) [arXiv]
If you find our work useful in your research, please consider citing:
@inproceedings{rao2020global,
title={Global-Local Bidirectional Reasoning for Unsupervised Representation Learning of 3D Point Clouds},
author={Rao, Yongming and Lu, Jiwen and Zhou, Jie},
booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year={2020}
}
Usage
Requirement
- Python 3
- Pytorch 0.4
- CMake > 2.8
Note: The code is not not compatible with Pytorch >= 1.0 due to the C++/CUDA extensions.
Building C++/CUDA Extensions for PointNet++
mkdir build && cd build
cmake .. && make
Dataset Preparation
ModelNet
- Download ModelNet point clouds (XYZ and normal):
mkdir dataset && cd dataset
wget https://shapenet.cs.stanford.edu/media/modelnet40_normal_resampled.zip
unzip modelnet40_normal_resampled.zip
- Preprocess dataset:
CUDA_VISIBLE_DEVICES=0 python tools/prepare_modelnet.py
ScanNet
You can download our prepared ScanNet dataset for object classification from Google Drive and move the uncompressed data folder to dataset/scannet
. The data structure should be:
dataset/scannet
├── train_files.txt
├── test_files.txt
├── train_0.h5
...
├── test_0.h5
...
ScanObjectNN
The ScanObjectNN dataset can be found here. You can download the h5_files.zipped
and move the uncompressed data folder to dataset/ScanObjectNN
. The data sturcture should be:
dataset/ScanObjectNN
├── main_split
| └── training_objectdataset.h5
| ...
├── main_split_nobg
| └── training_objectdataset.h5
| ...
...
Training & Evaluation
To train an SSG PointNet++ model on ModelNet:
bash train.sh exp_name pointnet2 modelnet
To train an SSG RSCNN model on ModelNet:
bash train.sh exp_name pointnet2 modelnet
You can modify multiplier
in cfgs/config.yaml
to train larger models. As a reference, the unsupervisedly trained 1x SSG PointNet++ and 1x SSG RSCNN models should have around 92.2% accuracy on ModelNet40. By increasing channel width (4x~5x), our best PointNet++ and RSCNN models achieved around 93.0% accuracy. The results might vary by 0.2%~0.5% between identical runs due to different random seed.
To obtain the results on ScanNet:
bash train.sh exp_name pointnet2 scannet
To obtain the results on ScanObjectNN:
bash train.sh exp_name pointnet2 scanobjectnn
Note that for experiments on ScanNet and ScanObjectNN, the feature extraction network is still trained on ModelNet. We only train the Linear SVM classifier on the corresponding dataset to obtain the classification results.
Acknowledgement
The code is based on Relation-Shape CNN and Pointnet2_PyTorch.
Contact
If you have any questions about our work, please contact raoyongming95@gmail.com