Awesome
Surface Reconstruction from Point Clouds by Learning Predictive Context Priors (CVPR 2022)
<h2 align="center"><a href="https://mabaorui.github.io/">Personal Web Pages</a> | <a href="https://arxiv.org/abs/2204.11015">Paper</a> | <a href="https://mabaorui.github.io/PredictableContextPrior_page/">Project Page</a></h2> This repository contains the code to reproduce the results from the paper. [Surface Reconstruction from Point Clouds by Learning Predictive Context Priors](https://arxiv.org/abs/2204.11015).You can find detailed usage instructions for training your own models and using pretrained models below.
If you find our code or paper useful, please consider citing
@inproceedings{PredictiveContextPriors,
title = {Surface Reconstruction from Point Clouds by Learning Predictive Context Priors},
author = {Baorui, Ma and Yu-Shen, Liu and Matthias, Zwicker and Zhizhong, Han},
booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2022}
}
Pytorch Version
This work was originally implemented by tensorflow, pytroch version of the code will be released soon that is easier to use.
Related work
Pytorch
https://github.com/mabaorui/NeuralPull-Pytorch
Tensorflow
https://github.com/mabaorui/NeuralPull
https://github.com/mabaorui/OnSurfacePrior
https://github.com/mabaorui/PredictableContextPrior
Surface Reconstruction Demo
<p align="left"> <img src="img/Teaser1.jpg" width="780" /> </p> <p align="left"> <img src="img/abccomp.jpg" width="780" /> </p> <p align="left"> <img src="img/bim_points.png" width="390" /><img src="img/bim_mesh.png" width="390" /> </p>Predicted Queries Visualization
<p align="left"> <img src="img/2d_test.png" width="260" /><img src="img/2d_train.png" width="260" /><img src="img/2d_query.png" width="260" /> </p>Predicted queries in Loccal Coorinate System
<p align="left"> <img src="img/test1.gif" width="780" /> </p>Installation
First you have to make sure that you have all dependencies in place. The simplest way to do so, is to use anaconda.
You can create an anaconda environment called tf
using
conda env create -f tf.yaml
conda activate tf
Training
You should train the Local Context Prior Network first, run
python pcp.py --input_ply_file test.ply --data_dir ./data/ --CUDA 0 --OUTPUT_DIR_LOCAL ./local_net/ --OUTPUT_DIR_GLOBAL ./glocal_net/ --train --save_idx -1
You should put the point cloud file(--input_ply_file, only ply format) into the '--data_dir' folder.
Then train the Predictive Context Prior Network, run
python pcp.py --input_ply_file test.ply --data_dir ./data/ --CUDA 0 --OUTPUT_DIR_LOCAL ./local_net/ --OUTPUT_DIR_GLOBAL ./glocal_net/ --finetune --save_idx -1
Test
You can extract the mesh model from the trained network, run
python pcp.py --input_ply_file test.ply --data_dir ./data/ --CUDA 0 --OUTPUT_DIR_LOCAL ./local_net/ --OUTPUT_DIR_GLOBAL ./glocal_net/ --test --save_idx -1
ToDo
In different datasets or your own data, because of the variation in point cloud density, this '0.5' parameter has a very strong influence on the final result, which controls the distance between the query points and the point cloud. So if you want to get better results, you should adjust this parameter. We give '0.5' here as a reference value, and this value can be used for most object-level reconstructions. For the scene dataset, we will later publish the reference values for the hyperparameter settings for the scene dataset.