Home

Awesome

<p align="center"> <h2 align="center">NeLiS: Neural Light Simulator for 📷Camera-Light🔦 Calibration</h2> <!-- <p align="center"> <h4 align="center"><a href="https://www.linkedin.com/in/kaining/">Kaining Huang</a> | <a href="https://scholar.google.com/citations?user=n11gQKoAAAAJ&hl=en"><strong>Tianyi Zhang</strong></a></h4> </p> --> </p> <br>

“There are two ways of spreading light: to be the candle or the mirror that receives it.” ― Edith Wharton (1862-1937)

<p align="center"> <img src="cmu_ri_logo.png" alt="Logo" width="40%""> <img src="NOAA_logo_mobile.svg" alt="Logo" width="25%"> </a> </p> <p align="center"> <a href=""> <img src="darkgs.gif" alt="Logo" width="100%"> </a> </p>

Dependencies

pip install git+https://github.com/princeton-vl/lietorch.git PySide6

Quick Start

  1. Clone the repo:
https://github.com/tyz1030/neuralight.git
  1. Run gui.py:
python3 gui.py

  Our toy dataset will be automatically loaded.
  3. Load our toy data checkpoint by simply click "LOAD" button on the gui.
  4. Check the (checkbox next to the) parameters you want to optimize and uncheck those to be freezed.
  5. Click "START" to start finetuning the model.
  6. Click "SAVE" to save your finetuned model.
  7. For more instructions see the following illustration:

<p align="center"> <a href=""> <img src="nelis_instruction.png" alt="Logo" width="100%"> </a> </p>

Make Your Own Calibration Target

An example calibration target can be downloaded here but feel free to generate your own target. We use moms-apriltag.

Citation

Arxiv

@misc{zhang2024darkgs,
      title={DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark}, 
      author={Tianyi Zhang and Kaining Huang and Weiming Zhi and Matthew Johnson-Roberson},
      year={2024},
      eprint={2403.10814},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Acknowledgement