Awesome

<img alt="image" src='media/lady-gaga.png' height="30px"> Gaga : Group Any Gaussians via 3D-aware Memory Bank

Weijie Lyu, Xueting Li, Abhijit Kundu, Yi-Hsuan Tsai, Ming-Hsuan Yang<br> University of California, Merced - Nvidia - Google

Gaga groups any Gaussians in an open-world 3D scene and renders multi-view consistent segmentation.<br> Codes will be released soon.<br> If you need the codes now, please contact the first author via email (wlyu3@ucmerced.edu).

Results

🗺️ Open-world 3D Segmentation

🖌️ Scene Editing

✨ Change the color of cushion on <img src="media/footstool.png" width="50"> to maroon 🟥<br> ✨ Remove <img src="media/stuffed.png" width="50">

https://github.com/weijielyu/Gaga/assets/47323245/803f049f-8930-445c-bc1a-b8bb12df0fbf

Citation

If you find our work useful for your project, please consider citing our paper.

@misc{lyu2024gaga,
      title={Gaga: Group Any Gaussians via 3D-aware Memory Bank}, 
      author={Weijie Lyu and Xueting Li and Abhijit Kundu and Yi-Hsuan Tsai and Ming-Hsuan Yang},
      year={2024},
      eprint={2404.07977},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Awesome

<img alt="image" src='media/lady-gaga.png' height="30px"> Gaga : Group Any Gaussians via 3D-aware Memory Bank

Results

🗺️ Open-world 3D Segmentation

MipNeRF 360

Replica

ScanNet

🖌️ Scene Editing

Citation