Awesome

Hyper-3DG:<br> Text-to-3D Gaussian Generation via Hypergraph

<font color=#FF0000>Accepted by IJCV</font>

Hyper-3DG pioneers a novel framework for text-to-3D generation that seamlessly integrates hypergraph learning with 3D Gaussian splatting, achieving high-fidelity and structurally coherent 3D models from textual descriptions without compromising computational efficiency.

</div>

Abstract: Text-to-3D generation represents an exciting field that has seen rapid advancements, facilitating the transformation of textual descriptions into detailed 3D models. However, current progress often neglects the intricate high-order correlation of geometry and texture within 3D objects, leading to challenges such as over-smoothness, over-saturation and the Janus problem. In this work, we propose a method named “3D Gaussian Generation via Hypergraph (Hyper-3DG)”, designed to capture the sophisticated high-order correlations present within 3D objects. Our framework is anchored by a well-established mainflow and an essential module, named “Geometry and Texture Hypergraph Refiner (HGRefiner)”. This module not only refines the representation of 3D Gaussians but also accelerates the update process of these 3D Gaussians by conducting the Patch-3DGS Hypergraph Learning on both explicit attributes and latent visual features. Our framework allows for the production of finely generated 3D objects within a cohesive optimization, effectively circumventing degradation. Extensive experimentation has shown that our proposed method significantly enhances the quality of 3D generation while incurring no additional computational overhead for the underlying framework.

Framework

Hyper-3DG framework

Video results

More Video Results here & Prompts for Showing Videos here and here

https://github.com/user-attachments/assets/83913e18-7eb7-4dda-94b7-275f8336f09c

https://github.com/user-attachments/assets/13263ce7-d63a-4c35-888b-926edc589d94

https://github.com/user-attachments/assets/03ba1ebe-3961-4b3e-b036-2bcb905d2e60

https://github.com/user-attachments/assets/63526bfa-874d-441c-b651-3496ac111960

https://github.com/user-attachments/assets/af150e12-b3a1-4569-8f8d-592d9f75d2cd

https://github.com/user-attachments/assets/3d308045-f445-46a9-9565-9bf5d4184ba9

Acknowledgements

We would like to express our gratitude to the authors of the following works, which have greatly influenced our project:

Citation

@misc{di2024hyper3dg,
      title={Hyper-3DG: Text-to-3D Gaussian Generation via Hypergraph}, 
      author={Donglin Di and Jiahui Yang and Chaofan Luo and Zhou Xue and Wei Chen and Xun Yang and Yue Gao},
      year={2024},
      eprint={2403.09236},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}