Awesome

Awesome Neural Radiance Fields

A curated list of awesome neural radiance fields papers, inspired by awesome-computer-vision.

How to submit a pull request?

Want to help maintain the list?

Table of Contents

• Survey
• Papers
• Talks
• Implementations

Survey

• Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review, Thang-Anh-Quan Nguyen*, Amine Bourki*, Màtyàs Macudzinski, Anthony Brunel, and Mohammed Bennamoun (*: Equal contribution), Arxiv 2024 | github | bibtex
• BeyondPixels: A Comprehensive Review of the Evolution of Neural Radiance Fields, AKM Shahariar Azad Rabby and Chengcui Zhang, Arxiv 2023 | bibtex
• Neural Volume Rendering: NeRF And Beyond, Dellaert and Yen-Chen, Arxiv 2020 | blog | github | bibtex
• NeRF: Neural Radiance Field in 3D Vision, Introduction and Review, Kyle Gao, Yina Gao, Hongjie He, Dening Lu, Linlin Xu, Jonathan Li
• Neural Fields in Robotics: A Survey, Muhammad Zubair Irshad, Mauro Comi, Yen-Chen Lin, Nick Heppert, Abhinav Valada, Zsolt Kira, Rares Ambrus, Johnathan Trembley

Papers

• NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis, Mildenhall et al., ECCV 2020 | github | bibtex <!---Mildenhall20eccv_nerf-->

• Learning Neural Transmittance for Efficient Rendering of Reflectance Fields, Mohammad Shafiei et al., BMVC 2021 | bibtex
• Neural Sparse Voxel Fields, Liu et al., NeurIPS 2020 | github | bibtex <!---Liu20neurips_sparse_nerf-->
• AutoInt: Automatic Integration for Fast Neural Volume Rendering, Lindell et al., CVPR 2021 | github | bibtex <!---Lindell20arxiv_AutoInt-->
• DeRF: Decomposed Radiance Fields, Rebain et al. Arxiv 2020 | bibtex <!---Rebain20arxiv_derf-->
• DONeRF: Towards Real-Time Rendering of Compact Neural Radiance Fields using Depth Oracle Networks, Neff et al., CGF 2021 | github | bibtex <!---neff2021donerf-->
• FastNeRF: High-Fidelity Neural Rendering at 200FPS, Garbin et al., Arxiv 2021 | bibtex <!---Garbin21arxiv_FastNeRF-->
• KiloNeRF: Speeding up Neural Radiance Fields with Thousands of Tiny MLPs , Reiser et al., ICCV 2021 | github | bibtex <!---reiser2021kilonerf-->
• PlenOctrees for Real-time Rendering of Neural Radiance Fields, Yu et al., Arxiv 2021 | github | bibtex <!---yu2021plenoctrees-->
• Mixture of Volumetric Primitives for Efficient Neural Rendering, Lombardi et al., SIGGRAPH 2021 | bibtex
• Light Field Networks: Neural Scene Representations with Single-Evaluation Rendering, Sitzmann et al., Arxiv 2021 | github | bibtex
• RT-NeRF: Real-Time On-Device Neural Radiance Fields Towards Immersive AR/VR Rendering, Li et al., ICCAD 2022 | bibtex
• ENeRF: Efficient Neural Radiance Fields for Interactive Free-viewpoint Video, Lin et al., SIGGRAPH 2022 | github | bibtex
• R2L: Distilling Neural Radiance Field to Neural Light Field for Efficient Novel View Synthesis, Wang et al., ECCV 2022 | github | bibtex <!---wang2022r2l-->
• Real-Time Neural Light Field on Mobile Devices, Cao et al., Arxiv 2022 | github | bibtext <!---cao2022mobiler2l-->
• Hardware Acceleration of Neural Graphics, Mubarik et al., ISCA 2023 | bibtext <!---mubarik2023hardware-->
• DyLiN: Making Light Field Networks Dynamic, Yu et al., CVPR 2023 | github | bibtext <!---yu2023dylin-->

• Depth-supervised NeRF: Fewer Views and Faster Training for Free, Deng et al., Arxiv 2021 | github | bibtex
• Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstruction, Sun et al., CVPR 2022 | github | bibtex <!---sun2021direct-->
• Instant Neural Graphics Primitives with a Multiresolution Hash Encoding, Müller et al., SIGGRAPH 2022 | github | bibtex
• Plenoxels Radiance Fields without Neural Networks, Yu et al., CVPR 2022 | github | bibtex
• TensoRF: Tensorial Radiance Fields, Chen et al., ECCV 2022 | github | bibtex
• BakedSDF: Meshing Neural SDFs for Real-Time View Synthesis, Yariv et al., Arxiv 2023 | bibtex
• Lightning NeRF: Efficient Hybrid Scene Representation for Autonomous Driving, Cao et al. ICRA 2024 | github | bibtex

• Variable Bitrate Neural Fields, Takikawa et al., SIGGRAPH 2022 | github | bibtex

• NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collections, Martin-Brualla et al., CVPR 2021 | bibtex <!---MartinBrualla20arxiv_nerfw-->
• Ha-NeRF:laughing:: Hallucinated Neural Radiance Fields in the Wild, Chen et al., CVPR 2022 | github | bibtex <!---chen2021hallucinated-->
• HDR-Plenoxels: Self-Calibrating High Dynamic Range Radiance Fields, Jun-seong et al., ECCV 2022 | github | bibtex <!---Jun-seong2022hdr-plenoxels-->
• UP-NeRF: Unconstrained Pose-Prior-Free Neural Radiance Fields, In-jae et al., NeurIPS 2023 | github | bibtex <!---kim2023upnerf-->

• Deformable Neural Radiance Fields, Park et al., Arxiv 2020 | github | bibtex <!---Park20arxiv_nerfies-->
• D-NeRF: Neural Radiance Fields for Dynamic Scenes, Pumarola et al., CVPR 2021 | github | bibtex <!---Pumarola20arxiv_D_NeRF-->
• Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstruction, Gafni et al., CVPR 2021 | github | bibtex <!---Gafni20arxiv_DNRF-->
• Non-Rigid Neural Radiance Fields: Reconstruction and Novel View Synthesis of a Deforming Scene from Monocular Video, Tretschk et al., Arxiv 2020 | github | bibtex <!---Tretschk20arxiv_NR-NeRF-->
• PVA: Pixel-aligned Volumetric Avatars, Raj et al., CVPR 2021 | bibtex
• Neural Articulated Radiance Field, Noguchi et al., Arxiv 2021 | github | bibtex
• CLA-NeRF: Category-Level Articulated Neural Radiance Field, Tseng et al., ICRA 2022 | bibtex
• Animatable Neural Radiance Fields for Modeling Dynamic Human Bodies, Peng et al., ICCV 2021 | github | bibtex <!---Peng21arxiv_animatable_nerf-->
• A Higher-Dimensional Representation for Topologically Varying Neural Radiance Fields, Park et al., Arxiv 2021 | github | bibtex
• IBRNet: Learning Multi-View Image-Based Rendering, Wang et al., CVPR 2021 | github | bibtex
• Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes, Li et al., CVPR 2021 | github | bibtex <!---Li20arxiv_nsff-->
• Animatable Neural Radiance Fields from Monocular RGB Videos, Chen et al., Arxiv 2021 | github | bibtex
• Neural Actor: Neural Free-view Synthesis of Human Actors with Pose Control, Liu et al., SIGGRAPH Asia 2021 | bibtex
• TiNeuVox: Fast Dynamic Radiance Fields with Time-Aware Neural Voxels, Fang et al., SIGGRAPH Asia 2022 | github | bibtex
• HumanNeRF: Free-viewpoint Rendering of Moving People from Monocular Video, Weng et al., CVPR 2022 | github | bibtex
• AligNeRF: High-Fidelity Neural Radiance Fields via Alignment-Aware Training, Jiang et al., CVPR 2023 | bibtex
• DynIBaR: Neural Dynamic Image-Based Rendering, Li et al., CVPR 2023 | bibtex

• BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects, Wen et al., CVPR 2023 | github | bibtex
• Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenes, Li et al., CVPR 2021 | github | bibtex <!---Li20arxiv_nsff-->
• Space-time Neural Irradiance Fields for Free-Viewpoint Video, Xian et al., CVPR 2021 | bibtex <!---Xian20arxiv_stnif-->
• Neural Radiance Flow for 4D View Synthesis and Video Processing, Du et al., Arxiv 2020 | bibtex <!---Du20arxiv_nerflow-->
• Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humans, Peng et al., CVPR 2021 | github | bibtex <!---Peng20arxiv_neuralbody-->
• UV Volumes for Real-time Rendering of Editable Free-view Human Performance, Chen et al., CVPR 2023 | github | bibtex <!---Chen22arxiv_uvvolumes-->
• Neural 3D Video Synthesis from Multi-view Video, Li et al., CVPR 2022 | bibtex
• Dynamic View Synthesis from Dynamic Monocular Video, Gao et al., ICCV 2021 | bibtex
• Streaming Radiance Fields for 3D Video Synthesis Li et al. NeurIPS 2022 | github | bibtex

• GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis, Schwarz et al., NeurIPS 2020 | github | bibtex <!---Schwarz20neurips_graf-->
• GRF: Learning a General Radiance Field for 3D Scene Representation and Rendering, Trevithick and Yang, Arxiv 2020 | github | bibtex <!---Trevithick20arxiv_GRF-->
• pixelNeRF: Neural Radiance Fields from One or Few Images, Yu et al., CVPR 2021 | github | bibtex <!---Yu20arxiv_pixelNeRF-->
• Learned Initializations for Optimizing Coordinate-Based Neural Representations, Tancik et al., CVPR 2021 | github | bibtex <!---Tancik20arxiv_meta-->
• pi-GAN: Periodic Implicit Generative Adversarial Networks for 3D-Aware Image Synthesis, Chan et al., CVPR 2021 | bibtex <!---Chan20arxiv_piGAN-->
• Portrait Neural Radiance Fields from a Single Image, Gao et al., Arxiv 2020 | bibtex <!---Gao20arxiv_pNeRF-->
• ShaRF: Shape-conditioned Radiance Fields from a Single View, Rematas et al., ICML 2021 | bibtex
• IBRNet: Learning Multi-View Image-Based Rendering, Wang et al., CVPR 2021 | github | bibtex
• CAMPARI: Camera-Aware Decomposed Generative Neural Radiance Fields, Niemeyer & Geiger, Arxiv 2021 | bibtex
• NeRF-VAE: A Geometry Aware 3D Scene Generative Model, Kosiorek et al., Arxiv 2021 | bibtex
• Unconstrained Scene Generation with Locally Conditioned Radiance Fields, DeVries et al., Arxiv 2021 | bibtex
• MVSNeRF: Fast Generalizable Radiance Field Reconstruction from Multi-View Stereo, Chen et al., ICCV 2021 | github | bibtex
• Stereo Radiance Fields (SRF): Learning View Synthesis from Sparse Views of Novel Scenes, Chibane et al., CVPR 2021 | bibtex
• Neural Rays for Occlusion-aware Image-based Rendering, Liu et al., Arxiv 2021 | bibtex
• Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis, Matthew Tancik et al., Arxiv 2021 | bibtex
• MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis, Jiaxin Li et al., ICCV 2021 | github | bibtex
• TöRF: Time-of-Flight Radiance Fields for Dynamic Scene View Synthesis, Benjamin Attal et al., NeurIPS 2021 | bibtex
• CodeNeRF: Disentangled Neural Radiance Fields for Object Categories, Jang et al., ICCV 2021 | bibtex
• StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesis, Gu et al., Arxiv 2021 | bibtex
• Generative Occupancy Fields for 3D Surface-Aware Image Synthesis, Xu et al., NeurIPS 2021 | github | bibtex
• NeRF in the Dark: High Dynamic Range View Synthesis from Noisy Raw Images, Ben Mildenhall et al, arXiv 2021 | bibtex
• Point-NeRF: Point-based Neural Radiance Fields, Xu et al., CVPR 2022 | github | bibtex
• SinNeRF: Training Neural Radiance Fields on Complex Scenes from a Single Image, Xu et al., ECCV 2022 | github | bibtex
• Rodin: A Generative Model for Sculpting 3D Digital Avatars Using Diffusion, Wang et al., CVPR 2023 | github | bibtex
• SurfelNeRF: Neural Surfel Radiance Fields for Online Photorealistic Reconstruction of Indoor Scenes, Gao et al., CVPR 2023 | github | bibtex
• NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes, Irshad et al., ICCV 2023 | github | bibtex
• X-NeRF: Explicit Neural Radiance Field for Multi-Scene 360° Insufficient RGB-D Views, Zhu et al., WACV 2023 | github | bibtex
• UFORecon: Generalizable Sparse-View Surface Reconstruction from Arbitrary and Unfavorable Sets, Na et al., CVPR 2024 | github | bibtex
• 🏡Know Your Neighbors: Improving Single-View Reconstruction via Spatial Vision-Language Reasoning, Li et al., CVPR 2024 | github | bibtex

• BundleSDF: Neural 6-DoF Tracking and 3D Reconstruction of Unknown Objects, Wen et al., CVPR 2023 | github | bibtex
• iNeRF: Inverting Neural Radiance Fields for Pose Estimation, Yen-Chen et al. IROS 2021 | bibtex <!---YenChen20arxiv_iNeRF-->
• A-NeRF: Surface-free Human 3D Pose Refinement via Neural Rendering, Su et al. Arxiv 2021 | bibtex <!---Su21arxiv_A_NeRF-->
• NeRF--: Neural Radiance Fields Without Known Camera Parameters, Wang et al., Arxiv 2021 | github | bibtex <!---Wang21arxiv_nerfmm-->
• iMAP: Implicit Mapping and Positioning in Real-Time, Sucar et al., ICCV 2021 | bibtex
• NICE-SLAM: Neural Implicit Scalable Encoding for SLAM, Zhu et al., Arxiv 2021 | bibtex
• GNeRF: GAN-based Neural Radiance Field without Posed Camera, Meng et al., Arxiv 2021 | bibtex
• BARF: Bundle-Adjusting Neural Radiance Fields, Lin et al., ICCV 2021 | bibtex
• Self-Calibrating Neural Radiance Fields, Jeong et al., ICCV 2021 | github | bibtex
• DFNet: Enhance Absolute Pose Regression with Direct Feature Matching, Chen et al., ECCV 2022 | github | bibtex
• GARF: Gaussian Activated Radiance Fields for High Fidelity Reconstruction and Pose Estimation, Chng et al., ECCV 2022 | bibtex
• L2G-NeRF: Local-to-Global Registration for Bundle-Adjusting Neural Radiance Fields, Chen et al., CVPR 2023 | github | bibtex
• NoPe-NeRF: Optimising Neural Radiance Field with No Pose Prior, Bian et al., CVPR 2023 | github | bibtex
• Loc-NeRF: Monte Carlo Localization using Neural Radiance Fields, Maggio et al., ICRA 2023 | github | bibtex
• Robust Camera Pose Refinement for Multi-Resolution Hash Encoding, Heo et al., ICML 2023 | bibtex
• CROSSFIRE: Camera Relocalization On Self-Supervised Features from an Implicit Representation, Moreau et al., ICCV 2023 | bibtex
• PoRF: Pose Residual Field for Accurate Neural Surface Reconstruction, Bian et al., ICLR 2024 | github | bibtex
• Neural Refinement for Absolute Pose Regression with Feature Synthesis, Chen et al., CVPR 2024 | github | bibtex

• NeRD: Neural Reflectance Decomposition from Image Collections, Boss et al., Arxiv 2020 | github | bibtex <!---Boss20arxiv_NeRD-->
• NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis, Srinivasan et al. CVPR 2021 | bibtex <!---Srinivasan20arxiv_NeRV-->
• NeX: Real-time View Synthesis with Neural Basis Expansion, Wizadwongsa et al. Arxiv 2021 | github | bibtex
• NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination, Zhang et al. Arxiv 2021 | github | bibtex
• A Shading-Guided Generative Implicit Model for Shape-Accurate 3D-Aware Image Synthesis, Pan et al., NeurIPS 2021 | github | bibtex
• KiloNeuS: Implicit Neural Representations with Real-Time Global Illumination, Esposito et al., Arxiv 2022 | bibtex

• NeRF++: Analyzing and Improving Neural Radiance Fields, Zhang et al., Arxiv 2020 | github | bibtex <!---Zhang20arxiv_nerf++-->
• GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields, Niemeyer et al., CVPR 2021, bibtex <!---Niemeyer20arxiv_GIRAFFE-->
• Object-Centric Neural Scene Rendering, Guo et al., Arxiv 2020 | bibtex <!---Guo20arxiv_OSF-->
• Learning Compositional Radiance Fields of Dynamic Human Heads, Wang et al., Arxiv 2020 | bibtex <!---Wang20arxiv_hybrid_NeRF-->
• Neural Scene Graphs for Dynamic Scenes, Ost et al., CVPR 2021 | bibtex <!---Ost20arxiv_NeuralSceneGraphs-->
• Unsupervised Discovery of Object Radiance Fields, Yu et al., ICLR 2022 | github | bibtex
• Unsupervised Discovery and Composition of Object Light Fields, Smith et al., TMLR 2023 | github | bibtex
• Learning Object-centric Neural Scattering Functions for Free-viewpoint Relighting and Scene Composition, Yu et al., TMLR 2023 | github | bibtex
• Learning Object-Compositional Neural Radiance Field for Editable Scene Rendering, Yang et al., ICCV 2021 | github | bibtex <!---yang2021objectnerf-->
• MoFaNeRF: Morphable Facial Neural Radiance Field, Zhuang et al., Arxiv 2021 | github | bibtex

• In-Place Scene Labelling and Understanding with Implicit Scene Representation, Zhi et al., Arxiv 2021 | bibtex
• NeRF-SOS: Any-view Self-supervised Object Segmentation on Complex Real-world Scenes, Fan et al., ICLR 2023 | bibtex
• Contrastive Lift: 3D Object Instance Segmentation by Slow-Fast Contrastive Fusion, Bhalgat et al., NeurIPS 2023 (Spotlight) | bibtex

• Editing Conditional Radiance Fields, Liu et al., Arxiv 2021 | github | bibtex
• Editable Free-viewpoint Video Using a Layered Neural Representation, Zhang et al., SIGGRAPH 2021 | github | bibtex
• NeRF-In: Free-Form NeRF Inpainting with RGB-D Priors, Liu et al., Arxiv 2022 | bibtex
• Unified Implicit Neural Stylization, Fan et al., ECCV 2022| github | bibtex
• CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fields, Wang et al., CVPR 2022| github | bibtex
• Local 3D Editing via 3D Distillation of CLIP Knowledge, Hyung et al., CVPR 2023| github | bibtex
• SINE: Semantic-driven Image-based NeRF Editing with Prior-guided Editing Field, Bao et al., CVPR 2023| github | bibtex
• General Neural Gauge Fields, Zhan et al., ICLR 2023| github | bibtex

• FiG-NeRF: Figure Ground Neural Radiance Fields for 3D Object Category Modelling, Xie et al., Arxiv 2021 | bibtex
• NeRF-Tex: Neural Reflectance Field Textures, Baatz et al., EGSR 2021 | bibtex

• Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fields, Barron et al., Arxiv 2021 | github | bibtex
• Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fields, Barron et al., Arxiv 2022 | bibtex

• UNISURF: Unifying Neural Implicit Surfaces and Radiance Fields for Multi-View Reconstruction, Oechsle et al., ICCV 2021 | bibtex
• NeuS: Learning Neural Implicit Surfaces by Volume Rendering for Multi-view Reconstruction, Wang et al., NeurIPS 2021 | github | bibtex
• Volume Rendering of Neural Implicit Surfaces, Yariv et al., NeurIPS 2021 | github | bibtex
• NeAT: Learning Neural Implicit Surfaces with Arbitrary Topologies from Multi-view Images, Meng et al., CVPR 2023 | github | bibtex

• NerfingMVS: Guided Optimization of Neural Radiance Fields for Indoor Multi-view Stereo, Wei et al., ICCV 2021 | bibtex

• 3D Neural Scene Representations for Visuomotor Control, Li et al., CoRL 2021 Oral | bibtex
• Vision-Only Robot Navigation in a Neural Radiance World, Adamkiewicz et al., RA-L 2022 Vol.7 No.2 | bibtex
• Differentiable Physics Simulation of Dynamics-Augmented Neural Objects, Le Cleac'h et al., RA-L 2023 | bibtex
• Customizable Perturbation Synthesis for Robust SLAM Benchmarking, Xu et al., ArXiv 2024 | bibtex

• Switch-NeRF: Learning Scene Decomposition with Mixture of Experts for Large-scale Neural Radiance Fields, Mi et al., ICLR 2023 | github | bibtex
• Block-NeRF: Scalable Large Scene Neural View Synthesis, Tancik et al., Arxiv 2022 | bibtex

• NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields, Irshad et al., ECCV 2024 | bibtex
• Ponder: Point Cloud Pre-training via Neural Rendering, Huang et al., ICCV 2023 | bibtex
• PonderV2: Pave the Way for 3D Foundation Model with A Universal Pre-training Paradigm, Zhu et al., Arxiv 2023 | github | bibtex
• UniPAD: A Universal Pre-training Paradigm for Autonomous Driving, Yang et al., Arxiv 2023 | github | bibtex

Talks

• NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis, Ben Mildenhall
• Understanding and Extending Neural Radiance Fields, Barron et al.
• Towards Photorealism (2nd half), Vladlen Koltun
• Neural Radiance Fields for View Synthesis, Matthew Tancik

Implementations

Tensorflow

• NeRF, Mildenhall et al., 2020 | bibtex
• Nerual-Radiance-Fields, @ariG23498, @ritwik_raha, 2022

PyTorch

• NeRF-PyTorch, Yen-Chen Lin, 2020 | bibtex
• NeRF-PyTorch-Lighting, @kwea123, 2020
• NeRF-W, @kwea123, 2021
• NeRF-PyTorch3D, @facebookresearch, 2020

Jax

• JaxNeRF, Deng et al., 2020 | bibtex
• Mip-NeRF, @google, 2021 | bibtex
• [Jax + Flax] Minimal Implementation of NeRF, @soumikrakshit, @sauravmaheshkar, 2022

Libraries

• Visu3d, @google, 2022

License

MIT