Coder Social home page Coder Social logo

futureshow / 3dgs_and_beyond_docs Goto Github PK

View Code? Open in Web Editor NEW

This project forked from yangjiheng/3dgs_and_beyond_docs

0.0 0.0 0.0 36 KB

This is a collective repository for all 3DGS related progresses in research and industry world

License: MIT License

3dgs_and_beyond_docs's Introduction

3DGS and Beyond Docs

This is a collection of documents and topics NeRF/3DGS & Beyond channel accumulated, as well as papers in literaure. Since there are lots of papers out there, so we split them into two seperate repositories: NeRF and Beyond Docs and 3DGS and Beyond Docs. Please choose accordingly recarding to your preference.

Some papers we discussed in the group, will be added to the back of the paper with a Notes link. You can follow the link to check whether there is topic you are interested in. If not, welcome to join us and ask the question to the crowd. The mighty community might have your answers.

We are actively maintaining this page trying to stay up-to-date and gather important works in a daily basis. We would also like to put as many notes as possible to some works, trying to make it easier to catch up.

Please feel free to join us on WeChat group or start a discussion topic here.

How to join us

For now, you can join us in the following ways

  • Bilibili Channel where we post near daily updates (primarily) on NeRF.
  • WeChat group, due to the limitation of WeChat group, you can add my personal account: jiheng_yang, and I will add you to the chat groups.
  • If you want to view this from a timeline perspective, please refer to this ProcessOn Diagram
  • If you think something is not correct or you think we could do better in some way, please write to us through all possible channels or drop an issue. All suggestions are appreciated!
  • For other discussed techniques that's related to 3D reconstruction and NeRF, please refer to link, we are constantly trying to add more resource to this document.
  • We are trying to gradually setup Discord channels, join the Discord Channel if you want to, we will certainly look forward to talk with you guys!

NeRF Progresses

For NeRF related progress, you can refer to NeRF and Beyond Docs

Table of Content

3DGS Original Paper

3D Gaussian Splatting for Real-Time Radiance Field Rendering
Bernhard Kerbl, Georgios Kopanas, Thomas Leimkühler, George Drettakis
ACM ToG 2023, 8 August, 2023
[arXiv] [Project] [Github]

3DGS Surveys

A Survey on 3D Gaussian Splatting
Guikun Chen, Wenguan Wang
arXiv preprint, 8 Jan 2024
[arXiv]

3D Gaussian as a New Vision Era: A Survey
Ben Fei, Jingyi Xu, Rui Zhang, Qingyuan Zhou, Weidong Yang, Ying He
arXiv preprint, 11 Feb 2024
[arXiv]

🔥Recent Advances in 3D Gaussian Splatting
Tong Wu, Yu-Jie Yuan, Ling-Xiao Zhang, Jie Yang, Yan-Pei Cao, Ling-Qi Yan, Lin Gao
arXiv preprint, 17 Mar 2024
[arXiv]

Gaussian Splatting: 3D Reconstruction and Novel View Synthesis, a Review
Anurag Dalal, Daniel Hagen, Kjell G. Robbersmyr, Kristian Muri Knausgård
arXiv preprint, 6 May 2024
[arXiv]

3DGS Frameworks

🔥GauStudio: A Modular Framework for 3D Gaussian Splatting and Beyond
Chongjie Ye, Yinyu Nie, Jiahao Chang, Yuantao Chen, Yihao Zhi, Xiaoguang Han
arXiv preprint, 28 Mar 2024
[arXiv] [Code]

3DGS Quality Enhancement

Mip-Splatting: Alias-free 3D Gaussian Splatting
Zehao Yu, Anpei Chen, Binbin Huang, Torsten Sattler, Andreas Geiger
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

Multi-Scale 3D Gaussian Splatting for Anti-Aliased Rendering
Zhiwen Yan, Weng Fei Low, Yu Chen, Gim Hee Lee
arXiv preprint, 28 Nov 2023
[arXiv]

Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering
Tao Lu, Mulin Yu, Linning Xu, Yuanbo Xiangli, Limin Wang, Dahua Lin, Bo Dai
arXiv preprint, 30 Nov 2023
[arXiv] [Project]

Gaussian Splitting Algorithm with Color and Opacity Depended on Viewing Direction
Dawid Malarz, Weronika Smolak, Jacek Tabor, Sławomir Tadeja, Przemysław Spurek
arXiv preprint, 21 Dec 2023
[arXiv]

TRIPS: Trilinear Point Splatting for Real-Time Radiance Field Rendering
Linus Franke, Darius Rückert, Laura Fink, Marc Stamminger
Eurographics 2024, 11 Jan 2024
[arXiv] [Project] [Code] [Video]

Optimal Projection for 3D Gaussian Splatting
Letian Huang, Jiayang Bai, Jie Guo, Yanwen Guo
arXiv preprint, 1 Feb 2024
[arXiv]

GaMeS: Mesh-Based Adapting and Modification of Gaussian Splatting
Joanna Waczyńska, Piotr Borycki, Sławomir Tadeja, Jacek Tabor, Przemysław Spurek
arXiv preprint, 2 Feb 2024
[arXiv]

FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization
Jiahui Zhang, Fangneng Zhan, Muyu Xu, Shijian Lu, Eric Xing
CVPR 2024, 11 Mar 2024
[arXiv] [Project]

Pixel-GS: Density Control with Pixel-aware Gradient for 3D Gaussian Splatting
Zheng Zhang, Wenbo Hu, Yixing Lao, Tong He, Hengshuang Zhao
arXiv preprint, 22 Mar 2024
[arXiv]

🔥SA-GS: Scale-Adaptive Gaussian Splatting for Training-Free Anti-Aliasing
Xiaowei Song, Jv Zheng, Shiran Yuan, Huan-ang Gao, Jingwei Zhao, Xiang He, Weihao Gu, Hao Zhao
arXiv preprint, 28 Mar 2024
[arXiv] [Project] [Code]

Robust Gaussian Splatting
François Darmon, Lorenzo Porzi, Samuel Rota-Bulò, Peter Kontschieder
arXiv preprint, 5 Apr 2024
[arXiv]

Revising Densification in Gaussian Splatting
Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder
arXiv preprint, 9 Apr 2024
[arXiv]

Hash3D: Training-free Acceleration for 3D Generation
Xingyi Yang, Xinchao Wang
arXiv preprint, 9 Apr 2024
[arXiv] [Project] [Code]

EGGS: Edge Guided Gaussian Splatting for Radiance Fields
Yuanhao Gong
arXiv preprint, 14 Apr 2024
[arXiv]

3D Gaussian Splatting as Markov Chain Monte Carlo
Shakiba Kheradmand, Daniel Rebain, Gopal Sharma, Weiwei Sun, Jeff Tseng, Hossam Isack, Abhishek Kar, Andrea Tagliasacchi, Kwang Moo Yi
arXiv preprint, 15 Apr 2024
[arXiv]

LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion Field
Jiyang Li, Lechao Cheng, Zhangye Wang, Tingting Mu, Jingxuan He
arXiv preprint, 13 Apr 2024
[arXiv]

AbsGS: Recovering Fine Details for 3D Gaussian Splatting
Zongxin Ye, Wenyu Li, Sidun Liu, Peng Qiao, Yong Dou
arXiv preprint, 16 Apr 2024
[arXiv] [Project] [Code]

Gaussian Splatting Decoder for 3D-aware Generative Adversarial Networks
Florian Barthel, Arian Beckmann, Wieland Morgenstern, Anna Hilsmann, Peter Eisert
CVPRW 2024, 16 Apr 2024
[arXiv]

Does Gaussian Splatting need SFM Initialization?
Yalda Foroutan, Daniel Rebain, Kwang Moo Yi, Andrea Tagliasacchi
arXiv preprint, 18 Apr 2024
[arXiv] [Project]

FlowMap: High-Quality Camera Poses, Intrinsics, and Depth via Gradient Descent
Cameron Smith, David Charatan, Ayush Tewari, Vincent Sitzmann
arXiv preprint, 23 Apr 2024
[arXiv]

🔥Spectrally Pruned Gaussian Fields with Neural Compensation
Runyi Yang, Zhenxin Zhu, Zhou Jiang, Baijun Ye, Xiaoxue Chen, Yifei Zhang, Yuantao Chen, Jian Zhao, Hao Zhao
arXiv preprint, 1 May 2024
[arXiv] [Project] [Code]

Bootstrap 3D Reconstructed Scenes from 3D Gaussian Splatting
Yifei Gao, Jie Ou, Lei Wang, Jun Cheng
arXiv preprint, 29 Apr 2024
[arXiv]

I3DGS: Improve 3D Gaussian Splatting from Multiple Dimensions
Jinwei Lin
arXiv preprint, 10 May 2024
[arXiv]

Gaussian Time Machine: A Real-Time Rendering Methodology for Time-Variant Appearances
Licheng Shen, Ho Ngai Chow, Lingyun Wang, Tong Zhang, Mengqiu Wang, Yuxing Han
arXiv preprint, 22 May 2024
[arXiv]

AtomGS: Atomizing Gaussian Splatting for High-Fidelity Radiance Field
Rong Liu, Rui Xu, Yue Hu, Meida Chen, Andrew Feng
arXiv preprint, 20 May 2024
[arXiv] [Project] [Code] [Video]

Feature Splatting for Better Novel View Synthesis with Low Overlap
T. Berriel Martins, Javier Civera
arXiv preprint, 24 May 2024
[arXiv]

LP-3DGS: Learning to Prune 3D Gaussian Splatting
Zhaoliang Zhang, Tianchen Song, Yongjae Lee, Li Yang, Cheng Peng, Rama Chellappa, Deliang Fan
arXiv preprint, 29 May 2024
[arXiv]

NegGS: Negative Gaussian Splatting
Artur Kasymov, Bartosz Czekaj, Marcin Mazur, Przemysław Spurek
arXiv preprint, 28 May 2024
[arXiv]

3D-HGS: 3D Half-Gaussian Splatting
Haolin Li, Jinyang Liu, Mario Sznaier, Octavia Camps
arXiv preprint, 4 Jun 2024
[arXiv]

Gaussian Splatting with Localized Points Management
Haosen Yang, Chenhao Zhang, Wenqing Wang, Marco Volino, Adrian Hilton, Li Zhang, Xiatian Zhu
arXiv preprint, 6 Jun 2024
[arXiv] [Code]

3DGS Acceleration

EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingS
Sharath Girish, Kamal Gupta, Abhinav Shrivastava
arXiv preprint, 7 Dec, 2023
[arXiv] [Project] [Code]

StopThePop: Sorted Gaussian Splatting for View-Consistent Real-time Rendering
Lukas Radl, Michael Steiner, Mathias Parger, Alexander Weinrauch, Bernhard Kerbl, Markus Steinberger
SIGGRAPH 2024, 1 Feb 2024
[arXiv] [Project] [Code] [Video]

GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering
Abdullah Hamdi, Luke Melas-Kyriazi, Guocheng Qian, Jinjie Mai, Ruoshi Liu, Carl Vondrick, Bernard Ghanem, Andrea Vedaldi
CVPR 2024, 15 Feb 2024
[arXiv] [Project] [Code] [Video]

OmniGS: Omnidirectional Gaussian Splatting for Fast Radiance Field Reconstruction using Omnidirectional Images
Longwei Li, Huajian Huang, Sai-Kit Yeung, Hui Cheng
arXiv preprint, 4 Apr 2024
[arXiv]

3DGS Geometry Reconstruction

SuGaR: Surface-Aligned Gaussian Splatting for Efficient 3D Mesh Reconstruction and High-Quality Mesh Rendering
Antoine Guédon, Vincent Lepetit
arXiv preprint, 21 Nov 2023
[arXiv] [Project]

NeuSG: Neural Implicit Surface Reconstruction with 3D Gaussian Splatting Guidance
Hanlin Chen, Chen Li, Gim Hee Lee
arXiv preprint, 1 Dec, 2023
[arXiv]

🔥2D Gaussian Splatting for Geometrically Accurate Radiance Fields
Binbin Huang, Zehao Yu, Anpei Chen, Andreas Geiger, Shenghua Gao
SIGGRAPH 2024, 26 Mar 2024
[arXiv] [Project] [Code] [Video]

GSDF: 3DGS Meets SDF for Improved Rendering and Reconstruction
Mulin Yu, Tao Lu, Linning Xu, Lihan Jiang, Yuanbo Xiangli, Bo Dai
arXiv preprint, 25 Mar 2024
[arXiv] [Project] [Code]

Modeling uncertainty for Gaussian Splatting
Luca Savant, Diego Valsesia, Enrico Magli
arXiv preprint, 27 Mar 2024
[arXiv]

Surface Reconstruction from Gaussian Splatting via Novel Stereo Views
Yaniv Wolf, Amit Bracha, Ron Kimmel
arXiv preprint, 2 Apr 2024
[arXiv] [Project]

Gaussian Opacity Fields: Efficient and Compact Surface Reconstruction in Unbounded Scenes
Zehao Yu, Torsten Sattler, Andreas Geiger
arXiv preprint, 16 Apr 2024
[arXiv] [Project] [Code]

Dynamic Gaussians Mesh: Consistent Mesh Reconstruction from Monocular Videos
Isabella Liu, Hao Su, Xiaolong Wang
arXiv preprint, 18 Apr 2024
[arXiv] [Project]

Direct Learning of Mesh and Appearance via 3D Gaussian Splatting
Ancheng Lin, Jun Li
arXiv preprint, 11 May 2024
[arXiv]

TetSphere Splatting: Representing High-Quality Geometry with Lagrangian Volumetric Meshes
Minghao Guo, Bohan Wang, Kaiming He, Wojciech Matusik
arXiv preprint, 30 May 2024
[arXiv]

Tetrahedron Splatting for 3D Generation
Chun Gu, Zeyu Yang, Zijie Pan, Xiatian Zhu, Li Zhang
arXiv preprint, 3 Jun 2024
[arXiv] [Code]

RaDe-GS: Rasterizing Depth in Gaussian Splatting
Baowen Zhang, Chuan Fang, Rakesh Shrestha, Yixun Liang, Xiaoxiao Long, Ping Tan
arXiv preprint, 3 Jun 2024
[arXiv]

Trim 3D Gaussian Splatting for Accurate Geometry Representation
Lue Fan, Yuxue Yang, Minxing Li, Hongsheng Li, Zhaoxiang Zhang
arXiv preprint, 11 Jun 2024
[arXiv] [Project] [Code]

PGSR: Planar-based Gaussian Splatting for Efficient and High-Fidelity Surface Reconstruction
Danpeng Chen, Hai Li, Weicai Ye, Yifan Wang, Weijian Xie, Shangjin Zhai, Nan Wang, Haomin Liu, Hujun Bao, Guofeng Zhang
arXiv prepreint, 10 Jun 2024
[arXiv] [Project] [Code]

VCR-GauS: View Consistent Depth-Normal Regularizer for Gaussian Surface Reconstruction
Hanlin Chen, Fangyin Wei, Chen Li, Tianxin Huang, Yunsong Wang, Gim Hee Lee
arXiv preprint, 9 Jun 2024
[arXiv]

3DGS Based Dynamic Scene

Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesis
Jonathon Luiten, Georgios Kopanas, Bastian Leibe, Deva Ramanan
arXiv preprint, 18 Aug 2023
[arXiv] [Project] [Github]

🔥Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstruction
Ziyi Yang, Xinyu Gao, Wen Zhou, Shaohui Jiao, Yuqing Zhang, Xiaogang Jin
arXiv preprint, 22 Sep 2023
[arXiv]

4D Gaussian Splatting for Real-Time Dynamic Scene Rendering
Guanjun Wu, Taoran Yi, Jiemin Fang, Lingxi Xie, Xiaopeng Zhang, Wei Wei, Wenyu Liu, Qi Tian, Xinggang Wang
arXiv preprint, 12 Oct 2023
[arXiv] [Project] [Github]

Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splatting
Zeyu Yang, Hongye Yang, Zijie Pan, Xiatian Zhu, Li Zhang
arXiv preprint, 16 Oct 2023
[arXiv]

Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstruction
Devikalyan Das, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen
arXiv preprint, 2 Dec 2023
[arXiv]

Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particle
Youtian Lin, Zuozhuo Dai, Siyu Zhu, Yao Yao
arXiv preprint, 6 Dec 2023
[arXiv]

CoGS: Controllable Gaussian Splatting
Heng Yu, Joel Julin, Zoltán Á. Milacski, Koichiro Niinuma, László A. Jeni
CVPR 2024, 9 Dec 2023
[arXiv]

GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesis
Yiqing Liang, Numair Khan, Zhengqin Li, Thu Nguyen-Phuoc, Douglas Lanman, James Tompkin, Lei Xiao
arXiv preprint, 18 Dec 2023
[arXiv] [Project]

🔥SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenes
Yi-Hua Huang, Yang-Tian Sun, Ziyi Yang, Xiaoyang Lyu, Yan-Pei Cao, Xiaojuan Qi
CVPR 2024, 4 Dec 2023
[arXiv] [Project] [Code] [Video]

Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesis
Zhan Li, Zhang Chen, Zhong Li, Yi Xu
CVPR 2024, 28 Dec 2023
[arXiv] [Project] [Code] [Video]

4D Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenes
Yuanxing Duan, Fangyin Wei, Qiyu Dai, Yuhang He, Wenzheng Chen, Baoquan Chen
arXiv preprint, 5 Feb 2024
[arXiv]

Mesh-based Gaussian Splatting for Real-time Large-scale Deformation
Lin Gao, Jie Yang, Bo-Tao Zhang, Jia-Mu Sun, Yu-Jie Yuan, Hongbo Fu, Yu-Kun Lai
arXiv preprint, 7 Feb 2024
[arXiv]

GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
Quankai Gao, Qiangeng Xu, Zhe Cao, Ben Mildenhall, Wenchao Ma, Le Chen, Danhang Tang, Ulrich Neumann
arXiv preprint, 19 Mar 2024
[arXiv] [Project] [Code] [Video]

Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splatting
Jeongmin Bae, Seoha Kim, Youngsik Yun, Hahyun Lee, Gun Bang, Youngjung Uh
arXiv preprint, 4 Apr 2024
[arXiv] [Project] [Code]

3D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesis
Zhicheng Lu, Xiang Guo, Le Hui, Tianrui Chen, Min Yang, Xiao Tang, Feng Zhu, Yuchao Dai
CVPR 2024, 9 Apr 2024
[arXiv] [Project]

MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffolds
Jiahui Lei, Yijia Weng, Adam Harley, Leonidas Guibas, Kostas Daniilidis
arXiv preprint, 27 May 2024
[arXiv] [Project] [Video]

GSDeformer: Direct Cage-based Deformation for 3D Gaussian Splatting
Jiajun Huang, Hongchuan Yu
arXiv preprint, 24 May 2024
[arXiv] [Project] [Video]

GFlow: Recovering 4D World from Monocular Video
Shizun Wang, Xingyi Yang, Qiuhong Shen, Zhenxiang Jiang, Xinchao Wang
arXiv preprint, 28 May 2024
[arXiv] [Project]

A Refined 3D Gaussian Representation for High-Quality Dynamic Scene Reconstruction
Bin Zhang, Bi Zeng, Zexin Peng
arXiv preprint, 28 May 2024
[arXiv]

Object-centric Reconstruction and Tracking of Dynamic Unknown Objects using 3D Gaussian Splatting
Kuldeep R Barad, Antoine Richard, Jan Dentler, Miguel Olivares-Mendez, Carol Martinez
IEEE Space Robotics 2024, 30 May 2024
[arXiv]

GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesis
Boming Zhao, Yuan Li, Ziyu Sun, Lin Zeng, Yujun Shen, Rui Ma, Yinda Zhang, Hujun Bao, Zhaopeng Cui
SIGGRAPH 2024, 30 May 2024
[arXiv] [Project]

Reconstructing and Simulating Dynamic 3D Objects with Mesh-adsorbed Gaussian Splatting
Shaojie Ma, Yawei Luo, Yi Yang
arXiv preprint, 3 Jun 2024
[arXiv] [Project] [Code]

Self-Calibrating 4D Novel View Synthesis from Monocular Videos Using Gaussian Splatting
Fang Li, Hao Zhang, Narendra Ahuja
arXiv preprint, 3 Jun 2024
[arXiv] [Code]

Superpoint Gaussian Splatting for Real-Time High-Fidelity Dynamic Scene Reconstruction
Diwen Wan, Ruijie Lu, Gang Zeng
ICML 2024, 6 Jun 2024
[arXiv] [Project] [Codehttps://github.com/dnvtmf/SP_GS]

MoDGS: Dynamic Gaussian Splatting from Causually-captured Monocular Videos
Qingming Liu, Yuan Liu, Jiepeng Wang, Xianqiang Lv, Peng Wang, Wenping Wang, Junhui Hou
arXiv preprint, 1 Jun 2024
[arXiv]

DGD: Dynamic 3D Gaussians Distillation
Isaac Labe, Noam Issachar, Itai Lang, Sagie Benaim
arXiv preprint, 29 May 2024
[arXiv] [Project] [Code]

Modeling Ambient Scene Dynamics for Free-view Synthesis
Meng-Li Shih, Jia-Bin Huang, Changil Kim, Rajvi Shah, Johannes Kopf, Chen Gao
SIGGRAPH 2024, 13 Jun 2024
[arXiv] [Project]

3DGS + Depth

DNGaussian: Optimizing Sparse-View 3D Gaussian Radiance Fields with Global-Local Depth Normalization
Jiahe Li, Jiawei Zhang, Xiao Bai, Jin Zheng, Xin Ning, Jun Zhou, Lin Gu
CVPR 2024, 11 Mar 2024
[arXiv] [Project] [Code] [Video]

🔥DN-Splatter: Depth and Normal Priors for Gaussian Splatting and Meshing
Matias Turkulainen, Xuqian Ren, Iaroslav Melekhov, Otto Seiskari, Esa Rahtu, Juho Kannala
arXiv preprint, 26 Mar 2024
[arXiv]

HoloGS: Instant Depth-based 3D Gaussian Splatting with Microsoft HoloLens 2
Miriam Jäger, Theodor Kapler, Michael Feßenbecker, Felix Birkelbach, Markus Hillemann, Boris Jutzi
arXiv preprint, 3 May 2024
[arXiv]

3DGS Few-shot Reconstruction

Depth-Regularized Optimization for 3D Gaussian Splatting in Few-Shot Images
Jaeyoung Chung, Jeongtaek Oh, Kyoung Mu Lee
arXiv preprint, 22 Nov 2023
[arXiv]

FSGS: Real-Time Few-shot View Synthesis using Gaussian Splatting
Zehao Zhu, Zhiwen Fan, Yifan Jiang, Zhangyang Wang
arXiv preprint, 1 Dec 2023
[arXiv] [Project]

Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformers
Zi-Xin Zou, Zhipeng Yu, Yuan-Chen Guo, Yangguang Li, Ding Liang, Yan-Pei Cao, Song-Hai Zhang
arXiv preprint, 14 Dec 2023
[arXiv] [Project] [Code]

pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstruction
David Charatan, Sizhe Li, Andrea Tagliasacchi, Vincent Sitzmann
arXiv preprint, 19 Dec 2023
[arXiv] [Project] [Code]

AGG: Amortized Generative 3D Gaussians for Single Image to 3D
Dejia Xu, Ye Yuan, Morteza Mardani, Sifei Liu, Jiaming Song, Zhangyang Wang, Arash Vahdat
arXiv preprint, 8 Jan 2024
[arXiv] [Project]

GaussianObject: Just Taking Four Images to Get A High-Quality 3D Object with Gaussian Splatting
Chen Yang, Sikuang Li, Jiemin Fang, Ruofan Liang, Lingxi Xie, Xiaopeng Zhang, Wei Shen, Qi Tian
arXiv preprint, 15 Feb 2024
[arXiv] [Project]

FDGaussian: Fast Gaussian Splatting from Single Image via Geometric-aware Diffusion Model
Qijun Feng, Zhen Xing, Zuxuan Wu, Yu-Gang Jiang
arXiv preprint, 15 Mar 2024
[arXiv] [Project]

Gamba: Marry Gaussian Splatting with Mamba for single view 3D reconstruction
Qiuhong Shen, Xuanyu Yi, Zike Wu, Pan Zhou, Hanwang Zhang, Shuicheng Yan, Xinchao Wang
arXiv preprint, 27 Mar 2024
[arXiv] [Project]

🔥InstantSplat: Unbounded Sparse-view Pose-free Gaussian Splatting in 40 Seconds
Zhiwen Fan, Wenyan Cong, Kairun Wen, Kevin Wang, Jian Zhang, Xinghao Ding, Danfei Xu, Boris Ivanovic, Marco Pavone, Georgios Pavlakos, Zhangyang Wang, Yue Wang
arXiv preprint, 29 Mar 2024
[arXiv] [Project] [Video]

CoherentGS: Sparse Novel View Synthesis with Coherent 3D Gaussians
Avinash Paliwal, Wei Ye, Jinhui Xiong, Dmytro Kotovenko, Rakesh Ranjan, Vikas Chandra, Nima Khademi Kalantari
arXiv preprint, 28 Mar 2024
[arXiv] [Project]

Guess The Unseen: Dynamic 3D Scene Reconstruction from Partial 2D Glimpses
Inhee Lee, Byungjun Kim, Hanbyul Joo
arXiv preprint, 22 Apr 2024
[arXiv] [Project]

CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularization
Jiawei Zhang, Jiahe Li, Xiaohan Yu, Lei Huang, Lin Gu, Jin Zheng, Xiao Bai
arXiv preprint, 20 May 2024
[arXiv] [Project] [Video]

Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors
Soumava Paul, Christopher Wewer, Bernt Schiele, Jan Eric Lenssen
arXiv preprint, 26 May 2024
[arXiv]

A Pixel Is Worth More Than One 3D Gaussians in Single-View 3D Reconstruction
Jianghao Shen, Tianfu Wu
arXiv preprint, 30 May 2024
[arXiv]

Flash3D: Feed-Forward Generalisable 3D Scene Reconstruction from a Single Image
Stanislaw Szymanowicz, Eldar Insafutdinov, Chuanxia Zheng, Dylan Campbell, João F. Henriques, Christian Rupprecht, Andrea Vedaldi
arXiv preprint, 6 Jun 2024
[arXiv] [Project]

3DGS Weak Camera Pose

COLMAP-Free 3D Gaussian Splatting
Yang Fu, Sifei Liu, Amey Kulkarni, Jan Kautz, Alexei A. Efros, Xiaolong Wang
CVPR 2024, 12 Dec 2023
[arXiv] [Project] [Video]

iComMa: Inverting 3D Gaussians Splatting for Camera Pose Estimation via Comparing and Matching
Yuan Sun, Xuan Wang, Yunfan Zhang, Jie Zhang, Caigui Jiang, Yu Guo, Fei Wang
arXiv preprint, 14 Dec 2023
[[arXiv]https://arxiv.org/abs/2312.09031]

A Construct-Optimize Approach to Sparse View Synthesis without Camera Pose
Kaiwen Jiang, Yang Fu, Mukund Varma T, Yash Belhe, Xiaolong Wang, Hao Su, Ravi Ramamoorthi
arXiv preprint, 6 May 2024
[arXiv]

3DGS-NeRF Transfer

NeRFs to Gaussian Splats, and Back
Siming He, Zach Osman, Pratik Chaudhari
arXiv preprint, 15 May 2024
[arXiv] [Code]

3DGS Generalization

GGRt: Towards Generalizable 3D Gaussians without Pose Priors in Real-Time
Hao Li, Yuanyuan Gao, Dingwen Zhang, Chenming Wu, Yalun Dai, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang, Junwei Han
arXiv preprint, 15 Mar 2024
[arXiv] [Project]

latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction
Christopher Wewer, Kevin Raj, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen
arXiv preprint, 24 Mar 2024
[arXiv] [Project]

Fast Generalizable Gaussian Splatting Reconstruction from Multi-View Stereo
Tianqi Liu, Guangcong Wang, Shoukang Hu, Liao Shen, Xinyi Ye, Yuhang Zang, Zhiguo Cao, Wei Li, Ziwei Liu
arXiv preprint, 20 May 2024
[arXiv] [Project] [Code] [Video]

3DGS Indoor Scene Reconstruction

360-GS: Layout-guided Panoramic Gaussian Splatting For Indoor Roaming
Jiayang Bai, Letian Huang, Jie Guo, Wen Gong, Yuanqi Li, Yanwen Guo
arXiv preprint, 1 Feb 2024
[arXiv]

MonoSelfRecon: Purely Self-Supervised Explicit Generalizable 3D Reconstruction of Indoor Scenes from Monocular RGB Views
Runfa Li, Upal Mahbub, Vasudev Bhaskaran, Truong Nguyen
arXiv preprint, 10 Apr 2024
[arXiv]

FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes
Yunsong Wang, Tianxin Huang, Hanlin Chen, Gim Hee Lee
arXiv preprint, 28 May 2024
[arXiv]

3DGS Based Large Scene Reconstruction

Periodic Vibration Gaussian: Dynamic Urban Scene Reconstruction and Real-time Rendering
Yurui Chen, Chun Gu, Junzhe Jiang, Xiatian Zhu, Li Zhang
arXiv preprint, 30 Nov 2023
[arXiv] [Project]

GauU-Scene: A Scene Reconstruction Benchmark on Large Scale 3D Reconstruction Dataset Using Gaussian Splatting
Butian Xiong, Zhuo Li, Zhen Li
arXiv preprint, 25 Jan 2024
[arXiv]

GaussianPro: 3D Gaussian Splatting with Progressive Propagation
Kai Cheng, Xiaoxiao Long, Kaizhi Yang, Yao Yao, Wei Yin, Yuexin Ma, Wenping Wang, Xuejin Chen
arXiv preprint, 22 Feb 2024
[arXiv] [Project] [Code]

🔥VastGaussian: Vast 3D Gaussians for Large Scene
Jiaqi Lin, Zhihao Li, Xiao Tang, Jianzhuang Liu, Shiyong Liu, Jiayue Liu, Yangdi Lu, Xiaofei Wu, Songcen Xu, Youliang Yan, Wenming Yang
CVPR 2024, 27 Feb, 2024
[arXiv] [Project]

SWAG: Splatting in the Wild images with Appearance-conditioned Gaussians
Hiba Dahmani, Moussab Bennehar, Nathan Piasco, Luis Roldao, Dzmitry Tsishkou
arXiv preprint, 15 Mar 2024
[arXiv]

Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collections
Dongbin Zhang, Chuming Wang, Weitao Wang, Peihao Li, Minghan Qin, Haoqian Wang
arXiv preprint, 23 Mar 2024
[arXiv]

🔥Octree-GS: Towards Consistent Real-time Rendering with LOD-Structured 3D Gaussians
Kerui Ren, Lihan Jiang, Tao Lu, Mulin Yu, Linning Xu, Zhangkai Ni, Bo Dai
arXiv preprint, 26 Mar 2024
[arXiv] [Project] [Code]

SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior
Zhongrui Yu, Haoran Wang, Jinze Yang, Hanzhang Wang, Zeke Xie, Yunfeng Cai, Jiale Cao, Zhong Ji, Mingming Sun
arXiv preprint, 29 Mar 2024
[arXiv]

HO-Gaussian: Hybrid Optimization of 3D Gaussian Splatting for Urban Scenes
Zhuopeng Li, Yilin Zhang, Chenming Wu, Jianke Zhu, Liangjun Zhang
arXiv preprint, 29 Mar 2024
[arXiv]

CityGaussian: Real-time High-quality Large-Scale Scene Rendering with Gaussians
Yang Liu, He Guan, Chuanchen Luo, Lue Fan, Junran Peng, Zhaoxiang Zhang
arXiv preprint, 1 Apr 2024
[arXiv] [Project] [Code]

LetsGo: Large-Scale Garage Modeling and Rendering via LiDAR-Assisted Gaussian Primitives
Jiadi Cui, Junming Cao, Yuhui Zhong, Liao Wang, Fuqiang Zhao, Penghao Wang, Yifan Chen, Zhipeng He, Lan Xu, Yujiao Shi, Yingliang Zhang, Jingyi Yu
arXiv preprint, 15 Apr 2024
[arXiv] [Project]

GS-LRM: Large Reconstruction Model for 3D Gaussian Splatting
Kai Zhang, Sai Bi, Hao Tan, Yuanbo Xiangli, Nanxuan Zhao, Kalyan Sunkavalli, Zexiang Xu
arXiv preprint, 30 Apr 2024
[arXiv] [Project]

DoGaussian: Distributed-Oriented Gaussian Splatting for Large-Scale 3D Reconstruction Via Gaussian Consensus
Yu Chen, Gim Hee Lee
arXiv preprint, 22 May 2024
[arXiv] [Project] [Code]

PyGS: Large-scale Scene Representation with Pyramidal 3D Gaussian Splatting
Zipeng Wang, Dan Xu
arXiv preprint, 27 May 2024
[arXiv]

GaussianFormer: Scene as Gaussians for Vision-Based 3D Semantic Occupancy Prediction
Yuanhui Huang, Wenzhao Zheng, Yunpeng Zhang, Jie Zhou, Jiwen Lu
arXiv preprint, 27 May 2024
[arXiv] [Code]

3D StreetUnveiler with Semantic-Aware 2DGS
Jingwei Xu, Yikai Wang, Yiqun Zhao, Yanwei Fu, Shenghua Gao
arXiv preprint, 28 May 2024
[arXiv] [Project] [Code]

WE-GS: An In-the-wild Efficient 3D Gaussian Representation for Unconstrained Photo Collections
Yuze Wang, Junyi Wang, Yue Qi
arXiv preprint, 4 Jun 2024
[arXiv] [Project]

3DGS Autonomous Driving

DrivingGaussian: Composite Gaussian Splatting for Surrounding Dynamic Autonomous Driving Scenes
Xiaoyu Zhou, Zhiwei Lin, Xiaojun Shan, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang
CVPR 2024, 13 Dec 2023
[arXiv] [Code]

Street Gaussians for Modeling Dynamic Urban Scenes
Yunzhi Yan, Haotong Lin, Chenxu Zhou, Weijie Wang, Haiyang Sun, Kun Zhan, Xianpeng Lang, Xiaowei Zhou, Sida Peng
arXiv preprint, 2 Jan 2024
[arXiv] [Project] [Code]

TCLC-GS: Tightly Coupled LiDAR-Camera Gaussian Splatting for Surrounding Autonomous Driving Scenes
Cheng Zhao, Su Sun, Ruoyu Wang, Yuliang Guo, Jun-Jun Wan, Zhou Huang, Xinyu Huang, Yingjie Victor Chen, Liu Ren
arXiv preprint, 3 Apr, 2024
[arXiv]

S^3 Gaussian: Self-Supervised Street Gaussians for Autonomous Driving
Nan Huang, Xiaobao Wei, Wenzhao Zheng, Pengju An, Ming Lu, Wei Zhan, Masayoshi Tomizuka, Kurt Keutzer, Shanghang Zhang
arXiv preprint, 30 May 2024
[arXiv] [Code]

3DGS Based AIGC

GaussianDiffusion: 3D Gaussian Splatting for Denoising Diffusion Probabilistic Models with Structured Noise
Xinhai Li, Huaibin Wang, Kuo-Kun Tseng
arXiv preprint, 19 Nov 2023
[arXiv]

LucidDreamer: Towards High-Fidelity Text-to-3D Generation via Interval Score Matching
Yixun Liang, Xin Yang, Jiantao Lin, Haodong Li, Xiaogang Xu, Yingcong Chen
arXiv preprint, 19 Nov 2023
[arXiv] [Github]

LucidDreamer: Domain-free Generation of 3D Gaussian Splatting Scenes
Jaeyoung Chung, Suyoung Lee, Hyeongjin Nam, Jaerin Lee, Kyoung Mu Lee
arXiv preprint, 22 Nov 2023
[arXiv] [Project]

DreamGaussian: Generative Gaussian Splatting for Efficient 3D Content Creation
Jiaxiang Tang, Jiawei Ren, Hang Zhou, Ziwei Liu, Gang Zeng
arXiv preprint, 28 Sep 2023
[arXiv] [Project] [Github]

Text-to-3D using Gaussian Splatting
Zilong Chen, Feng Wang, Huaping Liu
arXiv preprint, 29 Sep 2023
[arXiv] [Project] [Github]

GaussianDreamer: Fast Generation from Text to 3D Gaussian Splatting with Point Cloud Priors
Taoran Yi, Jiemin Fang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, Xinggang Wang
arXiv preprint, 12 Oct 2023
[arXiv] [Project] [Github]

CG3D: Compositional Generation for Text-to-3D via Gaussian Splatting
Alexander Vilesov, Pradyumna Chari, Achuta Kadambi
arXiv preprint, 29 Nov 2023
[arXiv]

Text2Immersion: Generative Immersive Scene with 3D Gaussians
Hao Ouyang, Kathryn Heal, Stephen Lombardi, Tiancheng Sun
arXiv preprint, 14 Dec 2023
[arXiv] [Project]

Align Your Gaussians: Text-to-4D with Dynamic 3D Gaussians and Composed Diffusion Models
Huan Ling, Seung Wook Kim, Antonio Torralba, Sanja Fidler, Karsten Kreis
CVPR 2024, 21 Dec 2023
[arXiv] [Project]

🔥LangSplat: 3D Language Gaussian Splatting
Minghan Qin, Wanhua Li, Jiawei Zhou, Haoqian Wang, Hanspeter Pfister
CVPR 2024, 26 Dec 2023
[arXiv] [Project] [Code] [Video]

4DGen: Grounded 4D Content Generation with Spatial-temporal Consistency
Yuyang Yin, Dejia Xu, Zhangyang Wang, Yao Zhao, Yunchao Wei
arXiv preprint, 28 Dec 2023
[arXiv] [Project] [Code]

DreamGaussian4D: Generative 4D Gaussian Splatting
Jiawei Ren, Liang Pan, Jiaxiang Tang, Chi Zhang, Ang Cao, Gang Zeng, Ziwei Liu
arXiv preprint, 28 Dec 2023
[arXiv] [Project] [Code]

IM-3D: Iterative Multiview Diffusion and Reconstruction for High-Quality 3D Generation
Luke Melas-Kyriazi, Iro Laina, Christian Rupprecht, Natalia Neverova, Andrea Vedaldi, Oran Gafni, Filippos Kokkinos
arXiv preprint, 13 Feb 2024
[arXiv]

GALA3D: Towards Text-to-3D Complex Scene Generation via Layout-guided Generative Gaussian Splatting
Xiaoyu Zhou, Xingjian Ran, Yajiao Xiong, Jinlin He, Zhiwei Lin, Yongtao Wang, Deqing Sun, Ming-Hsuan Yang
arXiv preprint, 11 Feb 2024
[arXiv]

GVGEN: Text-to-3D Generation with Volumetric Representation
Xianglong He, Junyi Chen, Sida Peng, Di Huang, Yangguang Li, Xiaoshui Huang, Chun Yuan, Wanli Ouyang, Tong He
arXiv preprint, 19 Mar 2024
[arXiv] [Project]

BrightDreamer: Generic 3D Gaussian Generative Framework for Fast Text-to-3D Synthesis
Lutao Jiang, Lin Wang
arXiv preprint, 17 Mar 2024
[arXiv] [Project] [Code]

DreamPolisher: Towards High-Quality Text-to-3D Generation via Geometric Diffusion
Yuanze Lin, Ronald Clark, Philip Torr
arXiv preprint, 25 Mar 2024
[arXiv] [Project] [Code]

GaussianCube: Structuring Gaussian Splatting using Optimal Transport for 3D Generative Modeling
Bowen Zhang, Yiji Cheng, Jiaolong Yang, Chunyu Wang, Feng Zhao, Yansong Tang, Dong Chen, Baining Guo
arXiv preprint, 28 Mar 2024
[arXiv] [Prject] [Code]

RealmDreamer: Text-Driven 3D Scene Generation with Inpainting and Depth Diffusion
Jaidev Shriram, Alex Trevithick, Lingjie Liu, Ravi Ramamoorthi
arXiv preprint, 10 Apr 2024
[arXiv] [Project]

DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splatting
Shijie Zhou, Zhiwen Fan, Dejia Xu, Haoran Chang, Pradyumna Chari, Tejas Bharadwaj, Suya You, Zhangyang Wang, Achuta Kadambi
arXiv preprint, 10 Apr 2024
[arXiv] [Project]

DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling
Xuening Yuan, Hongyu Yang, Yueming Zhao, Di Huang
arXiv preprint, 14 Apr 2024
[arXiv]

DreamScene: 3D Gaussian-based Text-to-3D Scene Generation via Formation Pattern Sampling
Haoran Li, Haolin Shi, Wenli Zhang, Wenjun Wu, Yong Liao, Lin Wang, Lik-hang Lee, Pengyuan Zhou
arXiv preprint, 4 Apr 2024
[arXiv]

Interactive3D: Create What You Want by Interactive 3D Generation
Shaocong Dong, Lihe Ding, Zhanpeng Huang, Zibin Wang, Tianfan Xue, Dan Xu
arXiv prepring, 25 Apr 2024 [arXiv] [Project] [Code]

FastScene: Text-Driven Fast 3D Indoor Scene Generation via Panoramic Gaussian Splatting
Yikun Ma, Dandan Zhan, Zhi Jin
IJCAI 2024, 9 May 2024
[arXiv]

MagicDrive3D: Controllable 3D Generation for Any-View Rendering in Street Scenes
Ruiyuan Gao, Kai Chen, Zhihao Li, Lanqing Hong, Zhenguo Li, Qiang Xu
arXiv preprint, 23 May 2024
[arXiv]

Dreamer XL: Towards High-Resolution Text-to-3D Generation via Trajectory Score Matching
Xingyu Miao, Haoran Duan, Varun Ojha, Jun Song, Tejal Shah, Yang Long, Rajiv Ranjan
arXiv preprint, 18 May 2024
[arXiv] [Code]

EG4D: Explicit Generation of 4D Object without Score Distillation
Qi Sun, Zhiyang Guo, Ziyu Wan, Jing Nathan Yan, Shengming Yin, Wengang Zhou, Jing Liao, Houqiang Li
arXiv preprint, 28 May 2024
[arXiv] [Code]

PLA4D: Pixel-Level Alignments for Text-to-4D Gaussian Splatting
Qiaowei Miao, Yawei Luo, Yi Yang
arXiv preprint, 30 May 2024
[arXiv] [Project]

Adversarial Generation of Hierarchical Gaussians for 3D Generative Model
Sangeek Hyun, Jae-Pil Heo
arXiv preprint, 5 Jun 2024
[arXiv] [Project]

Physics3D: Learning Physical Properties of 3D Gaussians via Video Diffusion
Fangfu Liu, Hanyang Wang, Shunyu Yao, Shengjun Zhang, Jie Zhou, Yueqi Duan
arXiv preprint, 6 Jun 2024
[arXiv] [Project]

GaussianCity: Generative Gaussian Splatting for Unbounded 3D City Generation
Haozhe Xie, Zhaoxi Chen, Fangzhou Hong, Ziwei Liu
arXiv preprint, 10 Jun 2024
[arXiv]

MVGamba: Unify 3D Content Generation as State Space Sequence Modeling
Xuanyu Yi, Zike Wu, Qiuhong Shen, Qingshan Xu, Pan Zhou, Joo-Hwee Lim, Shuicheng Yan, Xinchao Wang, Hanwang Zhang
arXiv preprint, 10 Jun 2024
[arXiv]

3DGS Model Compactness Optimization

LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS
Zhiwen Fan, Kevin Wang, Kairun Wen, Zehao Zhu, Dejia Xu, Zhangyang Wang
arXiv preprint, 28 Nov 2023
[arXiv] [Project] [Video]

Identifying Unnecessary 3D Gaussians using Clustering for Fast Rendering of 3D Gaussian Splatting
Joongho Jo, Hyeongwon Kim, Jongsun Park
arXiv preprint, 21 Feb 2024
[arXiv]

CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splatting
Xiangrui Liu, Xinju Wu, Pingping Zhang, Shiqi Wang, Zhu Li, Sam Kwong
arXiv preprint, 15 Apr 2024
[arXiv]

F-3DGS: Factorized Coordinates and Representations for 3D Gaussian Splatting
Xiangyu Sun, Joo Chan Lee, Daniel Rho, Jong Hwan Ko, Usman Ali, Eunbyung Park
arXiv preprint, 27 May 2024
[arXiv] [Project] [Code]

ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Model
Yufei Wang, Zhihao Li, Lanqing Guo, Wenhan Yang, Alex C. Kot, Bihan Wen
arXiv preprint, 31 May 2024
[arXiv]

Gaussian-Forest: Hierarchical-Hybrid 3D Gaussian Splatting for Compressed Scene Modeling
Fengyi Zhang, Tianjun Zhang, Lin Zhang, Helen Huang, Yadan Luo
arXiv preprint, 13 Jun 2024
[arXiv]

3DGS Streaming

3DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videos
Jiakai Sun, Han Jiao, Guangyuan Li, Zhanjie Zhang, Lei Zhao, Wei Xing
CVPR 2024, 3 Mar 2024
[arXiv] [Project] [Code]

HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression
Yihang Chen, Qianyi Wu, Jianfei Cai, Mehrtash Harandi, Weiyao Lin
arXiv preprint, 12 Mar 2024
[arXiv] [Project] [Code]

3DGS Robotics

Splat-Nav: Safe Real-Time Robot Navigation in Gaussian Splatting Maps
Timothy Chen, Ola Shorinwa, Weijia Zeng, Joseph Bruno, Philip Dames, Mac Schwager
arXiv preprint, 5 Mar 2023
[arXiv]

ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulation
Guanxing Lu, Shiyi Zhang, Ziwei Wang, Changliu Liu, Jiwen Lu, Yansong Tang
arXiv preprint, 13 Mar 2024
[arXiv]

Splat-MOVER: Multi-Stage, Open-Vocabulary Robotic Manipulation via Editable Gaussian Splatting
Ola Shorinwa, Johnathan Tucker, Aliyah Smith, Aiden Swann, Timothy Chen, Roya Firoozi, Monroe Kennedy III, Mac Schwager
arXiv preprint, 7 Mar 2024
[arXiv]

Query-based Semantic Gaussian Field for Scene Representation in Reinforcement Learning
Jiaxu Wang, Ziyi Zhang, Qiang Zhang, Jia Li, Jingkai Sun, Mingyuan Sun, Junhao He, Renjing Xu
arXiv preprint, 4 Jun 2024
[arXiv]

3DGS Avatar Generation

3DGS Avatar Generation Survey

A Survey on 3D Human Avatar Modeling -- From Reconstruction to Generation
Ruihe Wang, Yukang Cao, Kai Han, Kwan-Yee K. Wong
arXiv preprint, 6 Jun 2024
[arXiv]

3DGS Avatar Generation Progresses

Animatable 3D Gaussian: Fast and High-Quality Reconstruction of Multiple Human Avatars
Yang Liu, Xiang Huang, Minghan Qin, Qinwei Lin, Haoqian Wang
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

HumanGaussian: Text-Driven 3D Human Generation with Gaussian Splatting
Xian Liu, Xiaohang Zhan, Jiaxiang Tang, Ying Shan, Gang Zeng, Dahua Lin, Xihui Liu, Ziwei Liu
arXiv preprint, 28 Nov 2023
[arXiv] [Project]

HUGS: Human Gaussian Splats
Muhammed Kocabas, Jen-Hao Rick Chang, James Gabriel, Oncel Tuzel, Anurag Ranjan
arXiv preprint, 29 Nov 2023
[arXiv]

Gaussian Shell Maps for Efficient 3D Human Generation
Rameen Abdal, Wang Yifan, Zifan Shi, Yinghao Xu, Ryan Po, Zhengfei Kuang, Qifeng Chen, Dit-Yan Yeung, Gordon Wetzstein
arXiv preprint, 29 Nov 2023
[arXiv]

GPS-Gaussian: Generalizable Pixel-wise 3D Gaussian Splatting for Real-time Human Novel View Synthesis
Shunyuan Zheng, Boyao Zhou, Ruizhi Shao, Boning Liu, Shengping Zhang, Liqiang Nie, Yebin Liu
arXiv preprint, 4 Dec 2023
[arXiv] [Project]

GaussianAvatar: Towards Realistic Human Avatar Modeling from a Single Video via Animatable 3D Gaussians
Liangxiao Hu, Hongwen Zhang, Yuxiang Zhang, Boyao Zhou, Boning Liu, Shengping Zhang, Liqiang Nie
arXiv preprint, 4 Dec 2023
[arXiv] [Project]

GaussianAvatars: Photorealistic Head Avatars with Rigged 3D Gaussians
Shenhan Qian, Tobias Kirschstein, Liam Schoneveld, Davide Davoli, Simon Giebenhain, Matthias Nießner
arXiv preprint, 4 Dec 2023
[arXiv] [Project]

GaussianHead: Impressive 3D Gaussian-based Head Avatars with Dynamic Hybrid Neural Field
Jie Wang, Xianyan Li, Jiucheng Xie, Feng Xu, Hao Gao
arXiv preprint, 4 Dec 2023
[arXiv]

GauHuman: Articulated Gaussian Splatting from Monocular Human Videos
Shoukang Hu, Ziwei Liu
CVPR 2024, 5 Dec, 2023
[arXiv] [Project] [Code]

HeadGaS: Real-Time Animatable Head Avatars via 3D Gaussian Splatting
Helisa Dhamo, Yinyu Nie, Arthur Moreau, Jifei Song, Richard Shaw, Yiren Zhou, Eduardo Pérez-Pellitero
arXiv preprint, 5 Dec, 2023
[arXiv]

Relightable Gaussian Codec Avatars
Shunsuke Saito, Gabriel Schwartz, Tomas Simon, Junxuan Li, Giljoo Nam
CVPR 2024, 5 Dec 2023
[arXiv] [Project]

HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splatting
Yuheng Jiang, Zhehao Shen, Penghao Wang, Zhuo Su, Yu Hong, Yingliang Zhang, Jingyi Yu, Lan Xu
arXiv preprint, 6 Dec, 2023
[arXiv]

MonoGaussianAvatar: Monocular Gaussian Point-based Head Avatar
Yufan Chen, Lizhen Wang, Qijing Li, Hongjiang Xiao, Shengping Zhang, Hongxun Yao, Yebin Liu
SIGGRAPH 2024, 7 Dec, 2023
[arXiv] [Project] [Code] [Video]

ASH: Animatable Gaussian Splats for Efficient and Photoreal Human Rendering
Haokai Pang, Heming Zhu, Adam Kortylewski, Christian Theobalt, Marc Habermann
arXiv preprint, 10 Dec 2023
[arXiv] [Project] [Code]

3DGS-Avatar: Animatable Avatars via Deformable 3D Gaussian Splatting
Zhiyin Qian, Shaofei Wang, Marko Mihajlovic, Andreas Geiger, Siyu Tang
CVPR 2024, 14 Dec 2023
[arXiv] [Project] [Code]

GAvatar: Animatable 3D Gaussian Avatars with Implicit Mesh Learning
Ye Yuan, Xueting Li, Yangyi Huang, Shalini De Mello, Koki Nagano, Jan Kautz, Umar Iqbal
CVPR 2024, 18 Dec 2023
[arXiv] [Project] [Video]

3D Points Splatting for Real-Time Dynamic Hand Reconstruction
Zheheng Jiang, Hossein Rahmani, Sue Black, Bryan M. Williams
arXiv preprint, 21 Dec 2023
[arXiv]

Human101: Training 100+FPS Human Gaussians in 100s from 1 View
Mingwei Li, Jiachen Tao, Zongxin Yang, Yi Yang
arXiv preprint, 23 Dec 2023
[arXiv] [Code]

Gaussian Shadow Casting for Neural Characters
Luis Bolanos, Shih-Yang Su, Helge Rhodin
arXiv preprint, 11 Jan 2024
[arXiv]

GPAvatar: Generalizable and Precise Head Avatar from Image(s)
Xuangeng Chu, Yu Li, Ailing Zeng, Tianyu Yang, Lijian Lin, Yunfei Liu, Tatsuya Harada
ICLR 2024, 18 Jan 2024
[arXiv] [Code]

PSAvatar: A Point-based Morphable Shape Model for Real-Time Head Avatar Creation with 3D Gaussian Splatting
Zhongyuan Zhao, Zhenyu Bao, Qing Li, Guoping Qiu, Kanglin Liu
arXiv preprint, 23 Jan 2024
[arXiv]

ImplicitDeepfake: Plausible Face-Swapping through Implicit Deepfake Generation using NeRF and Gaussian Splatting
Georgii Stanishevskii, Jakub Steczkiewicz, Tomasz Szczepanik, Sławomir Tadeja, Jacek Tabor, Przemysław Spurek
arXiv preprint, 9 Feb 2024
[arXiv]

GaussianHair: Hair Modeling and Rendering with Light-aware Gaussians
Haimin Luo, Min Ouyang, Zijun Zhao, Suyi Jiang, Longwen Zhang, Qixuan Zhang, Wei Yang, Lan Xu, Jingyi Yu
arXiv preprint, 16 Feb 2024
[arXiv]

HeadStudio: Text to Animatable Head Avatars with 3D Gaussian Splatting
Zhenglin Zhou, Fan Ma, Hehe Fan, Yi Yang
arXiv preprint, 9 Feb 2024
[arXiv]

Rig3DGS: Creating Controllable Portraits from Casual Monocular Videos
Alfredo Rivero, ShahRukh Athar, Zhixin Shu, Dimitris Samaras
arXiv preprint, 6 Feb 2024
[arXiv] [Project]

SplatFace: Gaussian Splat Face Reconstruction Leveraging an Optimizable Surface
Jiahao Luo, Jing Liu, James Davis
arXiv preprint, 27 Mar 2024
[arXiv]

HAHA: Highly Articulated Gaussian Human Avatars with Textured Mesh Prior
David Svitov, Pietro Morerio, Lourdes Agapito, Alessio Del Bue
arXiv preprint, 1 Apr 2024
[arXiv]

GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Mesh
Jing Wen, Xiaoming Zhao, Zhongzheng Ren, Alexander G. Schwing, Shenlong Wang
CVPR 2024, 11 Apr 2024
[arXiv] [Project] [Code]

OccGaussian: 3D Gaussian Splatting for Occluded Human Rendering
Jingrui Ye, Zongkai Zhang, Yujiao Jiang, Qingmin Liao, Wenming Yang, Zongqing Lu
arXiv preprint, 12 Apr 2024
[arXiv]

GaussianTalker: Speaker-specific Talking Head Synthesis via 3D Gaussian Splatting
Hongyun Yu, Zhan Qu, Qihang Yu, Jianchuan Chen, Zhonghua Jiang, Zhiwen Chen, Shengyu Zhang, Jimin Xu, Fei Wu, Chengfei Lv, Gang Yu
arXiv preprint, 22 Apr 2024
[arXiv] [Project] [Video]

3D Gaussian Blendshapes for Head Avatar Animation
Shengjie Ma, Yanlin Weng, Tianjia Shao, Kun Zhou
SIGGRAPH 2024, 30 Apr 2024
[arXiv]

GaussianTalker: Real-Time High-Fidelity Talking Head Synthesis with Audio-Driven 3D Gaussian Splatting
Kyusun Cho, Joungbin Lee, Heeji Yoon, Yeobin Hong, Jaehoon Ko, Sangjun Ahn, Seungryong Kim
arXiv preprint, 24 Apr 2024
[arXiv] [Code]

GSTalker: Real-time Audio-Driven Talking Face Generation via Deformable Gaussian Splatting
Bo Chen, Shoukang Hu, Qi Chen, Chenpeng Du, Ran Yi, Yanmin Qian, Xie Chen
arXiv preprint, 29 Apr 2024
[arXiv]

MeGA: Hybrid Mesh-Gaussian Head Avatar for High-Fidelity Rendering and Head Editing
Cong Wang, Di Kang, He-Yi Sun, Shen-Han Qian, Zi-Xuan Wang, Linchao Bao, Song-Hai Zhang
arXiv preprint, 29 Apr 2024
[arXivhttps://arxiv.org/abs/2404.19026] [Project]

Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras
*Hanzhang Tu, Ruizhi Shao, Xue Dong, Shunyuan Zheng, Hao Zhang, Lili Chen, Meili Wang, Wenyu Li, Siyan Ma, Shengping Zhang, Boyao Zhou, Yebin Liu
SIGGRAPH 2024, 23 May 2024
[arXiv] [Project] [Video]

LAGA: Layered 3D Avatar Generation and Customization via Gaussian Splatting
Jia Gong, Shenyu Ji, Lin Geng Foo, Kang Chen, Hossein Rahmani, Jun Liu
arXiv preprint, 21 May 2024
[arXiv]

Gaussian Control with Hierarchical Semantic Graphs in 3D Human Recovery
Hongsheng Wang, Weiyue Zhang, Sihao Liu, Xinrui Zhou, Shengyu Zhang, Fei Wu, Feng Lin
arXiv preprint, 21 May 2024
[arXiv] [Project] [Code]

Gaussian Head & Shoulders: High Fidelity Neural Upper Body Avatars with Anchor Gaussian Guided Texture Warping
Tianhao Wu, Jing Yang, Zhilin Guo, Jingyi Wan, Fangcheng Zhong, Cengiz Oztireli
arXiv preprint, 20 May 2024
[arXiv] [Project]

3DGS Clothes/Garment

GaussianVTON: 3D Human Virtual Try-ON via Multi-Stage Gaussian Splatting Editing with Image Prompting
Haodong Chen, Yongle Huang, Haojian Huang, Xiangsheng Ge, Dian Shao
arXiv preprint, 13 May 2024
[arXiv]

MOSS: Motion-based 3D Clothed Human Synthesis from Monocular Video
Hongsheng Wang, Xiang Cai, Xi Sun, Jinhong Yue, Shengyu Zhang, Feng Lin, Fei Wu
arXiv preprint, 21 May 2024
[arXiv] [Project] [Code]

GarmentDreamer: 3DGS Guided Garment Synthesis with Diverse Geometry and Texture Details
Boqian Li, Xuan Li, Ying Jiang, Tianyi Xie, Feng Gao, Huamin Wang, Yin Yang, Chenfanfu Jiang
arXiv preprint, 20 May 2024
[arXiv] [Project]

NPGA: Neural Parametric Gaussian Avatars
Simon Giebenhain, Tobias Kirschstein, Martin Rünz, Lourdes Agapito, Matthias Nießner
arXiv preprint, 29 May 2024
[arXiv] [Project] [Video]

GGHead: Fast and Generalizable 3D Gaussian Heads
Tobias Kirschstein, Simon Giebenhain, Jiapeng Tang, Markos Georgopoulos, Matthias Nießner
arXiv preprint, 13 Jun 2024
[arXiv] [Projectt] [Video]

Human 3Diffusion: Realistic Avatar Creation via Explicit 3D Consistent Diffusion Models
Yuxuan Xue, Xianghui Xie, Riccardo Marin, Gerard Pons-Moll
arXiv preprint, 12 Jun 2024
[arXiv] [Project] [Code]

3DGS Scene Editing and Animation

Animatable 3D Gaussians for High-fidelity Synthesis of Human Motions
Keyang Ye, Tianjia Shao, Kun Zhou
arXiv preprint, 22 Nov 2023
[arXiv]

GaussianEditor: Swift and Controllable 3D Editing with Gaussian Splatting
Yiwen Chen, Zilong Chen, Chi Zhang, Feng Wang, Xiaofeng Yang, Yikai Wang, Zhongang Cai, Lei Yang, Huaping Liu, Guosheng Lin
arXiv preprint, 24 Nov 2023
[arXiv] [Project]

Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing
Jian Gao, Chun Gu, Youtian Lin, Hao Zhu, Xun Cao, Li Zhang, Yao Yao
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

GART: Gaussian Articulated Template Models
Jiahui Lei, Yufu Wang, Georgios Pavlakos, Lingjie Liu, Kostas Daniilidis
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

Animatable Gaussians: Learning Pose-dependent Gaussian Maps for High-fidelity Human Avatar Modeling
Zhe Li, Zerong Zheng, Lizhen Wang, Yebin Liu
arXiv preprint, 27 Nov 2023
[arXiv] [Project]

Point'n Move: Interactive Scene Object Manipulation on Gaussian Splatting Radiance Fields
Jiajun Huang, Hongchuan Yu
arXiv preprint, 28 Nov, 2023
[arXiv]

TIP-Editor: An Accurate 3D Editor Following Both Text-Prompts And Image-Prompts
Jingyu Zhuang, Di Kang, Yan-Pei Cao, Guanbin Li, Liang Lin, Ying Shan
SIGGRAPH 2024, 26 Jan 2024
[arXiv]

GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editing
Jing Wu, Jia-Wang Bian, Xinghui Li, Guangrun Wang, Ian Reid, Philip Torr, Victor Adrian Prisacariu
arXiv preprint, 13 Mar 2024
[arXiv] [Project]

Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing
Tian-Xing Xu, Wenbo Hu, Yu-Kun Lai, Ying Shan, Song-Hai Zhang
arXiv preprint, 15 Mar 2024
[arXiv]

View-Consistent 3D Editing with Gaussian Splatting
Yuxuan Wang, Xuanyu Yi, Zike Wu, Na Zhao, Long Chen, Hanwang Zhang
arXiv preprint, 18 Mar 2024
[arXiv] [Project]

Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing
Ri-Zhao Qiu, Ge Yang, Weijia Zeng, Xiaolong Wang
arXiv preprint, 1 Apr 2024
[arXiv] [Project] [Code]

GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal
Yuxin Wang, Qianyi Wu, Guofeng Zhang, Dan Xu
arXiv preprint, 21 Apr 2024
[arXiv] [Project]

DGE: Direct Gaussian 3D Editing by Consistent Multi-view Editing
Minghao Chen, Iro Laina, Andrea Vedaldi
arXiv preprint, 29 Apr 2024
[arXiv] [Project] [Code]

TIGER: Text-Instructed 3D Gaussian Retrieval and Coherent Editing
Teng Xu, Jiamin Chen, Peng Chen, Youjia Zhang, Junqing Yu, Wei Yang
arXiv preprint, 23 May 2024
[arXiv]

D-MiSo: Editing Dynamic 3D Scenes using Multi-Gaussians Soup
Joanna Waczyńska, Piotr Borycki, Joanna Kaleta, Sławomir Tadeja, Przemysław Spurek
arXiv preprint, 23 May 2024
[arXiv]

ICE-G: Image Conditional Editing of 3D Gaussian Splats
Vishnu Jaganathan, Hannah Hanyun Huang, Muhammad Zubair Irshad, Varun Jampani, Amit Raj, Zsolt Kira
CVPR AI4CC Workshop 2024, 12 Jun 2024
[arXiv] [Project]

3DGS Stylization

Gaussian Splatting in Style
Abhishek Saroha, Mariia Gladkova, Cecilia Curreli, Tarun Yenamandra, Daniel Cremers
arXiv preprint, 13 Mar 2024
[arXiv]

StyleGaussian: Instant 3D Style Transfer with Gaussian Splatting
Kunhao Liu, Fangneng Zhan, Muyu Xu, Christian Theobalt, Ling Shao, Shijian Lu
arXiv preprint, 12 Mar 2024
[arXiv] [Project] [Code]

StylizedGS: Controllable Stylization for 3D Gaussian Splatting
Dingxi Zhang, Zhuoxun Chen, Yu-Jie Yuan, Fang-Lue Zhang, Zhenliang He, Shiguang Shan, Lin Gao
arXiv preprint, 8 Apr 2024
[arXiv]

InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior
Zhiheng Liu, Hao Ouyang, Qiuyu Wang, Ka Leong Cheng, Jie Xiao, Kai Zhu, Nan Xue, Yu Liu, Yujun Shen, Yang Cao
arXiv preprint, 17 Apr 2024
[arXiv] [Project] [Code]

3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting
Qihang Zhang, Yinghao Xu, Chaoyang Wang, Hsin-Ying Lee, Gordon Wetzstein, Bolei Zhou, Ceyuan Yang
arXiv preprint, 28 May 2024
[arXiv] [Project] [Code]

Enhancing Temporal Consistency in Video Editing by Reconstructing Videos with 3D Gaussian Splatting
Inkyu Shin, Qihang Yu, Xiaohui Shen, In So Kweon, Kuk-Jin Yoon, Liang-Chieh Chen
arXiv preprint, 4 Jun 2024
[arXiv] [Project]

3DGS for Computer Graphics

PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamics
Tianyi Xie, Zeshun Zong, Yuxing Qiu, Xuan Li, Yutao Feng, Yin Yang, Chenfanfu Jiang
CVPR 2024, 20 Nov 2023
[arXiv] [Project]

Gaussian Splashing: Dynamic Fluid Synthesis with Gaussian Splatting
Yutao Feng, Xiang Feng, Yintong Shang, Ying Jiang, Chang Yu, Zeshun Zong, Tianjia Shao, Hongzhi Wu, Kun Zhou, Chenfanfu Jiang, Yin Yang
arXiv preprint, 27 Jan 2024
[arXiv] [Project] [Video]

VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Reality
Ying Jiang, Chang Yu, Tianyi Xie, Xuan Li, Yutao Feng, Huamin Wang, Minchen Li, Henry Lau, Feng Gao, Yin Yang, Chenfanfu Jiang
arXiv preprint, 30 Jan 2024
[arXiv] [Project]

A Grid-Free Fluid Solver based on Gaussian Spatial Representation
Jingrui Xing, Bin Wang, Mengyu Chu, Baoquan Chen
arXiv preprint, 28 May 2024
[arXiv]

GS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis
Yumeng He, Yunbo Wang, Xiaokang Yang
arXiv preprint, 31 May 2024
[arXiv]

DreamPhysics: Learning Physical Properties of Dynamic 3DGaussianswith Video Diffusion Priors
Tianyu Huang, Yihan Zeng, Hui Li, Wangmeng Zuo, Rynson W. H. Lau
arXiv preprint, 3 Jun 2024
[arXiv] [Code]

3DGS Based Scene Understanding

Language Embedded 3D Gaussians for Open-Vocabulary Scene Understanding
Jin-Chuan Shi, Miao Wang, Hao-Bin Duan, Shao-Hua Guan
arXiv preprint, 30 Nov 2023
[arXiv]

Semantic Anything in 3D Gaussians
Xu Hu, Yuxi Wang, Lue Fan, Junsong Fan, Junran Peng, Zhen Lei, Qing Li, Zhaoxiang Zhang
arXiv preprint, 31 Jan 2024
[arXiv]

2D-Guided 3D Gaussian Segmentation
Kun Lan, Haoran Li, Haolin Shi, Wenjun Wu, Yong Liao, Lin Wang, Pengyuan Zhou
arXiv preprint, 26 Dec 2023
[arXiv]

CoSSegGaussians: Compact and Swift Scene Segmenting 3D Gaussians
Bin Dou, Tianyu Zhang, Yongjia Ma, Zhaohui Wang, Zejian Yuan
arXiv preprint, 11 Jan 2024
[arXiv] [Project]

Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting
Jun Guo, Xiaojian Ma, Yue Fan, Huaping Liu, Qing Li
arXiv preprint, 22 Mar 2024
[arXiv] [Project] [Code]

CLIP-GS: CLIP-Informed Gaussian Splatting for Real-time and View-consistent 3D Semantic Understanding
Guibiao Liao, Jiankun Li, Zhenyu Bao, Xiaoqing Ye, Jingdong Wang, Qing Li, Kanglin Liu
arXiv preprint, 22 Apr 2024
[arXiv] [Code]

OMEGAS: Object Mesh Extraction from Large Scenes Guided by Gaussian Segmentation
Lizhi Wang, Feng Zhou, Jianqin Yin arXiv preprint, 24 Apr 2024
[arXiv] [Code]

Memorize What Matters: Emergent Scene Decomposition from Multitraverse
Yiming Li, Zehong Wang, Yue Wang, Zhiding Yu, Zan Gojcic, Marco Pavone, Chen Feng, Jose M. Alvarez
arXiv preprint, 27 May 2024
[arXiv] [Project] [Code]

RT-GS2: Real-Time Generalizable Semantic Segmentation for 3D Gaussian Representations of Radiance Fields
Mihnea-Bogdan Jurca, Remco Royen, Ion Giosan, Adrian Munteanu
arXiv preprint, 28 May 2024
[arXiv]

FastLGS: Speeding up Language Embedded Gaussians with Feature Grid Mapping
Yuzhou Ji, He Zhu, Junshu Tang, Wuyi Liu, Zhizhong Zhang, Yuan Xie, Lizhuang Ma, Xin Tan
arXiv preprint, 4 Jun 2024
[arXiv]

OpenGaussian: Towards Point-Level 3D Gaussian-based Open Vocabulary Understanding
Yanmin Wu, Jiarui Meng, Haijie Li, Chenming Wu, Yahao Shi, Xinhua Cheng, Chen Zhao, Haocheng Feng, Errui Ding, Jingdong Wang, Jian Zhang
arXiv preprint, 4 Jun 2024
[arXiv] [Project]

3DGS + Specular

Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splatting
Ziyi Yang, Xinyu Gao, Yangtian Sun, Yihua Huang, Xiaoyang Lyu, Wen Zhou, Shaohui Jiao, Xiaojuan Qi, Xiaogang Jin
arXiv preprint, 24 Feb 2024
[arXiv]

3DGS Based SLAM

SplaTAM: Splat, Track & Map 3D Gaussians for Dense RGB-D SLAM
Nikhil Keetha, Jay Karhade, Krishna Murthy Jatavallabhula, Gengshan Yang, Sebastian Scherer, Deva Ramanan, Jonathon Luiten
arXiv preprint, 4 Dec 2023
[arXiv]

LIV-GaussMap: LiDAR-Inertial-Visual Fusion for Real-time 3D Radiance Field Map Rendering
Sheng Hong, Junjie He, Xinhu Zheng, Hesheng Wang, Hao Fang, Kangcheng Liu, Chunran Zheng, Shaojie Shen
arXiv preprint, 26 Jan 2024
[arXiv]

SGS-SLAM: Semantic Gaussian Splatting For Neural Dense SLAM
Mingrui Li, Shuhong Liu, Heng Zhou
arXiv preprint, 5 Feb 2024
[arXiv]

MoD-SLAM: Monocular Dense Mapping for Unbounded 3D Scene Reconstruction
Heng Zhou, Zhetao Guo, Shuhong Liu, Lechen Zhang, Qihao Wang, Yuxiang Ren, Mingrui Li
arXiv preprint, 6 Feb 2024
[arXiv]

SemGauss-SLAM: Dense Semantic Gaussian Splatting SLAM
Siting Zhu, Renjie Qin, Guangming Wang, Jiuming Liu, Hesheng Wang
arXiv preprint, 13 Mar 2024
[arXiv]

RGBD GS-ICP SLAM
Seongbo Ha, Jiung Yeon, Hyeonwoo Yu
arXiv preprint, 19 Mar 2024
[arXiv]

NEDS-SLAM: A Novel Neural Explicit Dense Semantic SLAM Framework using 3D Gaussian Splatting
Yiming Ji, Yang Liu, Guanghu Xie, Boyu Ma, Zongwu Xie
arXiv preprint, 18 Mar 2024
[arXiv]

CG-SLAM: Efficient Dense RGB-D SLAM in a Consistent Uncertainty-aware 3D Gaussian Field
Jiarui Hu, Xianhao Chen, Boyin Feng, Guanglin Li, Liangjing Yang, Hujun Bao, Guofeng Zhang, Zhaopeng Cui
arXiv preprint, 24 Mar 2024
[arXiv] [Project] [Code]

RGBD GS-ICP SLAM
Seongbo Ha, Jiung Yeon, Hyeonwoo Yu
arXiv preprint, 19 Mar 2024
[arXiv]

HGS-Mapping: Online Dense Mapping Using Hybrid Gaussian Representation in Urban Scenes
Ke Wu, Kaizhao Zhang, Zhiwei Zhang, Shanshuai Yuan, Muer Tie, Julong Wei, Zijun Xu, Jieru Zhao, Zhongxue Gan, Wenchao Ding
arXiv preprint, 29 Mar 2024
[arXiv]

MM3DGS SLAM: Multi-modal 3D Gaussian Splatting for SLAM Using Vision, Depth, and Inertial Measurements
Lisong C. Sun, Neel P. Bhatt, Jonathan C. Liu, Zhiwen Fan, Zhangyang Wang, Todd E. Humphreys, Ufuk Topcu
arXiv preprint, 1 Apr 2024
[arXiv] [Project] [Video]

Gaussian-LIC: Photo-realistic LiDAR-Inertial-Camera SLAM with 3D Gaussian Splatting
Xiaolei Lang, Laijian Li, Hang Zhang, Feng Xiong, Mu Xu, Yong Liu, Xingxing Zuo, Jiajun Lv
IROS 2024, 10 Apr 2024
[arXiv]

RTG-SLAM: Real-time 3D Reconstruction at Scale using Gaussian Splatting
Zhexi Peng, Tianjia Shao, Yong Liu, Jingke Zhou, Yin Yang, Jingdong Wang, Kun Zhou
arXiv preprint, 30 Apr 2024
[arXiv]

MGS-SLAM: Monocular Sparse Tracking and Gaussian Mapping with Depth Smooth Regularization
Pengcheng Zhu, Yaoming Zhuang, Baoquan Chen, Li Li, Chengdong Wu, Zhanlin Liu
arXiv preprint, 10 May 2024
[arXiv]

NGM-SLAM: Gaussian Splatting SLAM with Radiance Field Submap
Mingrui Li, Jingwei Huang, Lei Sun, Aaron Xuxiang Tian, Tianchen Deng, Hongyu Wang
arXiv preprint, 9 May 2024
[arXiv]

GS-Planner: A Gaussian-Splatting-based Planning Framework for Active High-Fidelity Reconstruction
Rui Jin, Yuman Gao, Haojian Lu, Fei Gao
arXiv preprint, 16 May 2024
[arXiv]

Splat-SLAM: Globally Optimized RGB-only SLAM with 3D Gaussians
Erik Sandström, Keisuke Tateno, Michael Oechsle, Michael Niemeyer, Luc Van Gool, Martin R. Oswald, Federico Tombari
arXiv preprint, 26 May 2024
[arXiv] [Code]

Structure Gaussian SLAM with Manhattan World Hypothesis
Shuhong Liu, Heng Zhou, Liuzhuozheng Li, Yun Liu, Tianchen Deng, Yiming Zhou, Mingrui Li
arXiv preprint, 30 May 2024
[arXiv]

3DGS Based Inverse Rendering

GIR: 3D Gaussian Inverse Rendering for Relightable Scene Factorization
Yahao Shi, Yanmin Wu, Chenming Wu, Xing Liu, Chen Zhao, Haocheng Feng, Jingtuo Liu, Liangjun Zhang, Jian Zhang, Bin Zhou, Errui Ding, Jingdong Wang
arXiv preprint, 8 Dec, 2023
[arXiv] [Project]

DeferredGS: Decoupled and Editable Gaussian Splatting with Deferred Shading
Tong Wu, Jia-Mu Sun, Yu-Kun Lai, Yuewen Ma, Leif Kobbelt, Lin Gao
arXiv preprint, 15 Apr 2024
[arXiv]

MotionGS : Compact Gaussian Splatting SLAM by Motion Filter
Xinli Guo, Peng Han, Weidong Zhang, Hongtian Chen
arXiv preprint, 18 May 2024
[arXiv]

3DGS Imaging Tasks

Deblurring 3D Gaussian Splatting
Byeonghyeon Lee, Howoong Lee, Xiangyu Sun, Usman Ali, Eunbyung Park
arXiv preprint, 1 Jan 2024
[arXiv] [Project] [Code]

BAD-Gaussians: Bundle Adjusted Deblur Gaussian Splatting
Lingzhe Zhao, Peng Wang, Peidong Liu
arXiv preprint, 18 Mar 2024
[arXiv] [Project] [Code]

Gaussian Splatting on the Move: Blur and Rolling Shutter Compensation for Natural Camera Motion
Otto Seiskari, Jerry Ylilammi, Valtteri Kaatrasalo, Pekka Rantalankila, Matias Turkulainen, Juho Kannala, Esa Rahtu, Arno Solin
arXiv preprint, 20 Mar 2024
[arXiv] [Code]

BAGS: Blur Agnostic Gaussian Splatting through Multi-Scale Kernel Modeling
Cheng Peng, Yutao Tang, Yifan Zhou, Nengyu Wang, Xijun Liu, Deming Li, Rama Chellappa
arXiv preprint, 7 Mar 2024
[arXiv]

From Chaos to Clarity: 3DGS in the Dark
Zhihao Li, Yufei Wang, Alex Kot, Bihan Wen
arXiv preprint, 12 Jun 2024
[arXiv]

Cinematic Gaussians: Real-Time HDR Radiance Fields with Depth of Field
Chao Wang, Krzysztof Wolski, Bernhard Kerbl, Ana Serrano, Mojtaba Bemana, Hans-Peter Seidel, Karol Myszkowski, Thomas Leimkühler
arXiv preprint, 11 Jun 2024
[arXiv]

Lighting Every Darkness with 3DGS: Fast Training and Real-Time Rendering for HDR View Synthesis
Xin Jin, Pengyi Jiao, Zheng-Peng Duan, Xingchao Yang, Chun-Le Guo, Bo Ren, Chongyi Li
arXiv preprint, 10 Jun 2024
[arXiv] [Code]

3DGS for Reflective and Transparent Objects

Snap-it, Tap-it, Splat-it: Tactile-Informed 3D Gaussian Splatting for Reconstructing Challenging Surfaces
Mauro Comi, Alessio Tonioni, Max Yang, Jonathan Tremblay, Valts Blukis, Yijiong Lin, Nathan F. Lepora, Laurence Aitchison
arXiv preprint, 29 Mar 2024
[arXiv]

Mirror-3DGS: Incorporating Mirror Reflections into 3D Gaussian Splatting
Jiarui Meng, Haijie Li, Yanmin Wu, Qiankun Gao, Shuzhou Yang, Jian Zhang, Siwei Ma
arXiv preprint, 1 Apr 2024
[arXiv]

RainyScape: Unsupervised Rainy Scene Reconstruction using Decoupled Neural Rendering
Xianqiang Lyu, Hui Liu, Junhui Hou
arXiv preprint, 17 Apr 2024
[arXiv]

DeblurGS: Gaussian Splatting for Camera Motion Blur
Jeongtaek Oh, Jaeyoung Chung, Dongwoo Lee, Kyoung Mu Lee
arXiv preprint, 17 Apr 2024
[arXiv]

3D Gaussian Splatting with Deferred Reflection
Keyang Ye, Qiming Hou, Kun Zhou
arXiv preprint, 29 Apr 2024
[arXiv]

MirrorGaussian: Reflecting 3D Gaussians for Reconstructing Mirror Reflections
Jiayue Liu, Xiao Tang, Freeman Cheng, Roy Yang, Zhihao Li, Jianzhuang Liu, Yi Huang, Jiaqi Lin, Shiyong Liu, Xiaofei Wu, Songcen Xu, Chun Yuan
arXiv preprint, 20 May 2024
[arXiv] [Project]

DC-Gaussian: Improving 3D Gaussian Splatting for Reflective Dash Cam Videos
Linhan Wang, Kai Cheng, Shuo Lei, Shengkun Wang, Wei Yin, Chenyang Lei, Xiaoxiao Long, Chang-Tien Lu
arXiv preprint, 27 May 2024
[arXiv] [Project] [Code]

RefGaussian: Disentangling Reflections from 3D Gaussian Splatting for Realistic Rendering
Rui Zhang, Tianyue Luo, Weidong Yang, Ben Fei, Jingyi Xu, Qingyuan Zhou, Keyi Liu, Ying He
arXiv preprint, 9 Jun 2024
[arXiv]

3DGS Superresolution

SRGS: Super-Resolution 3D Gaussian Splatting
Xiang Feng, Yongbo He, Yubo Wang, Yan Yang, Zhenzhong Kuang, Yu Jun, Jianping Fan, Jiajun ding
ACM MM 2024, 16 Apr 2024
[arXiv]

3DGS for Point Cloud

Zero-shot Point Cloud Completion Via 2D Priors
Tianxin Huang, Zhiwen Yan, Yuyang Zhao, Gim Hee Lee
arXiv preprint, 10 Apr 2024
[arXiv]

Photorealistic 3D Urban Scene Reconstruction and Point Cloud Extraction using Google Earth Imagery and Gaussian Splatting
Kyle Gao, Dening Lu, Hongjie He, Linlin Xu, Jonathan Li
arXiv preprint, 17 May 2024
[arXiv]

3DGS for CV Tasks

3DGS-Calib: 3D Gaussian Splatting for Multimodal SpatioTemporal Calibration
Quentin Herau, Moussab Bennehar, Arthur Moreau, Nathan Piasco, Luis Roldao, Dzmitry Tsishkou, Cyrille Migniot, Pascal Vasseur, Cédric Demonceaux
arXiv preprint, 18 Mar 2024
[arXiv]

3DGS with Hardware

Dual-Camera Smooth Zoom on Mobile Phones
Renlong Wu, Zhilu Zhang, Yu Yang, Wangmeng Zuo
arXiv preprint, 7 Apr 2024
[arXiv]

Event3DGS: Event-based 3D Gaussian Splatting for Fast Egomotion
Tianyi Xiong, Jiayi Wu, Botao He, Cornelia Fermuller, Yiannis Aloimonos, Heng Huang, Christopher A. Metzler
arXiv preprint, 5 Jun 2024
[arXiv]

3DGS Applications

3DGS Application in Animal Reconstruction

Exploring the Feasibility of Generating Realistic 3D Models of Endangered Species Using DreamGaussian: An Analysis of Elevation Angle's Impact on Model Generation
Selcuk Anil Karatopak, Deniz Sen
arXiv preprint, 15 Dec 2023
[arXiv]

3DGS Application in Medical Imaging

EndoGaussian: Gaussian Splatting for Deformable Surgical Scene Reconstruction
Yifan Liu, Chenxin Li, Chen Yang, Yixuan Yuan
arXiv preprint, 23 Jan 2024
[arXiv] [Project] [Code]

Deformable Endoscopic Tissues Reconstruction with Gaussian Splatting
Lingting Zhu, Zhao Wang, Zhenchao Jin, Guying Lin, Lequan Yu
arXiv preprint, 21 Jan 2024
[arXiv] [Code]

Endo-4DGS: Distilling Depth Ranking for Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splatting
Yiming Huang, Beilei Cui, Long Bai, Ziqi Guo, Mengya Xu, Hongliang Ren
arXiv preprint, 29 Jan 2024
[arXiv]

Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
Yuanhao Cai, Yixun Liang, Jiahao Wang, Angtian Wang, Yulun Zhang, Xiaokang Yang, Zongwei Zhou, Alan Yuille
arXiv preprint, 7 Mar 2024
[arXiv] [Video]

TOGS: Gaussian Splatting with Temporal Opacity Offset for Real-Time 4D DSA Rendering
Shuai Zhang, Huangxuan Zhao, Zhenghong Zhou, Guanjun Wu, Chuansheng Zheng, Xinggang Wang, Wenyu Liu
arXiv preprint, 28 Mar 2024
[arXiv]

Gaussian Pancakes: Geometrically-Regularized 3D Gaussian Splatting for Realistic Endoscopic Reconstruction
Sierra Bonilla, Shuai Zhang, Dimitrios Psychogyios, Danail Stoyanov, Francisco Vasconcelos, Sophia Bano
arXiv preprint, 9 Apr 2024
[arXiv]

Novel View Synthesis for Cinematic Anatomy on Mobile and Immersive Displays
Simon Niedermayr, Christoph Neuhauser, Kaloian Petkov, Klaus Engel, Rüdiger Westermann
arXiv preprint, 17 Apr 2024
[arXiv]

HFGS: 4D Gaussian Splatting with Emphasis on Spatial and Temporal High-Frequency Components for Endoscopic Scene Reconstruction
Haoyu Zhao, Xingyue Zhao, Lingting Zhu, Weixi Zheng, Yongchao Xu
arXiv preprint, 28 May 2024
[arXiv]

Deform3DGS: Flexible Deformation for Fast Surgical Scene Reconstruction with Gaussian Splatting
Shuojue Yang, Qian Li, Daiyun Shen, Bingchen Gong, Qi Dou, Yueming Jin
arXiv preprint, 28 May 2024
[arXiv] [Code]

R^2-Gaussian: Rectifying Radiative Gaussian Splatting for Tomographic Reconstruction
Ruyi Zha, Tao Jun Lin, Yuanhao Cai, Jiwen Cao, Yanhao Zhang, Hongdong Li
arXiv preprint, 31 May 2024
[arXiv]

DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Rendering
Zhongpai Gao, Benjamin Planche, Meng Zheng, Xiao Chen, Terrence Chen, Ziyan Wu
arXiv preprint, 4 Jun 2024
[arXiv]

Gaussian Representation for Deformable Image Registration
Jihe Li, Fabian Zhang, Xia Li, Tianhao Zhang, Ye Zhang, Joachim Buhmann
arXiv preprint, 5 Jun 2024
[arXiv]

3DGS Artifact Detection

SplatPose & Detect: Pose-Agnostic 3D Anomaly Detection
Mathis Kruse, Marco Rudolph, Dominik Woiwode, Bodo Rosenhahn
CVPR 2024, 10 Apr 2024
[arXiv]

3DGS Applications in Satellite Images

Reconstructing Satellites in 3D from Amateur Telescope Images
Zhiming Chang, Boyang Liu, Yifei Xia, Youming Guo, Boxin Shi, He Sun
arXiv preprint, 29 Apr 2024
[arXiv]

SatSplatYOLO: 3D Gaussian Splatting-based Virtual Object Detection Ensembles for Satellite Feature Recognition
Van Minh Nguyen, Emma Sandidge, Trupti Mahendrakar, Ryan T. White
arXiv preprint, 4 Jun 2024
[arXiv]

3DGS Network Applications

Embracing Radiance Field Rendering in 6G: Over-the-Air Training and Inference with 3D Contents
Guanlin Wu, Zhonghao Lyu, Juyong Zhang, Jie Xu
arXiv preprint, 20 May 2024
[arXiv]

3DGS for Acoustic

AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesis
Swapnil Bhosale, Haosen Yang, Diptesh Kanojia, Jiankang Deng, Xiatian Zhu
arXiv preprint, 13 Jun 2024
[arXiv]

Contributors

Thanks to the community and hoping more and more people are joining us and submit commits and PRs!

Made with contributors-img.

License

CC-0

3dgs_and_beyond_docs's People

Contributors

yangjiheng avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.