anuzk13 / fall23_mat-200c_final-project

https://arxiv.org/pdf/2312.03203.pdf

Project Summary

For my project I am interested in reading a paper on NeRF and implementing this methods on webgpu. I am interested in being able to read, understand and implement a ML paper. I will use the same license as the original NERF project (MIT License).

My question would be:

Do you recommend me to try to understand the paper and the math? I have seen some "cool things" in the internet and I am not sure if instead I should just try to play around with it and achieve a good looking result.

Project progress

1. For my project I have studied two papers:

Representing Scenes as Neural Radiance Fields for View Synthesis

My notes on the NERF Paper

3D Gaussian Splatting for Real-Time Radiance Field Rendering

My notes on the GS paper

2. I am also working on playing with a renderer for gaussian splats

See my progres modifying the Gaussian Splat Renderer here: https://github.com/anuzk13/SplatMAT200C/tree/my_exp

My notes on creating and modifying GP

Brainstorming

Creating and visualizing Gaussian Splats

Modifying GP with shaders

Sources for volumetric video

Creating Gaussian Splats from movies

Dynamic volumetric video

Dynamic Gaussian Splatting

• Enerf
• Kplanes
• 4K4D: Real-Time 4D View Synthesis at 4K Resolution (only paper available, no code...yet?)

Web implementations

Web implementations GP for threejs https://discourse.threejs.org/t/3d-gaussian-splatting-in-three-js/57858 https://github.com/SpectacularAI/splat https://github.com/antimatter15/splat

Random online things

https://x.com/AlexR4/status/1720378611289526471?t=eaLqUYpj3C02ZcTXi852Xw&s=09 https://x.com/amygoodchild/status/1724083526671163645?t=8kaS-UfnGKgxmOJ3fQk1hw&s=09 https://mastodon.gamedev.place/@aras Unity GP Chat for learning about NERF Making GP smaller https://x.com/NTU_chenyiwen/status/1728963861813064187?t=UhJs13Hjm2KRMMfMrAKmFA&s=09 3D object tracking https://github.com/DLR-RM/3DObjectTracking https://x.com/Nik__V__/status/1731840557553496410?t=I-hFBYuzM4OcE3JC2Za_qw&s=09 https://lumalabs.ai/luma-web-library

https://x.com/Haxiomic/status/1733971738558435622?t=W4Ln0ZB_OU02Vbuf68GSbQ&s=09

https://x.com/Haxiomic/status/1733971738558435622?t=W4Ln0ZB_OU02Vbuf68GSbQ&s=09

https://x.com/zianwang97/status/1725300891421462926?t=ujDl8QuIvZbp7ftjb7jSIA&s=09