Comments (2)
Sorry for the delay..
Thank you for pointing out the error. I have fixed it.
I wonder what if light move across the surface . To my understanding, SDF is not accurate during optimizing, so sphere marching might not guarantee that light never move across the boundary of the object.
Compared with other concurrent work for SDF-based diff rendering, our approach would never move across the boundary since in each ray matching step, we always move forward by the distance to the closest surface. This guarantees that we will never move across the boundaries. Other approaches often move across since they speeded up the renderer by moving more than the distance to the closest surface. We speeded up the renderer by only making the last step differentiable rather than the entire process differentiable. In this case, we actually get more accurate results.
The direct result of multi-view optimization seems a bit noisy (in rendering image), do you reconstruct the mesh from the SDF field? Please tell me if I missed something. Thanks!
Oh.. We actually don't need to reconstruct the mesh from SDF. It is noisy because some parameter tuning needs to be done. Sorry I forgot to save the parameters for my paper, so I lost the exact parameters I used for generating images in the paper now.
But I changed a little bit now. You can try the current version to see whether it is better now.
There are two kinds of parameters you can change:
- In the line: loss = image_loss[cam] + sdf_loss[cam] + Lp_loss
you can make it weighted.. loss = a * image_loss[cam] + b * sdf_loss[cam] + c * Lp_loss
and try different a, b, c. The surface would be smoother if you increase c. - In the line: voxel_res_list = [8,16,24,32,40,48,56,64]
You can add more intermediate resolutions in the list. It can also produce better results when we have more intermediate resolutions.
from cvpr2020-sdfdiff.
I think I have the same question regarding "ray crosses the surface". The thing is, if some SDF values are not correct during optimization, then there's still a chance for the ray to cross the surface? By "not correct", I meant the voxelized SDF is not a mathematically valid SDF function.
from cvpr2020-sdfdiff.
Related Issues (15)
- batched rendering
- Muybridge Horse
- setup.py [WinError 2] The system cannot find the file specified HOT 3
- Question about derivatives of a given pixel with respect to the SDF grid
- Photographs
- Not able to complete build using setup.py
- Does not compile HOT 1
- About 'main.py' in the 'single_view_code' directory HOT 2
- Questions regarding your paper HOT 1
- How is grid_normal computed? HOT 4
- Questions about your paper HOT 4
- Dataset HOT 3
- Illumination aligned with camera? HOT 1
- paper. HOT 1
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cvpr2020-sdfdiff.