Comments (3)
same waiting this
from zero123.
Hey @ruoshiliu , Is the transform.json just the blender rotation matrix or is it some camera pose?
from zero123.
Based on my understanding of the format of this json file, the transform_matrix should be the camera extrinsic matrix in the world coordinate system, representing the transformation from the world coordinate system to the camera local coordinate system, rather than the rotation matrix in Blender. Specifically:
-
The matrix is 4x4, which conforms to the size of the camera extrinsic matrix.
-
The first 3 row vectors represent the directions of the three axes in the camera local coordinate system under the world coordinate system.
-
The 4th row represents the position of the origin of the camera local coordinate system under the world coordinate system.
-
Different transform_matrices reflect different camera perspectives.
These are all typical structures and semantics of the camera extrinsic matrix representing camera pose.
- While in Blender, the rotation matrix is usually 3x3, representing only three-dimensional rotation transformations.
So I think it can be determined that the transform_matrix in this json represents the camera extrinsic matrix in the NeRF data format, rather than the rotation matrix in Blender.
If it is as I guess, what puzzles me is that the link "file_path": "./train/r_0" is the same for different camera angles given so far, so how to ensure the 3D reconstruction effect? If they're all the same, what does the change in the value of the transform_matrix in different json files determine? Is it just the size of the object? Or is it something else? It is also very likely that there is something wrong with my understanding. I look forward to getting correction and reply
from zero123.
Related Issues (20)
- Zero123 autoregressive generation
- color mesh structure HOT 1
- The dataset file is too large,about 1.5TB, it's hard to download.
- focal length and principal point of the dataset
- Can export the mesh with texture
- getting some cv2 related error HOT 1
- Cant figure out where to put the model
- sd basemodel HOT 1
- UserWarning: ModelCheckpoint(monitor=’val/loss_simple_ema’) not found in the returned metrics HOT 1
- how to create_carvekit_interface without the online access to huggingface?
- Partial dataset HOT 7
- RuntimeError: DataLoader worker (pid(s) 3360242, 3361527, 3362405) exited unexpectedly HOT 4
- test/benchmark on non-object data
- Can we continue training on the basis of 105000.ckpt? HOT 1
- Run time error `python gradio_new.py` HOT 2
- demo is down
- Partial Objaverse dataset for demo HOT 3
- batch size issue when trianing custom dataset HOT 1
- offline rendering or online rendering
- How to change the view of the input picture
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from zero123.