Coder Social home page Coder Social logo

cg-py / geocode Goto Github PK

View Code? Open in Web Editor NEW
371.0 371.0 25.0 54.84 MB

GeoCode maps 3D shapes to a human-interpretable parameter space, allowing to intuitively edit the recovered 3D shapes from a point cloud or sketch input.

Python 99.80% Shell 0.20%
3d computer-graphics deep-learning mesh-generation point-cloud pytorch sketch

geocode's People

Contributors

eltociear avatar itailang avatar ofekp avatar ranahanocka avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

geocode's Issues

Demo video

Hello. Thanks for your work, it is a great resource and I'm exploring ways to use it atm.

This is not directly related to GeoCode, but how did you render the demo video?
I loved the morphing effects between shapes and the different effects but I have 0 clue how you did it (does Blender support morphing animations?)

Thanks in advance 👯‍♂️

question about how to do shape mixing and

hello, thanks for sharing, I am very interested in your work, but I know very little about blender geometry node.I hope these are not dull questions

  1. I'd like to know how to use the code to generate a new blend field that can be edited with human-interpretable parameters in the blender.
  2. Also, I'd would like know if shape mixing is possible in blender or if a new code is required to achieve this goal.

I hope to get your reply^-^

How to change the possible values of a parameter?

I'm not very familiar with the geometry nodes of blender. If I want to change the minimum number of cross rails (cr_count) from 3 to 2, how can I do that? Could you please give me some instructions?

Generating Data for a New Category (like beds)

Hi,

Thanks for sharing GeoCode!

I want to learn a parametric representation of a new category (like bed frames). My understanding of the steps to follow are -
a. Decide on the parameters and create a geometry node in blender with it.
b. Use this blender file to generate objs and sketches with the given dataset_generator.py and sketch_generator.py
c. Train the model using this data.

I wanted to clarify if -

  1. The above workflow is correct, and
  2. If we have to manually create the geometry nodes each time we want to do it for a new category (or do you have any suggestions here?)

Thanks,
Abbhinav

Are camera angles used by the model?

Hi,

I wonder if the angle information is used in the process, either passed to the network directly or in some other ways.

I notice there's performance loss when the model gets sketches of unseen angles, and I see that the custom DatasetSketch class returns the camera angle of current sketch file, but the wrapper around it are from standard library (DataLoader and lightning trainer). Not sure if this angle information is maintained along the way or dropped after checking that there are enough files of correct angles as specified by the recipe.yml file.

Thanks!

Questions about the blend file

Hi,
Thanks for sharing GeoCode!

I have a question about the blend file:
I see that the blend_file ~/blends/procedural_chair.blend in the input of test command is downloaded from download_ds.py, but the training results don't seem to have this file. Maybe something I misses during the training, but I have no clue. Because I want to know how the procedural program works, and I think the final result of the program is the blend file (hope I understand correctly) , but I have no idea how it comes from.

Sorry to bother you, looking forward to your reply. Thanks again T^T

working with real-world images and complex backgrounds

Hi,

I'm looking at training and testing GeoCode from real world images with complex backgrounds.

  1. Do you have any suggestions on how I should go about creating the ground truth for this? What all modalities do I need to train this model?
  2. For testing the your existing model (say for chairs) from real world images, I presume I have to convert the image to sketches. What do you recommend for this? Do I need anything else apart from sketches to perform this step?

Thanks in advance!

Regards,
Abbhinav

Is this a bug in procedural_table.blend?

Hi, thanks for your interesting work! I'm trying to use your blend files to generate shapes with blender. However, I found that the table_top_scale_x and table_top_scale_y parameters in "procedural_table.blend" would influence the height of the table. For example, if I change both table_top_scale_x and table_top_scale_y from 2.6 to 2.0, the height of the table would get shorter significantly. In my understanding, the table_top_scale_x and table_top_scale_y parameters should control the width and length of the table along the x-axis and y-axis respectively, without influencing the height. So is this a bug in the table's blend file?

How are Geometry nodes generated?

The concept of GeoCode is great!

Is the Geometry nodes in the chair blender file generated by algorithm training or manually edited?

If there is a more convenient way to make secondary adjustments to the generated blender file, the generated Geometry nodes are a bit messy now.

Thank you.
image

Error: File format is not supported

Hi, GeoCode is an amazing work for shape generation, congrats!
But I meet an error of "Error: File format is not supported in file 'dataset_generator/dataset_generator.py'" when I execute the command.
~/Blender/blender-3.2.0-linux-x64/blender ./blends/procedural_chair.blend -b dataset_generator/dataset_generator.py -- --dataset-dir ./datasets/MyChairDataset --phases test
What should I do if I have an external chair dataset? I want to try using the pre-trained model for my new chair dataset. The file format in this new dataset is the ‘.obj’ format (or '.png' format for specific views).
Looking forward to your help. A late Happy New Year!

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.