How wo get the groundtruth point cloud with normal vector from ShapeNet dataset? about pixel2mesh

[nywang16]

@tangjilin see data_generation folder

[happyday521]

@nywang16 Thanks very much！

[KnightOfTheMoonlight]

Hi, @nywang16 After checking the https://github.com/nywang16/Pixel2Mesh/blob/master/GenerateData/4_make_auxiliary_dat_file.ipynb. I have the following confusions about the data generation part.

About the original data from shapenetcore.v1, are they all resized to be put in a unit cube, which are of size (-0.5,0.5)^3? And why would you choose ellipsoid with a size of (0.2,0.2,0.4) radius?

And you use your rendering_metacamera.txt annotations to transform 3d object to camera coordinates?

[walsvid]

Hi @KnightOfTheMoonlight , our method is not sensitive to initial shape, you can also use sphere. The reason for using the ellipsoid as the initial may be that the average shape of the object is closer to the ellipsoid.

[EdwardSmith1884]

It is kind of sensitive though right? You want the initial mesh's vertices to project "nicely" over the input image so that the sampled image features which are placed on those vertices properly capture the information in the image. If the range of vertices when projected into images space is too small in either direction information about the object will be lost, and similarly if the range is too large. I would think any shape with uniformly distributed vertices in the range of (-0.5,0.5)^3 would be fine.

[walsvid]

Hi, @EdwardSmith1884 . I don't think the initial shape is very sensitive. According to the performance of graph convolution during training, no matter what the initial shape is, it seems that graph convolution tends to learn the shape completely from scratch. The shape of the three-dimensional mesh output by the first few epochs and initial mesh are basically irrelevant, but is mainly affected by topology.
At the same time, I also agree that what you said may be a more natural approach to uniform sampling in three dimensions.

Specifically, our experiments in the ECCV supp are as follows.

[EdwardSmith1884]

I think these all do well because they basically have uniformly distributed vertices in the range of (-0.5,0.5)^3 . I would think if the ellipsoid was very thin in one dimension, or the sphere was 1/10 the scale it would do worse. I guess I mean shape doesn't really matter but scale does, at least I observed worse much worse accuracy when I didn't scale the initial mesh properly.

[zshyang]

Hi,
Do you know how to download the dataset and unzip it from the link below?
https://drive.google.com/open?id=131dH36qXCabym1JjSmEpSQZg4dmZVQid