Coder Social home page Coder Social logo

wanquanf / rma-net Goto Github PK

View Code? Open in Web Editor NEW
206.0 206.0 57.0 1.04 MB

【Code of CVPR2021 paper】Recurrent Multi-view Alignment Network for Unsupervised Surface Registration (CVPR 2021)

Python 75.10% Shell 0.27% C 0.42% C++ 15.61% Cuda 8.36% CMake 0.24%

rma-net's People

Contributors

rainbowrui avatar wanquanf avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

rma-net's Issues

Problems downloading the pretrained models

Hi,

Are there plans to have the pre-trained models available outside Baidu. It looks like currently it requires creating an account on the system in order to download the models. Creating the account though is not straightforward.

Thank you,

Deformation problem

Thanks for your excellent work!

I had some problems when I tried to test RMA-Net on my own data (synthetic data generated from the SMPL model). I have checked my input data (source & target) were stay in a similar coordinate system but different size as your sample data. My result didn't look as good as you show. I have tried to use your sample data, and the results were all perfect. How should I do to get a better result? or if your method has some limitations (maybe it is not suitable for arbitrary body registration)?
1
(The red point cloud is the source, the blue one is the target and the green one is the result from RMA-Net)
2
(The yellow one is my data and another one is your sample data. I am not sure if they are in the same coordinate system but they look similar. )

About the number of point cloud

Your article states that the number of two point clouds is different,but i found when input data,the target point cloud number and the source point cloud number are same. Can the code handle tasks with inconsistent number of point clouds?
Thanks!

Deformation

When testing on a custom dataset I am getting a deformed result. The source should ideally align itself to the target and take the shape of the target too right?

My data consists of a simulated point cloud of an object (as source) and a point cloud generated from a real image of the same object (as target). This results in a deformed output that is also not aligned perfectly.
Is there any explanation for this?
Can you suggest a modification to solve the issue?

toy_dataset

Dear author,

When may the toy dataset be released?

Thanks

The earth_mover_distance

How to calculate the earth_mover_distance(EMD) between two point clouds? Can you send me a copy?
from emd import earth_mover_distance

Should I do any preprocess before deformation?

Thanks for your excellent work and nice code!

I have downloaded the code and checkpoint, and tested it one the samples you gave. I got very good results, then I hoped to test my own files.

I used the SMPL model to generate two poses of the same 'person' (they were set in the same coordinate system), and tested it with the model you trained, but the results were very strange. What prerequisites does this method have for the input data? Should I do any preprocess before deformation?

Screenshot from 2021-10-13 19-42-57

Unpickling Error

Using Python3.8, PyTorch 1.6 and Cuda 10.2, as specified in the repository. While running the sample registration using pretrained weights provided in the link attached to the repository I encountered the following error :

`Traceback (most recent call last):
  File "inference.py", line 72, in <module>
    rma_net.load_state_dict(torch.load(args.weight),True)
  File "/home/gridraster/anaconda3/envs/rmanet/lib/python3.8/site-packages/torch/serialization.py", line 585, in load
    return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
  File "/home/gridraster/anaconda3/envs/rmanet/lib/python3.8/site-packages/torch/serialization.py", line 755, in _legacy_load
    magic_number = pickle_module.load(f, **pickle_load_args)
_pickle.UnpicklingError: A load persistent id instruction was encountered,
but no persistent_load function was specified.

Can you help me fix this issue?
What is the pickle version used in the repository while pickling the pretrained weights?

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.