Coder Social home page Coder Social logo

orestis-z / mask-rcnn-rgbd Goto Github PK

View Code? Open in Web Editor NEW

This project forked from matterport/mask_rcnn

21.0 21.0 5.0 74.86 MB

Extended Mask R-CNN for RGB-D object instance segmentation based on Matterport's implementation. Segmentation accuracy improved by up to 31% using the additional depth input channel.

License: Other

Python 2.42% Jupyter Notebook 97.50% Makefile 0.01% C++ 0.07% Shell 0.01%
compter-vision deep-learning deep-neural-networks instance-segmentation keras tensorflow

mask-rcnn-rgbd's People

Contributors

cpruce avatar dingkunliu avatar elejke avatar gakarak avatar imgyuri avatar jmtatsch avatar jningwei avatar llltttppp avatar np-csu avatar orestis-z avatar orestisz avatar orextron avatar philferriere avatar ps48 avatar waleedka avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

mask-rcnn-rgbd's Issues

weights file

hi,

would it be possible to have a .h5 file uploaded with the weights obtained after training on the NYU dataset? im trying to train an RGB-D model on a small custom dataset and would rather not train a pretrained model on the NYU dataset from scratch, if possible

thanks :)

Training process with input init weight transforming

Thanks to share this code!
I'd like to follow training process.
In my understanding, this code(paper) uses image-net pretrained weight which has 3 channel input structure.
So I planed my training process as follows, roughly pretrained weight manipulate -> scenenet train ->custom data finetune.
Specifically

  1. Load mask-rcnn image net pretrained weight
  2. use module instance_segmentation/sceneNet/train.py with init_with == "rgb_to_rgbd"
    then it results 4-channel input weight.
  3. Train with init_with == "sceneNet"
  4. Train with custom data

So my issue is, Is it right that init_with == "rgb_to_rgbd" part is the weight structure transforming part?
And, nowadays, Imagenet weight which attained model.load_weights(model.get_imagenet_weights(), by_name=True) may not works.

NYU Depth v2 dataset problems

Hello, I'd like to use your code for instance segmentation at NYU Depth v2 dataset. But when I execute generate_np_data.py, the folder named 'data' made and there's no 'names' property at data folder. So I couldn't import this line, "from data.names import names". Could you tell me how to do this? Thank you.

My Error Message is this,

ModuleNotFoundError Traceback (most recent call last)
/tmp/ipykernel_3488/2422544616.py in
1 from instance_segmentation.objects_config import ObjectsConfig
2 from instance_segmentation.objects_dataset import ObjectsDataset, normalize
----> 3 from data.names import names

ModuleNotFoundError: No module named 'data.names'

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.