Coder Social home page Coder Social logo

jd730 / eopsn Goto Github PK

View Code? Open in Web Editor NEW
52.0 2.0 7.0 4.17 MB

[CVPR 2021] Exemplar-Based Open-Set Panoptic Segmentation Network (EOPSN)

License: Other

Python 91.20% Shell 0.48% C++ 3.56% Cuda 4.66% Dockerfile 0.07% Makefile 0.02%
exemplar open-set panoptic-segmentation

eopsn's Issues

train problems

How to solve the problem of insufficient video memory? Thanks!

About the pre-trained model.

Hi @jd730, thanks for sharing your wonderful work.
In the README, you said the training requires "void-suppression" pre-trained model. However, I find that in the config file, you still use the standard pre-trained model here.
If I want to train your EOPSN, which pre-trained model should I use?
Thx.

Adoption to cityscapes

Hi,
thanks for providing the code to your method. I am interested in trying this out on another dataset, namely cityscapes. I already know that I would have to adapt the dataloading to cityscapes, what I am still unsure about is which pretrained model I would need.

In this issue you mention that training needs a model pretrained with void-supression, the weights of which you provide. How would I go about pretraining such a model on cityscapes? Is there code in this repository for pretraining on COCO, which I could adapt to cityscapes?

test problems

请问是否有训练好的模型能直接让我们跑测试?

Problems of reproducing the results of EOPSN

Hi,

Thanks for the interesting paper and open-sourced code.

Recently, I ran the EOPSN method on K20 setting folllowing the given guideline (w/o any editing) and I found the results of unknown things are quite different from the reported one.

Unk PQ SQ RQ
EOPSN reported 11.3 73.8 15.3
EOPSN reproduced 15.6 79.2 19.6

From the table, it seems that the released code achieves a much better improvement than the reported one. However, when I further inspect the predictions of class-wise unkown things, it seems that EOPSN's unkown recognition is dominated by the "car" class and other unkown classes are rarely detected. Moreover, the reproduced results may not support the visualization results in Fig5 since several unkown classes are shown to be detected, e.g., stop sign, keyboard, banana, and toilet. So, could you please release the EOPSN checkpoint which supports the reported results? Thanks a lot.

image

BTW, I found that the training of EOPSN requires the pre-trained model of Void-Suppression, but the current released codebase only contains the void-train method. I wonder could you please release the void-suppression code for better reproduction? Thanks again.

FYI, the predictions of class-wise unkown things on Void-Suppression method are as follows and the results are identical to the reported ones in the paper
image

Infinity losses during training

When running the training, I noticed that sometimes some losses (especially the box regression loss) can become Infinity. This seems to happen especially once many exemplars have been mined. I was wondering if you encountered this issue as well, and if you know of any fixes.

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.