jfzhang95 / deepgrabcut-pytorch

Deep GrabCut in PyTorch

Hi there, I am a Research Scientist at ByteDance, working on 3D generative models and human avatar generation/animation. I received my PhD from National University of Singapore. During my PhD study, I spent wonderful time at Meta Reality Labs, TikTok and Sea AI Lab.

ByteDance internship/University collaboration: feel free to email me, if you share similar interests in 3D content creation from images, videos and texts, as well as human avatar generation/animation!

deepgrabcut-pytorch's Issues

How to get past drawing stage?

I can draw a box around an object in the demo but then nothing happens.

several questions

Hi,thanks for you provide this project,and several questions make me confused:
1.while training,what is the GT images?The bounding-box annotation images?Or the mask annotation images?Or no GT images?
2.The input images is the bounding-box annotation images,right?where can I get the dataset?
3.In the paper,it said that this method can accomplish semantic/instance segmentation,but this project only can realized object foreground segmentation.Is there any idea you could provide me to realize semantic segmentation?

Sincerely look forward to your reply.

script missing

Dear developers, the folder "models" and its contents (such as the script "download_pretrained_psp_model.sh") are all completely missing. Would you please upload them? Thank you very much!

How to reduce GPU memory consumption

GPU memory consumption is too large, is there any optimization method, is it because the network framework uses resnet101?

RUNTIME eRROR:

I have installed all the dependencies and followed the instruction.But still the pretrained model is not working

[Demo] Wrong set of seedpoint for cv2.floodFill

Hi there,

Thanks for this implementation!
I ran into a small problem running the demo: the cv2.floodFill was throwing errors saying the seedpoint had wrong values. Investigating a bit, I wonder if this section below
https://github.com/jfzhang95/DeepGrabCut-PyTorch/blob/master/demo.py#L97-L100
should not be commented.

Since left, right, up, down are used to put the seedpoint, if you leave this section uncommented (and that your monitor has more than twice the amount of pixels than the displayed image), opencv throws the mentioned error:

cv2.error: OpenCV(3.4.5) /io/opencv/modules/imgproc/src/floodfill.cpp:509: error: (-211:One of arguments' values is out of range) Seed point is outside of image in function 'floodFill'

Commenting the section fixes the error as the seedpoint changes from coordinates of 1000+ pixels down back to image dimensions:

I'm unsure about how others managed to run the demo without commenting it though.

TypeError

while I trying to run the train.py, the followed error occured：
Traceback (most recent call last):
File "/home/wq/Code/DeepGrabCut/train.py", line 147, in
loss = class_balanced_cross_entropy_loss(output, gts, size_average=True, batch_average=True)
File "/home/wq/Code/DeepGrabCut/layers/loss.py", line 45, in class_balanced_cross_entropy_loss
final_loss /= np.prod(label.size())
TypeError: div_() received an invalid combination of arguments - got (numpy.int64), but expected one of:

• (Tensor other)
  didn't match because some of the arguments have invalid types: (!numpy.int64!)
• (float other)
  didn't match because some of the arguments have invalid types: (!numpy.int64!)

could you give me some advice to solve this problem?