Object masks show up in UE4Editor but not in saved png file about unrealcv

[qiuwch]

Hi, @mtsakaguchi

"The image is blank" do you mean you got a complete white/black image or you did not get an image at all?

If you did not get an image, that might be related to a bug I already fixed. If the image is purely white/black, that is an issue I am not aware of.

Another thing you can try is using the UE4 built-in command shot to take a screenshot.

[mtsakaguchi]

@qiuwch

Thanks for the response.

When I say "the image is blank" I mean that the saved .png file is a complete white image.

I was able to try the shot command that you mentioned and if I switch to /viewmode object_mask and take a screen shot the .png file shows the bicycles as colored objects.

Ideally I would like to create a dataset using a script like the example "generate_images.py" that is provided with unrealcv with /viewmode lit images and /viewmode object_mask images.

[qiuwch]

Hi @mtsakaguchi

To be honest, I have no idea what went wrong. I add a new command vrun in v0.3.0, which enables you to run any UE4 command through UnrealCV. So you can use vrun shot as a workaround.

I know this is far from ideal and I want to know how to fix this issue. But I need more details to figure out what went wrong.

[taniajtaniaj]

Hi @qiuwch ,

first, thanks for your great work!
where can I find the fix for the object_mask image? when i try to dump it, the view mode switches to object_mask but no file is created. for other modes (lit, normal, etc.) everything works fine.

thank you,
Tania

[jason718]

Hi @qiuwch ,

I also met this problem!
When I use 'vget /camera/0/object_mask', I got a white picture. However, I can do 'vset /viewmode object_mask' successfully.

Thanks!

[ayush-agrawal]

I have the same issue as @jason718 and @taniajtaniaj
I get a black picture when I use vget /camera/0/object_mask
Has there been a fix on this yet?

[mkisantal]

Hi!

First, thank you for the great work!

I'm also having issues with object_mask, already on the first tutorial. When I'm running demo.py, everything works fine, except for the object mask image, which is not even created. I dot the following output:

INFO:__init__:205:Got connection confirm: u'connected to RealisticRendering' Image is saved to C:/Users/mate/Documents/rendering_demo/WindowsNoEditor/RealisticRendering/Binaries/Win64/00000001.png normal is saved to C:/Users/mate/Documents/rendering_demo/WindowsNoEditor/RealisticRendering/Binaries/Win64/00000002.png object_mask is saved to C:/Users/mate/Documents/rendering_demo/WindowsNoEditor/RealisticRendering/Binaries/Win64 depth is saved to C:/Users/mate/Documents/rendering_demo/WindowsNoEditor/RealisticRendering/Binaries/Win64/depth.exr

On the other hand, the camera in the game is in object_mask mode, as if vset was used instead of vget.