Fail to open capture device (Linux and macOS builds are not compiled with FFmpeg) about opencv-python

[skvark]

I might have figured out a way to include FFmpeg support to the Linux (and maybe MacOS too) builds without actually shipping the library itself within the package. This will of course require a proof of concept first, but this is roughly the idea:

1. Find somewhere a fresh dev build of FFmpeg for Cent OS 5 or compile it manually
2. Compile OpenCV against it
3. Patch the resulting binary with PatchELF which comes pre-installed in the manylinux containers
- this means that any needed link time dependencies (DT_NEEDED) related to FFmpeg will be removed
4. Users can install the opencv-python as before and it will import without any issues, BUT:
- video I/O is maybe (I have to look at this, not sure about the dynamic linker stuff) supported given that FFmpeg has been separately installed in the system and it is API/ABI compatible with the one that OpenCV was compiled against
- trying to use video related functions without FFmpeg will most likely result in undefined symbol / some other error and terminate the program

EDIT: I have been thinking about this and the solution above does not probably work correctly. However, the same logic could be applied to __init__.py if import fails -> remove DT_NEEDED (with python) entries from the binary and try again.

EDIT2: Forget all of the above. We will ship LGPL FFmpeg with the packages like in the Windows wheels. Work in progress.

It will take some time to test this, so do not except video support any time soon. I haven't forgotten this or the other issues :)

[cachitas]

The Linux wheel built this way is useless to me then. A shame, for this could be an easy way to get OpenCV rolling in my environments. I have gstreamer also installed but it looks like it is of no help.

The lack of ffmpeg codecs could be the reason why I can not read my videos, but what about the camera? Any hints on how I can work through this?

Anyone using this on Linux with success? Can anyone cv2.VideoCapture(0) even without ffmpeg enabled?

[skvark]

FFmpeg will be supported in the next release. I will try to enable V4L2 also.

[skvark]

Some of the V4L/V4L2 headers were missing on those Cent OS 5 containers. I ended up adding them there manually since anything else didn't seem to work. OpenCV detects now both of them and builds fine. Can't really test if webcams work in reality since I don't have actual HW for testing but I guess we will see at some point.

[skvark]

I'm waiting for pull request for macOS support, see #49. For Linux builds FFmpeg will be added hopefully during this year.

[espadolini]

How is V4L2 (using VideoCapture with webcams) related to FFmpeg in any way? The two are orthogonal (except maybe to support h264 webcams, which are somewhat rare anyway).

Is there a problem building with V4L2 support with the manylinux setup?

[skvark]

The Linux builds have been built without ffmpeg. I can enable it (and I'm looking into #6), but there remains the GPL/LGPL licensing issue. Statically linking the ffmpeg to the cv2.so is a no go (I don't know if this is even possible). Shipping the shared ffmpeg lib with the package might be possible. Another solution is to build the package with ffmpeg support and then users manually install ffmpeg on their systems.

[cancan101]

Using the wheels built here, I cannot get capture devices to work on either OS X or Linux (Ubuntu).

[cancan101]

It looks like windows support was added: #15

[skvark]

Haven't found yet enough time to enable ffmpeg on Linux/OS X. Yes, Windows support was a lot easier to add than for example Linux because precompiled ffmpeg shared libs are provided within OpenCV.

[cancan101]

https://github.com/opencv/opencv/tree/master/3rdparty/ffmpeg talks about various options around ffmpeg, etc and dealing with licenses. It seems that at least on OS X, oepncv should link against AVFoundation.

It might also be worth looking at how brew builds opencv3: https://github.com/Homebrew/homebrew-science/blob/master/opencv3.rb

[cancan101]

There is also some flag: WITH_AVFOUNDATION.

[arthurbarros]

@skvark is it in progress? are there any rc with it already? Thanks m8

[skvark]

I haven't tried, but I hope it works. I'm just trying to provide consistent and comprehensive packages across different platforms given that Windows builds already use FFmpeg for video I/O and macOS builds will have FFmpeg support hopefully soon.

[skvark]

Closing in favor of #50 and #56.

[fabito]

As @kerio92 mentioned. We could have webcam video capture enabled without FFMPEG.
Its a totally separate flag and dependency to enable V4L2 support in OpenCV.

[fabito]

Once it's released I can help testing it.