How to install on Mac CPU about pytorch-correlation-extension

[ClementPinard]

Hello,

this error does not seem related to this project but rather how to link openmp to a compiler in mac.
I found this issue, that you may find of interest : microsoft/LightGBM#3

My first guess would be to try to change the setup.py at line 26 so that the extra_compile_arg['cxx'] is -openmprather than-fopenmp` .

[kkew3]

Thanks for your reply. I changed -fopenmp to -openmp. Now there are two more errors:

clang: error: no such file or directory: 'build/temp.macosx-10.9-x86_64-3.6/Correlation_Module/correlation.o'
clang: error: no such file or directory: 'build/temp.macosx-10.9-x86_64-3.6/Correlation_Module/correlation_sampler.o'
error: command 'clang++' failed with exit status 1

I found the two underlying cpp files under Correlation_Module. How should I get them compiled?

Thanks!

[ClementPinard]

seems like some interferences with you previous attempt at building. I'd say completely remove the build folder and and start over.

[kkew3]

Thanks for your reply. No it reoccurs even after rebuilding. Here's the whole stdout and stderr (attached build.out.txt). Thanks!

build.out.txt

[kkew3]

I solved the issue by changing back -openmp to -fopenmp and installed /Library/Developer/CommandLineTools/Packages/macOS_SDK_headers_for_macOS_10.14.pkg (as per this answer).

However, when I run python grad_check.py cpu, it gives another error:

Traceback (most recent call last):
  File "check.py", line 8, in <module>
    from spatial_correlation_sampler import SpatialCorrelationSampler
  File "$VIRTUAL_ENV/lib/python3.6/site-packages/spatial_correlation_sampler-0.1.0-py3.6-macosx-10.9-x86_64.egg/spatial_correlation_sampler/__init__.py", line 1, in <module>
    from .spatial_correlation_sampler import SpatialCorrelationSampler, SpatialCorrelationSamplerFunction, spatial_correlation_sample
  File "$VIRTUAL_ENV/lib/python3.6/site-packages/spatial_correlation_sampler-0.1.0-py3.6-macosx-10.9-x86_64.egg/spatial_correlation_sampler/spatial_correlation_sampler.py", line 6, in <module>
    import spatial_correlation_sampler_backend as correlation
ImportError: dlopen($VIRTUAL_ENV/lib/python3.6/site-packages/spatial_correlation_sampler-0.1.0-py3.6-macosx-10.9-x86_64.egg/spatial_correlation_sampler_backend.cpython-36m-darwin.so, 2): Symbol not found: __Z24correlation_cuda_forwardN2at6TensorES0_iiiiiiiiii
  Referenced from: $VIRTUAL_ENV/lib/python3.6/site-packages/spatial_correlation_sampler-0.1.0-py3.6-macosx-10.9-x86_64.egg/spatial_correlation_sampler_backend.cpython-36m-darwin.so
  Expected in: flat namespace
 in $VIRTUAL_ENV/lib/python3.6/site-packages/spatial_correlation_sampler-0.1.0-py3.6-macosx-10.9-x86_64.egg/spatial_correlation_sampler_backend.cpython-36m-darwin.so

It seems that somehow the cpp file still needs certain cuda component. How to solve it? Thanks for any suggestions!

[ClementPinard]

I just pushed changes, you can get the last version (tagged 0.2.0) and try to install with setup_cpu.py instead of setup.py

[kkew3]

Thank you so much!