MacOS support? about japanesetokenizers

[Kensuke-Mitsuzawa]

@rpryzant thanks for your report and sorry to be late for my reply. I did not run this script in MacOS. But, I think, it does not run on MacOS because MacOS does not have ldconfig command. All issues in your issue are rooted from here.

Resasons

install_tokenizers.sh: line 89: ldconfig: command not found

This line shows ldconfig command does not run on MacOS, and failed to install mecab on your MacOS.

subprocess.CalledProcessError: Command 'Failed to initialize Mecab object' returned non-zero exit status -1

This line shows that python failed to install the package because mecab is not installed yet on your MacOS.

Solution

You have to make & install mecab(and other tokenizers if you want) manually.

As I mention here, you can make install mecab manually. please try it.

By the way

your mac does not have unxz command.

[install-mecab-ipadic-NEologd] : unxz is not found.
make: *** [install_neologd] Error 1

You can install it with brew. Try this command.

$ brew install xz

[rpryzant]

Sorry for my late response as well. Thank you!! Your advice helped me fix my problem.