dermatologist / nlp-qrmine

Qualitative Research support tools in Python

🔦 QRMine

/ˈkärmīn/

QRMine is a suite of qualitative research (QR) data mining tools in Python using Natural Language Processing (NLP) and Machine Learning (ML). QRMine is work in progress. Read More..

What it does

NLP

• Lists common categories for open coding.
• Create a coding dictionary with categories, properties and dimensions.
• Topic modelling.
• Arrange docs according to topics.
• Compare two documents/interviews.
• Select documents/interviews by sentiment, category or title for further analysis.
• Sentiment analysis

ML

• Accuracy of a neural network model trained using the data
• Confusion matrix from an support vector machine classifier
• K nearest neighbours of a given record
• K-Means clustering
• Principal Component Analysis (PCA)
• Association rules

How to install

pip install qrmine
python -m spacy download en_core_web_sm

Mac users

• Mac users, please install libomp for XGBoost

brew install libomp

How to Use

• input files are transcripts as txt files and a single csv file with numeric data. The output txt file can be specified.

• The coding dictionary, topics and topic assignments can be created from the entire corpus (all documents) using the respective command line options.

• Categories (concepts), summary and sentiment can be viewed for entire corpus or specific titles (documents) specified using the --titles switch. Sentence level sentiment output is possible with the --sentence flag.

• You can filter documents based on sentiment, titles or categories and do further analysis, using --filters or -f

• Many of the ML functions like neural network takes a second argument (-n) . In nnet -n signifies the number of epochs, number of clusters in kmeans, number of factors in pca, and number of neighbours in KNN. KNN also takes the --rec or -r argument to specify the record.

• Variables from csv can be selected using --titles (defaults to all). The first variable will be ignored (index) and the last will be the DV (dependant variable).

Command-line options

qrmine --help

Command	Alternate	Description
--inp	-i	Input file in the text format with Topic
--out	-o	Output file name
--csv		csv file name
--num	-n	N (clusters/epochs etc depending on context)
--rec	-r	Record (based on context)
--titles	-t	Document(s) title(s) to analyze/compare
--codedict		Generate coding dictionary
--topics		Generate topic model
--assign		Assign documents to topics
--cat		List categories of entire corpus or individual docs
--summary		Generate summary for entire corpus or individual docs
--sentiment		Generate sentiment score for entire corpus or individual docs
--nlp		Generate all NLP reports
--sentence		Generate sentence level scores when applicable
--nnet		Display accuracy of a neural network model -n epochs(3)
--svm		Display confusion matrix from an svm classifier
--knn		Display nearest neighbours -n neighbours (3)
--kmeans		Display KMeans clusters -n clusters (3)
--cart		Display Association Rules
--pca		Display PCA -n factors (3)

Use it in your code

from qrmine import Content
from qrmine import Network
from qrmine import Qrmine
from qrmine import ReadData
from qrmine import Sentiment
from qrmine import MLQRMine

• More instructions and a jupyter notebook available here.

Input file format

NLP

Individual documents or interview transcripts in a single text file separated by Topic. Example below

Transcript of the first interview with John.
Any number of lines
<break>First_Interview_John</break>

Text of the second interview with Jane.
More text.
<break>Second_Interview_Jane</break>

....

Multiple files are suported, each having only one break tag at the bottom with the topic. (The tag may be renamed in the future)

ML

A single csv file with the following generic structure.

• Column 1 with identifier. If it is related to a text document as above, include the title.
• Last column has the dependent variable (DV). (NLP algorithms like the topic asignments may provide the DV)
• All independent variables (numerical) in between.

index, obesity, bmi, exercise, income, bp, fbs, has_diabetes
1, 0, 29, 1, 12, 120, 89, 1
2, 1, 32, 0, 9, 140, 92, 0
......

Author

• Bell Eapen (McMaster U) | Contact |

• This software is developed and tested using Compute Canada resources.

• See also: 🔥 The FHIRForm framework for managing healthcare eForms

• See also: 👀 Drishti | An mHealth sense-plan-act framework!

Citation

Please cite QRMine in your publications if it helped your research. Here is an example BibTeX entry (Read paper on arXiv):

@article{eapenbr2019qrmine,
  title={QRMine: A python package for triangulation in Grounded Theory},
  author={Eapen, Bell Raj and Archer, Norm and Sartpi, Kamran},
  journal={arXiv preprint arXiv:2003.13519 },
  year={2020}
}

QRMine is inspired by this work and the associated paper.

Give us a star ⭐️

If you find this project useful, give us a star. It helps others discover the project.

Demo

nlp-qrmine's Issues

Read text files with same tags in multiple sites.

This helps to separate transcripts of different speakers in a focus group for example.

Test auto-comment

Testing auto-comment app

Dependabot couldn't authenticate with https://pypi.python.org/simple/

Dependabot couldn't authenticate with https://pypi.python.org/simple/.

You can provide authentication details in your Dependabot dashboard by clicking into the account menu (in the top right) and selecting 'Config variables'.

View the update logs.

Support for GPT/Chat-GPT based summarization

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
A clear and concise description of what you want to happen.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Topic

--topic keeps repeating same list

Dependabot can't resolve your Python dependency files

Dependabot can't resolve your Python dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

Creating virtualenv qrmine-_Eb2WFYj-py3.8 in /home/dependabot/.cache/pypoetry/virtualenvs
Updating dependencies
Resolving dependencies...

[PackageNotFound]
Package spacy (2.2.3) not found.

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

Test Welcome bot

Testing welcome bot

Support Q&A based on documents

Is your feature request related to a problem? Please describe.
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

Describe the solution you'd like
Use haystack based Q&A.

Describe alternatives you've considered
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

SVM error

Gives the following error: ValueError: Unknown label type: 'unknown'

tox tests fail

There is a (temporary) issue because of Tensorflows dependency on numpy fixed to < 1.20
To prevent errors, install numpy with pip install numpy==1.20.1. Ignore the warnings about incompatibility with TF.
This extra step has to be added to tox.ini. as install_command ?

ValueError: max_df corresponds to fewer documents than min_df

I'm getting this error when I try:

qrmine -i transcript.txt --topics --assign -n 3

Full trace:

QRMine(TM) Qualitative Research Miner. v3.4.0
Using TensorFlow backend.
Traceback (most recent call last):
  File "/Library/Frameworks/Python.framework/Versions/3.7/bin/qrmine", line 8, in <module>
    sys.exit(main_routine())
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/qrmine/main.py", line 381, in main_routine
    cli()  # run the main function
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/click/core.py", line 764, in __call__
    return self.main(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/click/core.py", line 717, in main
    rv = self.invoke(ctx)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/click/core.py", line 956, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/click/core.py", line 555, in invoke
    return callback(*args, **kwargs)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/qrmine/main.py", line 75, in cli
    generate_topics(data, assign, num)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/qrmine/main.py", line 182, in generate_topics
    q.process_content()
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/qrmine/nlp_qrmine.py", line 164, in process_content
    self.load_matrix()
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/qrmine/nlp_qrmine.py", line 195, in load_matrix
    for documents in self._corpus.docs))
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/textacy/vsm/vectorizers.py", line 431, in fit_transform
    doc_term_matrix = self._fit(tokenized_docs)
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/textacy/vsm/vectorizers.py", line 492, in _fit
    doc_term_matrix, vocabulary_terms
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/textacy/vsm/vectorizers.py", line 592, in _filter_terms
    max_n_terms=self.max_n_terms,
  File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/textacy/vsm/matrix_utils.py", line 246, in filter_terms_by_df
    raise ValueError("max_df corresponds to fewer documents than min_df")
ValueError: max_df corresponds to fewer documents than min_df

pip install does not work because of deprecated services.

I get a build error when trying to build spacy from the pip install qrmine. When I install it with pip myself I get an error ModuleNotFoundError: No module named 'textacy.vsm and this is because textacy uses a different layout now. after that I couldn't be bothered anymore to try and get this working.

      creating build/temp.macosx-12-x86_64-cpython-310
      creating build/temp.macosx-12-x86_64-cpython-310/spacy
      clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-install-5eqam2ky/spacy_379d909711584d72adfa87296af81397/include -I/Users/joytimmermans/jtest/simone-coding/.venv/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c spacy/parts_of_speech.cpp -o build/temp.macosx-12-x86_64-cpython-310/spacy/parts_of_speech.o -O2 -Wno-strict-prototypes -Wno-unused-function
      clang++ -bundle -undefined dynamic_lookup -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk build/temp.macosx-12-x86_64-cpython-310/spacy/parts_of_speech.o -o build/lib.macosx-12-x86_64-cpython-310/spacy/parts_of_speech.cpython-310-darwin.so -Wl,-rpath,@loader_path/../spacy/platform/darwin/lib
      building 'spacy.strings' extension
      clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-install-5eqam2ky/spacy_379d909711584d72adfa87296af81397/include -I/Users/joytimmermans/jtest/simone-coding/.venv/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c spacy/strings.cpp -o build/temp.macosx-12-x86_64-cpython-310/spacy/strings.o -O2 -Wno-strict-prototypes -Wno-unused-function
      spacy/strings.cpp:4287:29: warning: comparison of integers of different signs: '__pyx_t_5spacy_8typedefs_hash_t' (aka 'unsigned long long') and 'Py_ssize_t' (aka 'long') [-Wsign-compare]
        __pyx_t_1 = ((__pyx_v_key < __pyx_t_6) != 0);
                      ~~~~~~~~~~~ ^ ~~~~~~~~~
      spacy/strings.cpp:4450:33: warning: comparison of integers of different signs: 'int' and 'std::vector<__pyx_t_5spacy_8typedefs_hash_t>::size_type' (aka 'unsigned long') [-Wsign-compare]
        for (__pyx_t_3 = 0; __pyx_t_3 < __pyx_t_2; __pyx_t_3+=1) {
                            ~~~~~~~~~ ^ ~~~~~~~~~
      2 warnings generated.
      clang++ -bundle -undefined dynamic_lookup -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk build/temp.macosx-12-x86_64-cpython-310/spacy/strings.o -o build/lib.macosx-12-x86_64-cpython-310/spacy/strings.cpython-310-darwin.so -Wl,-rpath,@loader_path/../spacy/platform/darwin/lib
      building 'spacy.lexeme' extension
      clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-install-5eqam2ky/spacy_379d909711584d72adfa87296af81397/include -I/Users/joytimmermans/jtest/simone-coding/.venv/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c spacy/lexeme.cpp -o build/temp.macosx-12-x86_64-cpython-310/spacy/lexeme.o -O2 -Wno-strict-prototypes -Wno-unused-function
      In file included from spacy/lexeme.cpp:645:
      In file included from /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/arrayobject.h:5:
      In file included from /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/ndarrayobject.h:12:
      In file included from /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/ndarraytypes.h:1948:
      /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: "Using deprecated NumPy API, disable it with "          "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-W#warnings]
      #warning "Using deprecated NumPy API, disable it with " \
       ^
      1 warning generated.
      clang++ -bundle -undefined dynamic_lookup -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk build/temp.macosx-12-x86_64-cpython-310/spacy/lexeme.o -o build/lib.macosx-12-x86_64-cpython-310/spacy/lexeme.cpython-310-darwin.so -Wl,-rpath,@loader_path/../spacy/platform/darwin/lib
      building 'spacy.vocab' extension
      clang -Wno-unused-result -Wsign-compare -Wunreachable-code -fno-common -dynamic -DNDEBUG -g -fwrapv -O3 -Wall -isysroot /Library/Developer/CommandLineTools/SDKs/MacOSX12.sdk -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -I/private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-install-5eqam2ky/spacy_379d909711584d72adfa87296af81397/include -I/Users/joytimmermans/jtest/simone-coding/.venv/include -I/usr/local/opt/[email protected]/Frameworks/Python.framework/Versions/3.10/include/python3.10 -c spacy/vocab.cpp -o build/temp.macosx-12-x86_64-cpython-310/spacy/vocab.o -O2 -Wno-strict-prototypes -Wno-unused-function
      In file included from spacy/vocab.cpp:645:
      In file included from /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/arrayobject.h:5:
      In file included from /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/ndarrayobject.h:12:
      In file included from /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/ndarraytypes.h:1948:
      /private/var/folders/pz/tgfdn7qx0ss8z2gw1kkkthrr0000gn/T/pip-build-env-h55d6azv/overlay/lib/python3.10/site-packages/numpy/core/include/numpy/npy_1_7_deprecated_api.h:17:2: warning: "Using deprecated NumPy API, disable it with "          "#define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION" [-W#warnings]
      #warning "Using deprecated NumPy API, disable it with " \
       ^
      spacy/vocab.cpp:3006:15: error: no member named 'use_tracing' in '_ts'
            tstate->use_tracing = 0;
            ~~~~~~  ^
      spacy/vocab.cpp:3012:15: error: no member named 'use_tracing' in '_ts'
            tstate->use_tracing = 1;
            ~~~~~~  ^
      spacy/vocab.cpp:4936:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__init__", __pyx_f[0], 35, 0, __PYX_ERR(0, 35, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2957:32: note: expanded from macro '__Pyx_TraceCall'
                if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                             ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:4936:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__init__", __pyx_f[0], 35, 0, __PYX_ERR(0, 35, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2966:28: note: expanded from macro '__Pyx_TraceCall'
            if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                         ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5512:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(Py_None, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3024:27: note: expanded from macro '__Pyx_TraceReturn'
                    if (tstate->use_tracing) {\
                        ~~~~~~  ^
      spacy/vocab.cpp:5512:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(Py_None, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3031:23: note: expanded from macro '__Pyx_TraceReturn'
                if (tstate->use_tracing) {\
                    ~~~~~~  ^
      spacy/vocab.cpp:5554:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__get__", __pyx_f[0], 78, 0, __PYX_ERR(0, 78, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2957:32: note: expanded from macro '__Pyx_TraceCall'
                if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                             ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5554:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__get__", __pyx_f[0], 78, 0, __PYX_ERR(0, 78, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2966:28: note: expanded from macro '__Pyx_TraceCall'
            if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                         ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5702:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(__pyx_r, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3024:27: note: expanded from macro '__Pyx_TraceReturn'
                    if (tstate->use_tracing) {\
                        ~~~~~~  ^
      spacy/vocab.cpp:5702:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(__pyx_r, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3031:23: note: expanded from macro '__Pyx_TraceReturn'
                if (tstate->use_tracing) {\
                    ~~~~~~  ^
      spacy/vocab.cpp:5743:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__get__", __pyx_f[0], 89, 0, __PYX_ERR(0, 89, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2957:32: note: expanded from macro '__Pyx_TraceCall'
                if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                             ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5743:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__get__", __pyx_f[0], 89, 0, __PYX_ERR(0, 89, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2966:28: note: expanded from macro '__Pyx_TraceCall'
            if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                         ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5875:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(__pyx_r, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3024:27: note: expanded from macro '__Pyx_TraceReturn'
                    if (tstate->use_tracing) {\
                        ~~~~~~  ^
      spacy/vocab.cpp:5875:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(__pyx_r, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3031:23: note: expanded from macro '__Pyx_TraceReturn'
                if (tstate->use_tracing) {\
                    ~~~~~~  ^
      spacy/vocab.cpp:5913:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__len__", __pyx_f[0], 95, 0, __PYX_ERR(0, 95, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2957:32: note: expanded from macro '__Pyx_TraceCall'
                if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                             ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5913:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("__len__", __pyx_f[0], 95, 0, __PYX_ERR(0, 95, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2966:28: note: expanded from macro '__Pyx_TraceCall'
            if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                         ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      spacy/vocab.cpp:5938:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(Py_None, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3024:27: note: expanded from macro '__Pyx_TraceReturn'
                    if (tstate->use_tracing) {\
                        ~~~~~~  ^
      spacy/vocab.cpp:5938:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceReturn(Py_None, 0);
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:3031:23: note: expanded from macro '__Pyx_TraceReturn'
                if (tstate->use_tracing) {\
                    ~~~~~~  ^
      spacy/vocab.cpp:6047:3: error: no member named 'use_tracing' in '_ts'
        __Pyx_TraceCall("add_flag", __pyx_f[0], 102, 0, __PYX_ERR(0, 102, __pyx_L1_error));
        ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
      spacy/vocab.cpp:2957:32: note: expanded from macro '__Pyx_TraceCall'
                if (unlikely(tstate->use_tracing) && !tstate->tracing &&\
                             ~~~~~~  ^
      spacy/vocab.cpp:843:43: note: expanded from macro 'unlikely'
        #define unlikely(x) __builtin_expect(!!(x), 0)
                                                ^
      fatal error: too many errors emitted, stopping now [-ferror-limit=]
      1 warning and 20 errors generated.
      error: command '/usr/bin/clang' failed with exit code 1
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.
  ERROR: Failed building wheel for spacy
Failed to build spacy
ERROR: Could not build wheels for spacy, which is required to install pyproject.toml-based projects

data.read_file doesn’t work

---

UnicodeDecodeError Traceback (most recent call last)
in
2 data = ReadData()
3 inp_file = ["Example.txt"]
----> 4 data.read_file(inp_file)

~/XZY/XZD/XZS/XZA/XZW/XZYF/XZK/qrmine/readfiles.py in read_file(self, file_names)
54 file_name = file_names[0]
55 with open(file_name, 'r') as f:
---> 56 read_from_file = f.read()
57 self._content = re.sub('<[^<]+?>', '', read_from_file)
58 self._documents = re.split('.*?', read_from_file)

~XZD/XZS/XZA/XZW/XZYF/XZK/codecs.py in decode(self, input, final)
320 # decode input (taking the buffer into account)
321 data = self.buffer + input
--> 322 (result, consumed) = self._buffer_decode(data, self.errors, final)
323 # keep undecoded input until the next call
324 self.buffer = data[consumed:]

UnicodeDecodeError: 'utf-8' codec can't decode byte 0xd2 in position 19: invalid continuation byte

Dependabot can't resolve your Python dependency files

Dependabot can't resolve your Python dependency files.

As a result, Dependabot couldn't update your dependencies.

The error Dependabot encountered was:

Creating virtualenv qrmine-K-COo7Jl-py3.8 in /home/dependabot/.cache/pypoetry/virtualenvs
Updating dependencies
Resolving dependencies...

[PackageNotFound]
Package cython (0.29.21) not found.

If you think the above is an error on Dependabot's side please don't hesitate to get in touch - we'll do whatever we can to fix it.

View the update logs.

installation package ERROR

version: Python3.8
It does not install the package.

The error I get is the following:

Attempting uninstall: scikit-learn
Found existing installation: scikit-learn 0.23.2
Uninstalling scikit-learn-0.23.2:
Successfully uninstalled scikit-learn-0.23.2
Running setup.py install for scikit-learn ... error
ERROR: Command errored out with exit status 1:

I have tried both on Mac and Windows, the error I get is the same

Thank you for helping!