The decontextualizer from paulbricman

paulbricman / decontextualizer Goto Github PK

View Code? Open in Web Editor NEW

A pipeline for making highlighted text stand-alone.

License: Mozilla Public License 2.0

Python 97.88% Dockerfile 2.12%

decontextualizer's People

Contributors

Stargazers

Watchers

decontextualizer's Issues

Consider leveraging the state of the art

Everything's in the title :)
https://paperswithcode.com/sota/coreference-resolution-on-ontonotes

PDF Failures

Hello!

I attempted two different PDFs (which I can share in a DM or a email) — one was an older-pre computer PDF that had been OCRed professionally and hilighted. Another was a modern PDF, of a book published last year, also highlighted. Zotero was able to extract from both using pdfjs. When i use https://huggingface.co/spaces/paulbricman/decontextualizer i get:

File "/home/user/.local/lib/python3.8/site-packages/streamlit/script_runner.py", line 354, in _run_script
    exec(code, module.__dict__)
File "/home/user/app/main.py", line 17, in <module>
    components.add_section()
File "/home/user/app/components.py", line 46, in add_section
    excerpts = pdf_to_excerpts(filename)
File "/home/user/app/processing.py", line 48, in pdf_to_excerpts
    excerpt = extract_annot(annot, words)
File "/home/user/app/processing.py", line 24, in extract_annot
    quad_count = int(len(quad_points) / 4)

Recommend Projects