Coder Social home page Coder Social logo

talk2arxiv-server's Introduction

talk2arxiv-server

Talk to any ArXiv paper using ChatGPT!

Talk2arxiv is an innovative open-source implementation of a standard RAG (Retrieval-Augmented Generation) system, designed to facilitate interactive conversations with academic papers.

Usage

Simply prepend any arxiv.org link with 'talk2' to load the paper into a responsive RAG chat application (e.g. www.arxiv.org/pdf/1706.03762.pdf -> www.talk2arxiv.org/pdf/1706.03762.pdf)

Installation

This server is intended to be run on a Linux (specifically Amazon Linux 2 on EC2)

usermod -aG wheel root
git clone https://github.com/evanhu1/talk2arxiv-server
cd talk2arxiv-server/
python3 -m pip install --user pipx
echo export PATH=$PATH:/root/.local/bin >> ~/.bashrc
source ~/.bashrc
pipx install poetry
poetry install
poetry run python -m spacy download en_core_web_sm
poetry run gunicorn app:app -b 0.0.0.0:3001

You must also create a .env with the following defined:

COHERE_API_KEY=""
QDRANT_API_KEY=""
OPENAI_API_KEY="

Features

  • PDF Parsing: Utilizes GROBID for efficient text extraction from PDFs.
  • Chunking Algorithm: Custom-built algorithm for optimal text chunking.
  • Text Embedding: Implements Cohere's EmbedV3 model for accurate text embeddings.
  • Vector Database Integration: Uses Qdrant for storing and querying embeddings.
  • Contextual Relevance: Employs a reranking process to select the most relevant content based on user input.

Technologies Used

Poetry, Python, Flask, Gunicorn, and Nginx.

Credits

  • SciPDF
  • GROBID

Roadmap

  • Implement parallel processing
  • Better caching of papers

Known Issues

  • The backend is not built to handle any level of scale, might fail with a lot of concurrent requests

talk2arxiv-server's People

Contributors

evanhu1 avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.