abeusher / pico-jarvis

Pico Jarvis

This repository contains the source code for the Retrieval-augmented Generation (RAG) technique, as described in the following articles:

• Part 1: Getting started, Chain of Thought
• Part 2: Reason-Act, multi-turn conversation
• Part 3: PDF ingestion, vector search

First, you need to run the API server of llama.cpp with Mistral 7B OpenOrca, e.g.:

./server -m /path/to/mistral-7b-openorca.Q4_K_M.gguf

(For a quicker response with potentially reduced accuracy, consider using Phi 2 Q5_K_M).

To launch Pico Jarvis, you need Node.js v18 or later:

npm install
npm start

and then open localhost:5000.

Ask the following questions:

• Who wrote the Canon of Medicine?
• Is ramen typically eaten in Egypt?
• Who directed the Dark Knight movie?
• Name Indonesia #1 tourist destination!

(and some more to try)

• What is the native language of Mr. Spock?
• Which US state starts with G?
• What is the atomic number of Magnesium?
• Where do we find kangoroo?
• Who is the father of Luke Skywalker?
• In which country Mandarin is spoken?
• What is the longest river in Latin America?
• Who authored the special theory of relativity?
• Which fictional metal is infused into Wolverine body?
• Who sailed with the flagship Santa Maria?
• Name the big desert close to Mongolia
• Which is closer to Singapor: Vietnam or Australia?
• Who is the fictional spy 007?
• Which country is known for IKEA?

Meanwhile, questions related the solar system will be answered by searching the PDF document:

• What is a dwarf planet?
• Give an example!
• List all terrestrial planets
• Which is the closest to the Sun?
• Which planet known as the red one?
• What materials compose the gas giants?
• Explain the heliopause

If you get an API key for OpenWeatherMap and supply it as OPENWEATHERMAP_API_KEY environment variable, try to ask the following:

• How is the weather in Jakarta?
• What is the current temperature in Palo Alto?
• Is it currently cloudy in Seattle?