kevintsai / building-and-evaluating-advanced-rag-applications

Jupyter notebooks for course Building and Evaluating Advanced RAG Applications, taught by Jerry Liu (Co-founder and CEO of LlamaIndex) and Anupam Datta (Co-founder and chief scientist of TruEra).

Building and Evaluating Advanced RAG Applications

Jupyter notebooks for course Building and Evaluating Advanced RAG Applications, taught by Jerry Liu (Co-founder and CEO of LlamaIndex) and Anupam Datta (Co-founder and chief scientist of TruEra).

Course Topics

Learn how to efficiently bring Retrieval Augmented Generation (RAG) into production by enhancing retrieval techniques and mastering evaluation metrics.

• Learn methods like sentence-window retrieval and auto-merging retrieval, improving your RAG pipeline’s performance beyond the baseline.
• Learn evaluation best practices to streamline your process, and iteratively build a robust system.
• Dive into the RAG triad for evaluating the relevance and truthfulness of an LLM’s response:Context Relevance, Groundedness, and Answer Relevance.

Course Link

https://www.deeplearning.ai/short-courses/building-evaluating-advanced-rag/

Resource Links

• LlamaIndex - Data Framework for LLM Applications - https://www.llamaindex.ai/
• TruEra - leader in ML monitoring, testing, and quality management - https://truera.com/

building-and-evaluating-advanced-rag-applications's Issues

incomplete - need requirements.txt (what are dependencies?!)

Hi,

I've quite enjoyed the course so far.
all these notebooks seem to assume certain things, there are no %pip install or requirements.txt files

On the deeplearning.ai I can't upload my own PDF's
I'm not sure what is utils or where I would get the utils.get_openai_api_key()

So while the github repo is great to have the code, I'm still a bit unsure where/how to run this on my own server with my own keys and pdfs.

Thanks!

utils.py & .env.example not included

The utils.py dependency is missing.