kudzai / pearson-llm-dev-intro

LLMs, GPT, and Prompt Engineering for Developers

This repository contains code for the O'Reilly Live Online Training for LLMs, GPT, and Prompt Engineering for Developers

Dive into the fascinating world of Large Language Models (LLMs) and Generative Pre-trained Transformers (GPT) in this comprehensive live online course. Throughout four engaging hours, you'll learn the essentials of LLMs, GPT, and language modeling while exploring practical applications through prompt engineering. This course is perfect for programmers and software engineers interested in the cutting-edge technology that powers modern AI language understanding and generation.

This course is the first in a three-part series by Sinan Ozdemir designed for machine learning engineers and software developers who want to expand their skillset and learn how to work with LLMs like ChatGPT and FLAN-T5. The series provides practical instruction on prompt engineering, language modeling, moving LLM prototypes to production, and fine-tuning GPT models. The three live courses in the series are:

LLMs, GPT and Prompt Engineering for Developers Using Open- and Closed-Source LLMs in Real World Applications LLMs from Prototypes to Production The book Quick Start Guide to LLMs by Sinan Ozdemir is recommended as companion material for post-class reference.

Notebooks

Intro to LLMs

Intro with BERT

Intro to GPT

Comparing LLM Token Embeddings

Intro to Fine-tuning LLMs

Classification with BERT

Finetuning LLMs with OpenAI

BERT vs ChatGPT

LLM Distillation

Prompt Engineering + RAG

Introduction to Prompt Engineering

Advanced to Prompt Engineering

Semantic Search

Extra / Advanced

Fine-tuning LLama-2 to be instructionally aligned

Probing LLMs for a world model - based on the paper "Language Models Represent Space and Time"

Instructor

Sinan Ozdemir is founder and CTO of LoopGenius, where he uses state-of-the-art AI to help people create and run their businesses. He has lectured in data science at Johns Hopkins University and authored multiple books, videos and numerous online courses on data science, machine learning, and generative AI. He also founded the recently acquired Kylie.ai, an enterprise-grade conversational AI platform with RPA capabilities. Sinan most recently published Quick Guide to Large Language Models, and launched a podcast audio series, AI Unveiled. Ozdemir holds a master’s degree in pure mathematics from Johns Hopkins University.