The open-source LLMOps platform for prompt-engineering, evaluation, and deployment of complex LLM apps.
About • Demo • Quick Start • Installation • Features • Documentation • Support • Community • Contributing
Important: In version 0.3, we had to do a large refactoring that introduced breaking changes. This means that version 0.3 cannot be used with data from versions 0.2 and below. You should manually save your data before pulling version 0.3. Feel free to contact us on Slack if you need help with the migration.
Building production-ready LLM-powered applications is currently very difficult. It involves countless iterations of prompt engineering, parameter tuning, and architectures.
Agenta provides you with the tools to quickly do prompt engineering and 🧪 experiment, ⚖️ evaluate, and 🚀 deploy your LLM apps. All without imposing any restrictions on your choice of framework, library, or model.
agenta-demo.mp4
playground_1024_30.07.2023.mp4
When you are ready, deploy your LLM applications as APIs in one click.
- 🔨 Build quickly: You need to iterate many times on different architectures and prompts to bring apps to production. We streamline this process and allow you to do this in days instead of weeks.
- 🏗️ Build robust apps and reduce hallucination: We provide you with the tools to systematically and easily evaluate your application to make sure you only serve robust apps to production
- 👨💻 Developer-centric: We cater to complex LLM-apps and pipelines that require more than one simple prompt. We allow you to experiment and iterate on apps that have complex integration, business logic, and many prompts.
- 🌐 Solution-Agnostic: You have the freedom to use any library and models, be it Langchain, llma_index, or a custom-written alternative.
- 🔒 Privacy-First: We respect your privacy and do not proxy your data through third-party services. The platform and the data are hosted on your infrastructure.
1. Write your LLM-app code
Write the code using any framework, library, or model you want. Add the agenta.post
decorator and put the inputs and parameters in the function call just like in this example:
Example simple application that generates baby names
import agenta as ag
from langchain.chains import LLMChain
from langchain.llms import OpenAI
from langchain.prompts import PromptTemplate
default_prompt = "Give me five cool names for a baby from {country} with this gender {gender}!!!!"
@ag.post
def generate(
country: str,
gender: str,
temperature: ag.FloatParam = 0.9,
prompt_template: ag.TextParam = default_prompt,
) -> str:
llm = OpenAI(temperature=temperature)
prompt = PromptTemplate(
input_variables=["country", "gender"],
template=prompt_template,
)
chain = LLMChain(llm=llm, prompt=prompt)
output = chain.run(country=country, gender=gender)
return output
2.Deploy your app using the Agenta CLI.
![Screenshot 2023-06-19 at 15 58 34](https://private-user-images.githubusercontent.com/4510758/246851133-eede3e78-0fe1-42a0-ad4e-d880ddb10bf0.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ2ODU2OTksIm5iZiI6MTcyNDY4NTM5OSwicGF0aCI6Ii80NTEwNzU4LzI0Njg1MTEzMy1lZWRlM2U3OC0wZmUxLTQyYTAtYWQ0ZS1kODgwZGRiMTBiZjAucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI0MDgyNiUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNDA4MjZUMTUxNjM5WiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9ZWY3MTM4NTM0YjVhZGEzMWFmYWNlYjAyYWI4ZWFjODM2MTE2ZmU4OGNiMmMzYTIzZTVkZjVmYmZmMDVhYjZmYSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QmYWN0b3JfaWQ9MCZrZXlfaWQ9MCZyZXBvX2lkPTAifQ.a63myXLTwAfyLh8y4oU6hJQDzD3mrR-D9vy5WnEKN5M)
3. Go to agenta at localhost:3000
Now your team can 🔄 iterate, 🧪 experiment, and ⚖️ evaluate different versions of your app (with your code!) in the web platform.
![Screenshot 2023-06-25 at 21 08 53](https://private-user-images.githubusercontent.com/57623556/248580912-7e07a988-a36a-4fb5-99dd-9cc13a678434.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjQ2ODU2OTksIm5iZiI6MTcyNDY4NTM5OSwicGF0aCI6Ii81NzYyMzU1Ni8yNDg1ODA5MTItN2UwN2E5ODgtYTM2YS00ZmI1LTk5ZGQtOWNjMTNhNjc4NDM0LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MjYlMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODI2VDE1MTYzOVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWI5NGIwMGQ4MjRmZWIxZjZmZTU5NjY1OTdiMDY5M2NmN2NkZmRiMjkwYjFiNTRlMjRlYzljYzYzZWU4NzFkMmYmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0._93k1lGzIEiF9Pe680g74Tb3-X4-2bhr5tVcZem6NGA)
Talk with the founders for any commercial inquiries.
We warmly welcome contributions to Agenta. Feel free to submit issues, fork the repository, and send pull requests.
We are usually hanging in our Slack. Feel free to join our slack and ask us anything
Check out our Contributing Guide for more information.
Thanks goes to these wonderful people (emoji key):
This project follows the all-contributors specification. Contributions of any kind welcome!
Attribution: Testing icons created by Freepik - Flaticon