Coder Social home page Coder Social logo

agents-playground's Introduction

The LiveKit icon, the name of the repository and some sample code in the background.

LiveKit Agents Playground

The Agent Playground is designed for quickly prototyping with server side agents built with LiveKit Agents Framework. Easily tap into LiveKit WebRTC sessions and process or generate audio, video, and data streams. The playground includes components to fully interact with any LiveKit agent, through video, audio and chat.

Docs and references

Docs for how to get started with LiveKit agents at https://docs.livekit.io/agents

The repo containing the (server side) agent implementations (including example agents): https://github.com/livekit/agents

Try out a live version

You can try out the agents playground at https://livekit-agent-playground.vercel.app. This will connect you to our example agent KITT.

Setting up the playground locally

  1. Install dependencies
  npm install
  1. Copy and rename the .env.example file to .env.local and fill in the necessary environment variables.
LIVEKIT_API_KEY=<your API KEY>
LIVEKIT_API_SECRET=<Your API Secret>
NEXT_PUBLIC_LIVEKIT_URL=wss://<Your Cloud URL>
  1. Run the development server:
  npm run dev
  1. Open http://localhost:3000 with your browser to see the result.
  2. If you haven't done so yet, start your agent (with the same project variables as in step 2.)
  3. Connect to a room and see your agent connecting to the playground

Features

  • Render video, audio and chat from your agent
  • Send video, audio, or text to your agent
  • Configurable settings panel to work with your agent

Notes

  • This playground is currently work in progress. There are known layout/responsive bugs and some features are under tested.
  • The playground was tested against the kitt example in https://github.com/livekit/agents.
  • Feel free to ask questions, request features in our community slack.

Known issues

  • Layout can break on smaller screens.
  • Mobile device sizes not supported currently


LiveKit Ecosystem
Real-time SDKsReact Components · JavaScript · iOS/macOS · Android · Flutter · React Native · Rust · Python · Unity (web) · Unity (beta)
Server APIsNode.js · Golang · Ruby · Java/Kotlin · Python · Rust · PHP (community)
Agents FrameworksPython · Playground
ServicesLivekit server · Egress · Ingress · SIP
ResourcesDocs · Example apps · Cloud · Self-hosting · CLI

agents-playground's People

Contributors

renovate[bot] avatar lukasio avatar mattherzog avatar ocupe avatar arsenstorm avatar davidzhao avatar dsa avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.