lazyfroglol / omniplex Goto Github PK

View Code? Open in Web Editor NEW

This project forked from omniplex-ai/omniplex

0.0 0.0 0.0 1.41 MB

Open-Source Perplexity

Home Page: https://omniplex.ai

License: GNU Affero General Public License v3.0

JavaScript 0.39% TypeScript 75.89% CSS 23.73%

omniplex's Introduction

Omniplex

Open-Source Perplexity

Website · Discord · Reddit

🚧 Under Active Development

Our focus is on establishing core functionality and essential features. As we continue to develop Omniplex, we are committed to implementing best practices, refining the codebase, and introducing new features to enhance the user experience.

Get started

To run the project, modify the code in the Chat component to use the // Development Code.

Fork & Clone the repository

git clone [email protected]:[YOUR_GITHUB_ACCOUNT]/omniplex.git

Install the dependencies

yarn

Fill out secrets in .env.local

BING_API_KEY=
OPENAI_API_KEY=

OPENWEATHERMAP_API_KEY=
ALPHA_VANTAGE_API_KEY=
FINNHUB_API_KEY=

Run the development server

yarn dev

Open http://localhost:3000 in your browser to see the app.

Plugins Development

This is just a hacky way but very easy to implement. We will be adding a more robust way to add plugins in the future. Feel free to understand from the sample plugin we have added.

Update the types in types.ts to include the new plugin data types.
Update the tools api in api to include the new plugin function call.
Update the api.ts in utils file to include the new plugin data.
Update the chatSlice.ts in store to include the new plugin reducer.
Create a new folder in the components directory for the UI of the plugin.
Update the chat.tsx to handle the new plugin in useEffect.
Call the plugin function and return the data as props to source.
Update the source.ts to use the plugin UI.
Lastly Update the data.ts in utils to show in the plugin tab.

Multi-LLM Support: Example

Add the new LLM apiKey in env and add the related npm package.

ANTHROPIC_API_KEY=******

Update the chat in api

import Anthropic from "@anthropic-ai/sdk";
import { OpenAIStream, StreamingTextResponse } from "ai";

const anthropic = new Anthropic({
  apiKey: process.env.ANTHROPIC_API_KEY,
});

export const runtime = "edge";

export async function POST(req: Request) {
  const {
    messages,
    model,
    temperature,
    max_tokens,
    top_p,
    frequency_penalty,
    presence_penalty,
  } = await req.json();

  const response = await anthropic.messages.create({
    stream: true,
    model: model,
    temperature: temperature,
    max_tokens: max_tokens,
    top_p: top_p,
    frequency_penalty: frequency_penalty,
    presence_penalty: presence_penalty,
    messages: messages,
  });

  const stream = OpenAIStream(response);
  return new StreamingTextResponse(stream);
}

Update the data in utils

export const MODELS = [
  { label: "Claude 3 Haiku", value: "claude-3-haiku-20240307" },
  { label: "Claude 3 Sonnet", value: "claude-3-sonnet-20240229" },
  { label: "Claude 3 Opus", value: "claude-3-opus-20240229" },
];

Disclaimer

We recently transitioned from the pages directory to the app directory, which involved significant changes to the project structure and architecture. As a result, you may encounter some inconsistencies or rough edges in the codebase.