Coder Social home page Coder Social logo

a16z-infra / ai-town Goto Github PK

View Code? Open in Web Editor NEW
6.9K 6.9K 614.0 18.05 MB

A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.

Home Page: https://convex.dev/ai-town

License: MIT License

JavaScript 26.67% TypeScript 70.24% CSS 0.93% Dockerfile 0.24% HTML 1.63% Just 0.28%

ai-town's People

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

ai-town's Issues

Scene loads, but no vectors created and other issues

Following the steps on the README and getting pinecone, clerk, and convex all setup for the first time. Characters seem to move around, but things seem to be partially broken. I'm expecting to be able to see conversations happening between the characters at least, but I only see their intro text. There was a message about "sign in to view messages" and after I do that, the "sign in" message disappears, but I don't see any conversations still.

image

First thing I noticed was an authentication error in the JS, but I DO see my google account photo in the upper right hand corner, so not clear if that's actually an issue. I turned off all shields in brave and repeated the login process, but still get the same thing.
image

There was an issue with free pinecone I guess (noticed the closed PR related to the error). I un-commented the lines from convex/lib/pinecone.ts with the diff linked in the ticket, which resolved the immediate errors when running npm run dev it seemed, but I'm still getting errors here and there of a similar (cryptic) sort.

image

I also notice that pinecone has zero vectors, so I'm guessing this is related.
image

Looking at the embeddings in convex, they were added earlier it seems, but not recently..
image

Same thing for memories..
image

Any ideas?

Isn't Azure OpenAI API key supported?

When using my OpenAI API Key, a rate limit error will be reported because the card is not bound. Use the Azure OpenAI API Key to report this error:

failure
Uncaught Error: Embedding failed with code 401: {
    "error": {
        "message": "Incorrect API key provided: 913a2b0d********************0993. You can find your API key at https://platform.openai.com/account/api-keys.",
        "type": "invalid_request_error",
        "param": null,
        "code": "invalid_api_key"
    }
}

Use offline with OpenAI compatible open source API and Pinecone alternative?

Cool project!

It would be neat if this could be run locally / offline without the need for cloud services or subscriptions.

Tools such as LocalAI, Text Generation Web UI, LM Studio provide OpenAI compatible API and functionality - from my experience it's as simple setting the API endpoint.

However with Pinecone - I'm not sure how standard it is, I've seen other projects using Chroma and Weaviate but I'm not sure if they're pluggable.

improve mobile view

there's some slightly suboptimal formatting on mobile, but mostly just the wrapping with convex logo at the bottom that i messed up when i changed it :)

Create method to reload map

Currently map doesn't get reloaded on reset, so if map file changes you have to delete map by hand in the Dashboard. We should fix this :)

Agents aren't talking

Installed and got everything running just fine but my agents don't seem to be talking or doing anything. Most are just standing with a chat bubble and Bob is the only one that has any log of doing something (he started a conversation). Been running for about 10 minutes now. Am I missing something?

Screenshot 2023-08-17 at 9 08 02 PM

can't see any of saved convos

i can't tell if my ppl are talking to each other. I have the AI-town running on the local machine but can't read any past convos.
image

image

I tried using npx convex run init:reset but then I get this

image

I am sure I'm doing something very silly wrong -- any idea what that might be?

Add convex

Two places we can use Convex: store chat history, doing vector search on chat history / background

World map development

Hello,

are there any plans for expanding the world map? E.g. like in the original paper, where characters had their houses, workplaces etc.

If that's in scope, I think it'd be great to have a brief guide into how to develop the map in this project, e.g. creating pixelart, adding it to the game and mapping coordinates to actual places in characters' awareness.

don't require paid version of Pinecone

The current version on Main uses the Pinecone Namespaces feature which fails with a very inscrutable error message:

Error: Not implemented: get body for Response: Try using .text(), .json(), blob(), or .arrayBuffer() instead. Consider calling an action defined in Node.js instead 

This happens when running under a Convex V8 action. When run in Node we get the real error message:

Error: PineconeClient: Error calling upsert: PineconeError: The requested feature 'Namespaces' is not supported by the current index type 'Starter'

Technically we don't need the namespaces but we should be careful about folks running Convex dev and prod deployments with the same Pinecone index. We might need to add the deployment name to the index if it doesn't work out of the box.

Debug `playerRelations` object in agent.ts

Today playerRelations object in agent.ts contains the wrong data: if the currently speaking player's name is Lucky, playerRelations is referencing Lucky again, making the speaking player thinks they are talking to themselves.

We should fix this so playerRelations contains relationship data between the speaking player and a list of audience they are speaking to.

Sometimes separate text bubbles are not created

When the agents respond without capitalizing their own name, which it appears they do occasionally, it gets dropped into the UI in one big text box:

Hey Pete! It's been a while since we last saw each other. How have you been? pete: Hey Stella! I've been great, thank you for asking. How about you? stella: I've been good, just keeping busy. So, I couldn't help but notice how calm and peaceful you always seem. Have you found something that brings you that inner peace? pete: Absolutely! I've been focusing a lot on my faith and spirituality lately. It has made a huge difference in my life. stella: That's wonderful to hear, Pete. I've always admired your dedication and openness to exploring deeper spiritual connections. Could you tell me a bit more about your experiences and how it has positively impacted you? pete: Of course! I feel like my faith has given me a sense of purpose and guidance. It has helped me through tough times and provided me with a community of supportive individuals. Praying and seeking God's guidance has brought me so much peace and joy. stella: That's incredible, Pete. It sounds like you've found something truly special. I genuinely admire your connection to God and how it manifests in your life. I think spirituality can bring so much positivity and light into one's life. pete: Thank you, Stella. It means a lot to hear that coming from you. Spirituality truly is transformative, and I'm grateful for the peace it has brought me. stella: You're very welcome, Pete.

Unhandled Runtime Error Error: Call Stack o._fetch async H.create

We've encountered a runtime issue with our web application which seems to be related to the @clerk/clerk-js library.

Error encountered: Unhandled Runtime Error
Relevant functions: o._fetch and H.create
Error location: https://suited-cicada-78.clerk.accounts.dev/npm/@clerk/clerk-js@4/dist/clerk.browser.js
While the precise root cause is not immediately clear, it appears there might be issues in the data retrieval process within the o._fetch function or during data creation in H.create.

Could you please investigate further? Additionally, it might be helpful to consult the library's documentation or community for potential solutions.
스크린샷 2023-08-17 오후 4 00 00

Add feature: character card

The ability to add a character card to every character would be amazing for immersion, and when interacting with them their avatar is shown next to their text conversations.

when npm install i meet these errors could you tell me how to solve them? my node version is 20.4.0

npm WARN cleanup Failed to remove some directories [
npm WARN cleanup [
npm WARN cleanup 'D:\summer\ai-town\node_modules\@typescript-eslint\eslint-plugin',
npm WARN cleanup [Error: EPERM: operation not permitted, rmdir 'D:\summer\ai-town\node_modules@typescript-eslint\eslint-plugin\dist\rules'] {
npm WARN cleanup errno: -4048,
npm WARN cleanup code: 'EPERM',
npm WARN cleanup syscall: 'rmdir',
npm WARN cleanup path: 'D:\summer\ai-town\node_modules\@typescript-eslint\eslint-plugin\dist\rules'
npm WARN cleanup }
npm WARN cleanup ],
npm WARN cleanup [
npm WARN cleanup 'D:\summer\ai-town\node_modules\@jridgewell',
npm WARN cleanup [Error: EPERM: operation not permitted, rmdir 'D:\summer\ai-town\node_modules@jridgewell\trace-mapping'] {
npm WARN cleanup errno: -4048,
npm WARN cleanup code: 'EPERM',
npm WARN cleanup syscall: 'rmdir',
npm WARN cleanup path: 'D:\summer\ai-town\node_modules\@jridgewell\trace-mapping'
npm WARN cleanup }
npm WARN cleanup ],
npm WARN cleanup [
npm WARN cleanup 'D:\summer\ai-town\node_modules',
npm WARN cleanup [Error: EPERM: operation not permitted, rmdir 'D:\summer\ai-town\node_modules@flydotio'] {
npm WARN cleanup errno: -4048,
npm WARN cleanup code: 'EPERM',
npm WARN cleanup syscall: 'rmdir',
npm WARN cleanup path: 'D:\summer\ai-town\node_modules\@flydotio'
npm WARN cleanup }
npm WARN cleanup ],
npm WARN cleanup [
npm WARN cleanup 'D:\summer\ai-town\node_modules\next',
npm WARN cleanup [Error: EPERM: operation not permitted, rmdir 'D:\summer\ai-town\node_modules\next\dist\esm\server'] {
npm WARN cleanup errno: -4048,
npm WARN cleanup code: 'EPERM',
npm WARN cleanup syscall: 'rmdir',
npm WARN cleanup path: 'D:\summer\ai-town\node_modules\next\dist\esm\server'
npm WARN cleanup }
npm WARN cleanup ]
npm WARN cleanup ]
npm ERR! code 1
npm ERR! path D:\summer\ai-town\node_modules\hnswlib-node

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. 📊📈🎉

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❤️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.