![NotesGPT – AI-powered voice note taking in seconds.](/public/images/og-image.png)
Generate action items from your notes in seconds. Powered by Convex, Together.ai, and Whisper.
Tech Stack · Deploy Your Own · Future Tasks
- Convex for the database and cloud functions
- Next.js App Router for the framework
- Together Inference for the LLM (Mixtral)
- Together Embeddings for the embeddings for search
- Convex File Storage for storing voice notes
- Convex Vector search for vector search
- Replicate for Whisper transcriptions
- Clerk for user authentication
- Tailwind CSS for styling
You can deploy this template by setting up the following services and adding their environment variables:
- Run
npm install
to install dependencies. - Run
npm run dev
. It will prompt you to log into Convex and create a project. - It will then ask you to supply the
CLERK_ISSUER_URL
. To do this:- Make a Clerk account.
- Copy the API keys into
.env.local
. - Do steps 1-3 here and copy the Issuer URL.
It should look something like
https://some-animal-123.clerk.accounts.dev
. - Add
CLERK_ISSUER_URL
to your Convex Environment Variables (deep link also available in your terminal). Paste the Issuer URL as the value and click "Save".
- Now your frontend and backend should be running and you should be able to log in but not record.
- Make a Together account to get your API key.
- Make a Replicate account to get your API key.
- Save your environment variables in Convex as
REPLICATE_API_KEY
andTOGETHER_API_KEY
.
- Whisper transcripts can get queued on Replicate. If that happens, show a message to the user
- Make text/images in the landing page smaller to account for multiple screen sizes.
- Make the search experience a little smoother overall
- Prompt engineer the summary a little more to be more useful than what's currently displaying
- Add a Notion integration to be able to get the transcript + summary + action items on there
- UI updates to make it look a little nicer based on Youssef's redesign
- Be able to edit action items after the fact and set a due date for them
- Account for layout shift on the dashboard page when refreshing – show a loading state on content?
- Make action items animate out + make checkbox rounded + add a little check icon on hover