Awesome
<a href="https://usenotesgpt.com/"> <img alt="NotesGPT – AI-powered voice note taking in seconds." src="/public/images/og-image.png"> <h1 align="center">notesGPT</h1> </a> <p align="center"> Generate action items from your notes in seconds. Powered by Convex, Together.ai, and Whisper. </p> <p align="center"> <a href="#tech-stack"><strong>Tech Stack</strong></a> · <a href="#deploy-your-own"><strong>Deploy Your Own</strong></a> · <a href="#future-tasks"><strong>Future Tasks</strong></a> </p> <br/>Tech Stack
- Convex for the database and cloud functions
- Next.js App Router for the framework
- Together Inference for the LLM (Mixtral)
- Together Embeddings for the embeddings for search
- Convex File Storage for storing voice notes
- Convex Vector search for vector search
- Replicate for Whisper transcriptions
- Clerk for user authentication
- Tailwind CSS for styling
Deploy Your Own
You can deploy this template by setting up the following services and adding their environment variables:
- Run
npm installto install dependencies. - Run
npm run dev. It will prompt you to log into Convex and create a project. - It will then ask you to supply the
CLERK_ISSUER_URL. To do this:- Make a Clerk account.
- Copy both the
CLERK_SECRET_KEYandNEXT_PUBLIC_CLERK_PUBLISHABLE_KEYAPI keys into.env.local. - Do steps 1-3 here and copy the Issuer URL.
It should look something like
https://some-animal-123.clerk.accounts.dev. - Add
CLERK_ISSUER_URLto your Convex Environment Variables (deep link also available in your terminal). Paste the Issuer URL as the value and click "Save".
- Now your frontend and backend should be running and you should be able to log in but not record.
- Make a Together account to get your API key.
- Make a Replicate account to get your API key.
- Save your environment variables in Convex as
REPLICATE_API_KEYandTOGETHER_API_KEY.
Future tasks
- Keep recording for future playback and display it on the page somewhere
- Animate the purple microphone to be in sync with your voice
- Store completed action items for the future instead of fully deleting them
- Make text/images in the landing page smaller to account for multiple screen sizes.
- Make the search experience a little smoother overall by searching automatically on entering text
- Be able to have this as a PWA if there's an easy step to do that
- Prompt engineer the summary a little more to be more useful than what's currently displaying
- Add a Notion integration to be able to get the transcript + summary + action items on there
- UI updates to make it look a little nicer based on Youssef's redesign
- Be able to edit action items after the fact and set a due date for them
- Account for layout shift on the dashboard page when refreshing – show a loading state on content?
- Make action items animate out + make checkbox rounded + add a little check icon on hover
- Migrate to incredibly fast whisper