Vibe Coder Extension - Voice Agent in Cursor

For my fellow vibe coders, I’m hoping to get some feedback on something I built and launched on Product Hunt today.

Vibe Coder is an open-source VS Code extension that brings a Voice Agent into Cursor. It has two modes:

  • Vibe mode: Deepgram’s Voice Agent in your IDE that is prompted to help you brainstorm ideas and think through problems. At the end of a conversation, you can ask it to generate a product spec, and it will create one based on everything you discussed! Then you can use this to guide Cursor’s Agent/Composer. It can also execute limited VS Code commands, with more to come. I’m most excited about building this out and hearing what you would like it to do. Top of mind would be some way of giving it context of recent changes/text or files you’re focused on, or perhaps highlighting diffs that seem out of whack.

  • Code mode: Deepgram’s STT + AI rewrite in your IDE, automatically copied to your clipboard. Due to limitations of just being an extension, you still have to paste it into composer (or anywhere else!), but I am thinking of some creative ways around that for future updates… The custom prompts are helpful for common Cursor scenarios, like debugging or planning or limiting Claude 3.7’s tendency to do too much, because you can instruct to return something extra at the end of every dictation without having to think about. I have a debug prompt (my dication+ “Think through the top 5-7 reasons this is happening…”) and a planning prompt (my dictation + “Do not code, just think through how we would implement this change…etc”) that work to great effect. It’s super snappy and you never have to leave the IDE for anything.

I’m going to be actively maintaining it, and welcome all ideas, criticisms, feature requests, and contributions! More detail can be found on Product Hunt and a quick trailer is below.

This is just a first cut/preview, so there are still some issues and quick hit improvements I’m working through.

Right now, you need a Deepgram API key (lots of free credits with new accounts though, and let me know if you need more) and an OpenAI key. I’m working on a way to remove that though, so you can just use it for free in the next day or two.

And yes, I built this entirely in Cursor despite having entirely zero coding experience. All credit due to the Cursor team for enabling that! :slight_smile:

1 Like

You can intstall it by searching for “Vibe Coder” on the extension sidebar in Cursor.