Grok Bot: real-time voice conversations via smart home speakers (Home Assistant)

Feature request for product/service

– Other –

Describe the request

I’d love to talk to my Grok Bot directly at home, through speakers in several rooms, like a “Jarvis”. My house runs on KNX and Home Assistant, and I’m planning to use voice satellites such as the FutureProofHomes Satellite1.

Right now the only option is a workaround: Home Assistant turns speech into text and sends it via webhook to a Grok Bot routine. Grok Bot then replies with a delay through the Home Assistant API. That’s far too slow for a real conversation.

What I’d like:

  • A real-time voice interface so an external speaker can talk directly to a specific Grok Bot, e.g. as a conversation agent for Home Assistant (Assist)
  • Replies within a few seconds, with access to my memories, connectors and routines just like in the chat
  • German language support

This would make Grok Bot a personal assistant you can reach anywhere in the house, not just at the computer or on the phone.

Operating System (if it applies)

MacOS

It’s the same for me! I’m using that exact setup; while it works well (i.e., no reliability issues), it does suffer from high latency on the Grok bot’s end: the webhook triggers quickly and is usually received promptly, but the subsequent processing takes a long time. To start with, it would be great if we could bump up the processing priority for the webhook routine.

Exactly what I was thinking about last night! I bought Cursor, and have used it but then found my way into GrokBot and it has chnaged how I control my home/home network/Proxmox servers, etc. I have it tied into everything and being able to use it like an Amazon Alexa or Google Home/Siri Speaker would be welcomed. If GrokBot was to sell hardware for it, (but also have an opensource way to access it based on your account) I’d buy the hardware instantly.