Flask-SocketIO · AssemblyAI · Gemini · ElevenLabs · FAISS · AWS EC2
Live voice support agent: customers speak, it answers from the brand's own policy documents, and it hands off to a human when sources conflict or a message is sensitive.
- Voice-enabled AI customer support agent built for the AssemblyAI Voice Agent Hackathon (lablab.ai), September 2026 — live at verveassist.live
- Full real-time voice loop: browser mic → AssemblyAI speech-to-text → Gemini-powered RAG pipeline → ElevenLabs text-to-speech, streamed back over WebSocket
4 more details
- Built on a production-proven RAG core (retrieval, conflict detection, order lookup, escalation logic) carried over from a prior text-based support agent, with an entirely new voice layer built for this hackathon
- Conflict detection caught a real contradiction sitting unnoticed in the policy knowledge base — a 24-hour vs. 1-hour cancellation window — during deployment testing
- Multi-turn conversation state for verification flows, e.g. collecting an order number, then a total
- Deployed on AWS EC2 behind nginx with Let's Encrypt SSL — HTTPS required for browser microphone access














