Software Engineer at Finzly · Weekend Tinkerer

G. P. Singh

Builder of small, stubbornly useful things

AI Call Assistant

A self-hosted AI phone assistant. Someone calls your number, an AI answers, holds a real conversation, books appointments and takes messages.

  • Node.js
  • Twilio
  • Groq
  • Whisper
  • Supabase

What it does

  • Streaming conversation with barge-in — interrupt it mid-sentence and it stops and listens.
  • Books real appointments against multiple staff Google Calendars over OAuth 2.0.
  • Detects missed calls and offers one-click callbacks from the dashboard.
  • Runs on free tiers: Groq for LLM + Whisper, local TTS, Cloudflare tunnel. Twilio is the only line item.

How it works

Caller hits a Twilio number, TwiML opens a Media Streams WebSocket, and 8 kHz mu-law frames flow both ways. VAD handles endpointing, Groq Whisper transcribes, Llama replies, and TTS goes back down the same socket. Calls, transcripts, tasks and staff credentials persist to Supabase so nothing is lost when the container sleeps.

Source code

Back to all works