VEXYL - Self-Hosted AI Voice Gateway for Asterisk

Asterisk AI
1

Hey Asterisk community,

I’ve built a voice AI gateway that bridges Asterisk to modern AI services (STT, LLM, TTS) via AudioSocket protocol. Thought I’d share here since the Asterisk community understands telephony infrastructure better than anyone.

What is VEXYL?

Self-hosted middleware that sits between your Asterisk/FreePBX system and AI providers. Handles the full voice AI pipeline - speech recognition, language processing, text-to-speech - while your PBX continues managing call routing, transfers, and everything else you’ve already built.

Why I Built This

After deploying voice AI for several call centers, I realized there’s a gap between expensive cloud platforms ($0.15-0.40/min) and building everything in-house (4-6 months dev time). Organizations with existing Asterisk investments shouldn’t have to choose between high recurring costs or massive development effort.

Technical Overview:

  • Protocol: AudioSocket (WebRTC support also available)

  • Architecture: Redis, PM2 clustering

  • Response Time: 2.2-3.3 seconds end-to-end

  • Providers: 17+ AI providers supported (BYOK model)

  • Deployment: Docker or binary, self-hosted

  • Languages: English + 10+ Indian languages

Simple Dialplan Integration:

exten => _X.,1,Answer()
same => n,AudioSocket(${UUID},localhost:9099)
same => n,Hangup()

Two Operating Modes:

  1. Standard Mode: Full STT→LLM→TTS pipeline with custom data integration (Flowise/n8n)

  2. Gateway Mode: Direct streaming to OpenAI Realtime API, ElevenLabs

Quick Start:

docker pull vexyl/vexyl-voice-gateway
docker run -d -p 9099:9099 vexyl/vexyl-voice-gateway

Production Stats:

  • 1000+ monthly calls in healthcare/call centers

  • 90% TTS cache hit rate

  • 20-50 concurrent calls, tested to 200+

Why Post Here?

Looking for feedback on:

  • AudioSocket vs other integration approaches

  • Scaling patterns for high-volume deployments

  • Use cases you’re encountering with voice AI

  • FreeSWITCH compatibility needs

Resources:

Happy to answer technical questions or discuss integration challenges you’re facing with voice AI.

Anil

1 Like