Auralius
Performance Engineering

Blazil Bare-Metal Gateway

Written entirely in Rust. The Blazil Gateway processes raw uncompressed 16-bit 8kHz PCM audio directly from Twilio with zero disk I/O, achieving unmatched sub-50ms processing latency.

rust
async fn process_audio_buffer(
    stream: &mut WebSocketStream<TcpStream>,
    buffer: &mut BytesMut,
) -> Result<()> {
    // Zero-copy processing of raw PCM packets
    let frame = codec::decode_pcm(buffer.split());
    let stt_result = transcriber.process(frame).await?;
    
    // Stream sentence boundaries to gRPC Orchestrator immediately
    grpc_client.run_turn_stream(stt_result).await
}

Memory-Safe Audio Streaming

Audio packets are handled in-memory using Rust's zero-cost abstractions, completely eliminating garbage collection pauses during live calls.

Instant Barge-In

The gateway defers barge-in detection directly to the playback layer, instantly cutting off the TTS stream the millisecond the caller interrupts.

High Concurrency

High Concurrency

Built on Tokio async runtime. A single Blazil node can effortlessly multiplex thousands of concurrent WebSockets.

[INFO] Starting Blazil Media Service v0.1.0
[INFO] Binding listener to 0.0.0.0:8000
[INFO] Accepting secure TLS connections...
[DEBUG] WebSocket connected: wss://tenant-e02f...

End-to-End Encryption

TLS 1.3 secured WebSockets ensure that all audio transit from SIP trunks to our infrastructure is mathematically secure.

Real-Time Metrics

Deep instrumentation with tracing and Prometheus metrics. Monitor VAD counters, STT turnaround times, and TTS TTFB.

Automatic Reconnection

Built-in jitter buffers and TCP backoff strategies ensure call stability even under suboptimal network conditions.