Systems

Real-time backend systems and the ML that ships them — plus the tooling around both. Filter by discipline.

• SYS.02 — SWITCHBOARDBACKEND

  Switchboard

  Real-time voice-AI orchestration engine

  Routes phone calls (PSTN/SIP) through STT → LLM → TTS with streaming and barge-in. Multi-tenant, sub-300ms turn latency.

  • TypeScript
  • Node.js
  • WebSockets
  • Redis

  ▪ p50 turn latency ≈ 280msOPEN →
• SYS.03 — PRISMAI / ML

  Prism

  Transcript intelligence service

  Real-time intent, sentiment & entity extraction over call transcripts. TensorFlow → ONNX with dynamic request batching.

  • Python
  • TensorFlow / Keras
  • FastAPI
  • ONNX Runtime

  ▪ batched inference < 50ms · intent F1 ≈ 0.9xOPEN →
• SYS.04 — CONDUITINFRA

  Conduit

  Integration middleware framework

  A tenant / adapter / router framework to wire CRMs, telephony and webhooks together without per-client spaghetti. Dual deploy (SaaS + self-hosted).

  • TypeScript
  • pnpm monorepo
  • PostgreSQL
  • Redis

  ▪ idempotent webhook pipeline · replay + mergeOPEN →
• SYS.05 — OVERWATCHFULL-STACK

  Overwatch

  Live agent observability dashboard

  Real-time view of running agents: live transcripts, latency graphs, error feed and per-tenant metrics.

  • Astro
  • Vanilla TS
  • WebSockets / SSE
  • TimescaleDB

  ▪ streaming UI · live latency histogramsOPEN →
• SYS.06 — ANVILAI / ML

  Anvil

  LLM / agent evaluation harness

  Regression-tests prompts & agent flows like code: fixtures, assertions, LLM-as-judge + deterministic checks, CI gate, HTML reports.

  • Python
  • async
  • pytest-style API

  ▪ CI gate · deterministic + LLM-as-judge scoringOPEN →
• SYS.07 — REPLAYOSS

  replay

  Webhook capture & replay CLI

  Capture and replay webhooks for local dev. Small, sharp, open-source — signals CLI/systems maturity and an OSS presence.

  • Go
  • or Node + TS

  ▪ open-source · single-binary CLIOPEN →