Building ultra-efficient traffic routing engines, stream-aware gateways, and minimal-footprint edge infrastructure.
- llm-stream-guard - Ultra-low latency Ingress Gateway for local LLMs (Ollama, vLLM). Eliminates token jitter under heavy RAG/embedding batches.
- nano-ingress - Sub-18MB Reverse Proxy & Ingress Gateway for Micro-VPS (512MB RAM), SBCs, and constrained Edge nodes.
- apex-gateway (Docker Hub) - Non-resonant DRR scheduling engine core packaged as an ultra-compact native container.
- Languages & Runtime: Rust, Tokio (Async I/O), Python
- Networking & Protocols: HTTP/1.1, HTTP/2, WebSockets, Server-Sent Events (SSE)
- Traffic Engineering: Non-resonant Deficit Round Robin (DRR), Multi-Tier Ingress Queues
- Infrastructure: Docker, Linux Cgroups, Edge Systems, Micro-VPS Optimization