ZeroRoute
Architected an open-source, multi-cloud AI gateway and turnkey SaaS platform aggregating 11 free-tier cloud providers into a zero-downtime OpenAI-compatible API with a 1-line embeddable website chatbot widget, SSRF-safe crawler, BM25 RAG, and Dodo Payments billing.
About
ZeroRoute is a production-grade multi-cloud AI API Gateway and turnkey SaaS platform built with Next.js 16 (Turbopack) and React 19. It pools free developer quotas across 11 AI cloud providers (Groq, Cerebras, SambaNova, Mistral AI, Cohere, Google Gemini, OpenRouter, NVIDIA NIM, Cloudflare Workers AI, Hugging Face, and BazaarLink AI) into a unified, high-availability, OpenAI-compatible endpoint with sub-8ms dynamic routing. Features include an autonomous 1-line embeddable website chatbot widget (widget.js) with live SSE token streaming, intra-provider model fallback chains, real-time circuit breaker cooldowns, a 1-click SSRF-protected web crawler (supporting Google Docs, Notion, GitHub markdown, and websites), BM25 semantic RAG with anti-hallucination directives, domain whitelisting (CORS security), Dodo Payments turnkey subscription billing, and a Master Admin console with live 11-cloud benchmark racing and failover trail telemetry.
Key Features
- Autonomous 1-line embeddable streaming chatbot widget (widget.js) with glassmorphism UI, custom avatars, quick prompt pills, and domain whitelisting (CORS security)
- Multi-cloud routing aggregating 11 free AI cloud providers (Groq, Cerebras, SambaNova, Mistral, Cohere, Gemini, OpenRouter, NVIDIA NIM, Cloudflare AI, Hugging Face, BazaarLink)
- Sub-8ms circuit breaker & intra-provider model fallback chains with automated rate-limit telemetry harvesting and cooldown backoff
- Real-time Server-Sent Events (SSE) streaming engine with chunk-level token normalization, custom typewriter animation, and stream fallback
- 1-Click SSRF-protected web crawler indexing Google Docs, Notion, GitHub markdown, and live websites into verified business knowledge
- BM25 semantic RAG engine with custom persona compiler and anti-hallucination pricing & URL guardrails
- Turnkey SaaS subscriber console (/app) with 10,000 monthly quota management and Dodo Payments subscription billing integration
- Master Admin dashboard (/admin) featuring visual fallback chain reordering, live 11-cloud benchmark racing, and multi-cloud failover trail inspector
- Dual-engine database architecture supporting Cloudflare D1 serverless edge database and embedded SQLite (@libsql/client)
