Relay – a self-hosted LLM gateway with eval-gated routing
SMRTR summary
Relay is a self-hosted LLM gateway that routes AI traffic across multiple providers using a single Go binary, supporting both OpenAI and Anthropic API formats. It features built-in routing policies, an eval harness that tests routing quality before enabling it, and zero telemetry — your prompts never leave your infrastructure.
SMRTR provides this summary for quick context. The original article belongs to Hacker News.
Read the original article