Blazing fast LLMs API Gateway written in Go ⚡️

企业级的数字员工容器化管理平台

LLM Router is a service that can be deployed on‑premises or in the cloud. It adds a layer between any application and the LLM provider. In real time it controls traffic, distributes a load among providers of a specific LLM, and enables analysis of outgoing requests from a security perspective (masking, anonymization, prohibited content).

Jinguzhou (紧箍咒 [jǐn gū zhòu], Band-tightening Spell): OpenAI-compatible LLM gateway and policy engine for AI agents, tool calling, audit logs, human approval, and MCP or LangChain integrations.

Reference Docker Compose stacks, cloud deploy recipes, and SDK integration samples for the DVARA LLM Gateway