I study the intelligent routing. I focus on bringing collective intelligence to the LLM systems.
It`s just a good thinking game 🎲
I study the intelligent routing. I focus on bringing collective intelligence to the LLM systems.
It`s just a good thinking game 🎲
System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge
Manages Unified Access to Generative AI Services built on Envoy Gateway
Inference-native Tokenmaxxing Agent Harness for Loop Engineering
A high-throughput and memory-efficient inference and serving engine for LLMs
Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway
Personal-Model First Self Evolving AI Agent 🐘