vllm-project/semantic-router
A programmable Mixture-of-Models router for heterogeneous LLM inference
6k stars995forks393issuespushed
Worth your time
rules reportOutside contributors get real replies here, and their work gets merged.
37 of 68outside PRs merged (54%)
checked