flashinfer-ai/flashinfer

FlashInfer: Kernel Library for LLM Serving

6.9k stars1.8kforks478issuespushed

flashinfer.ai ↗github.com/flashinfer-ai/flashinfer ↗

Worth your time

Outside contributors get real replies here, and their work gets merged.

9 of 32outside PRs merged (28%)

checked