Pinned Loading

1. kvcache-ai/Mooncake kvcache-ai/Mooncake Public

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 4.1k 398

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 19.1k 3.1k

3. LMCache/LMCache LMCache/LMCache Public

   Supercharge Your LLM with the Fastest KV Cache Layer

   Python 5.6k 652

4. foyer-rs/foyer foyer-rs/foyer Public

   Hybrid in-memory and disk cache in Rust

   Rust 1.5k 61

5. datenlord/datenlord datenlord/datenlord Public

   DatenLord, Computing Defined Storage, an application-orientated, cloud-native distributed storage system

   Rust 908 92