Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 60.8k 10.7k

2. IBM/text-generation-inference IBM/text-generation-inference Public

   IBM development fork of https://github.com/huggingface/text-generation-inference

   Python 61 35

3. IBM/etcd-java IBM/etcd-java Public

   Alternative etcd3 java client

   Java 161 44

4. kserve/modelmesh kserve/modelmesh Public

   Distributed Model Serving Framework

   Java 177 79

5. netty/netty netty/netty Public

   Netty project - an event-driven asynchronous network application framework

   Java 34.5k 16.2k

6. IBM/kv-utils IBM/kv-utils Public

   Abstracted helper classes providing consistent key-value store functionality, with zookeeper and etcd3 implementations

   Java 5 2