Popular repositories Loading

1. llm-d-infra llm-d-infra Public

   llm-d helm charts and deployment examples

   Shell 45 42

2. llm-d-modelservice llm-d-modelservice Public

   helm charts for deploying models with llm-d

   Smarty 20 35

3. workload-variant-autoscaler workload-variant-autoscaler Public

   Variant optimization autoscaler for distributed inference workloads

   Go 19 16

4. llm-d-fast-model-actuation llm-d-fast-model-actuation Public

   Go 4 6

5. llm-d-ci llm-d-ci Public

   Shell 2 2

6. ig-wva ig-wva Public

   Workload Variant Autoscaler is a service to compute the cost-optimal provisioning of heterogeneous accelerators for inference workloads with varying request latency objectives

   Jupyter Notebook 1 1