FriendliAI
Supercharge Generative AI Inference
- 72 followers
- United States of America
- https://friendli.ai
- https://friendli.ai
- company/friendliai
- @friendliai
- @friendliai
Popular repositories Loading
-
friendli-client
friendli-client Public archive[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
-
-
-
friendli-model-optimizer
friendli-model-optimizer Public archiveFMO (Friendli Model Optimizer)
Repositories
Showing 10 of 31 repositories
- container-resource Public
friendliai/container-resource’s past year of commit activity - friendli-gradio Public
friendliai/friendli-gradio’s past year of commit activity - homebrew-client Public
friendliai/homebrew-client’s past year of commit activity - friendli-client Public archive
[⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI
friendliai/friendli-client’s past year of commit activity - TensorRT-LLM Public Forked from NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.
friendliai/TensorRT-LLM’s past year of commit activity
People
This organization has no public members. You must be a member to see who’s a part of this organization.
Most used topics
Loading…