Pinned Loading

1. EleutherAI/lm-evaluation-harness EleutherAI/lm-evaluation-harness Public

   A framework for few-shot evaluation of language models.

   Python 10.4k 2.8k

2. transformer_shmap transformer_shmap Public

   Tensor Parallelism with JAX + Shard Map

   Python 11 1

3. ZeRO-transformer ZeRO-transformer Public

   Two implementations of ZeRO-1 optimizer sharding in JAX

   Python 14

4. tritonformer tritonformer Public

   Trainable transformer with fwd+bwd ops in Triton, matching the performance of PyTorch + cuDNN/cuBLAS

   Python 7

5. hawk-pytorch hawk-pytorch Public

   PyTorch implementation of Hawk from "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models" (https://arxiv.org/abs/2402.19427). Compatible with torch.compile.

   Python 5

6. tiny-gemma tiny-gemma Public

   Fast single-threaded Gemma 3 CPU inference in C++

   C++