Pinned Loading

1. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. deepspeedai/DeepSpeedExamples deepspeedai/DeepSpeedExamples Public

   Example models using DeepSpeed

   Python 6.4k 1.1k

4. hao-ai-lab/LookaheadDecoding hao-ai-lab/LookaheadDecoding Public

   [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

   Python 1.2k 74