Pinned

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 19.7k 2.7k

2. neuralmagic/nm-vllm neuralmagic/nm-vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 206 7

3. flame/blis flame/blis Public

   BLAS-like Library Instantiation Software Framework

   C 2.1k 357

4. neuralmagic/deepsparse neuralmagic/deepsparse Public

   Sparsity-aware deep learning inference runtime for CPUs

   Python 2.9k 168