Pinned Loading

1. opensoul opensoul Public

   Your AI Soul Companion. Self-hosted AI agent across 30+ messaging channels It can not only serve as an emotional companion in daily life (such as a lover or friend), but also help you complete vari…

   TypeScript 51 6

2. vllm-project/semantic-router vllm-project/semantic-router Public

   Intelligent Mixture-of-Models Router for Efficient Heterogeneous LLMs Inference

   Go 4.9k 745

3. microgpt microgpt Public template

   🔬 The most atomic GPT-2 implementation in 265 lines of pure Python & CUDA. A bilingual "Rosetta Stone" for understanding LLM internals from scratch. No dependencies, just math and kernels.

   HTML 22

4. vllm-project/vllm-ascend vllm-project/vllm-ascend Public

   Community maintained hardware plugin for vLLM on Ascend

   C++ 2.5k 1.7k

5. Dao-AILab/flash-attention Dao-AILab/flash-attention Public

   Fast and memory-efficient exact attention

   Python 24.4k 2.9k

6. nanoGPT nanoGPT Public

   Forked from karpathy/nanoGPT

   The simplest, fastest repository for training/finetuning medium-sized GPTs.

   Python