Hybrid Mamba-2 + Transformer 2.94B LLM (Nemotron-H style) — Korean 3B model pretrained from scratch on 7× NVIDIA B200 GPUs with SFT + DPO alignment
-
Updated
Mar 26, 2026 - Python
#
mamba2
Here are 4 public repositories matching this topic...
Hybrid SSM-Attention language model on Apple Silicon with MLX — interleaving Mamba-2 and Transformer for efficient inference
python machine-learning deep-learning transformer attention language-model ssm mamba hybrid-model mlx state-space-model apple-silicon llm mamba2
-
Updated
Mar 29, 2026 - Python
Improve this page
Add a description, image, and links to the mamba2 topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mamba2 topic, visit your repo's landing page and select "manage topics."