install.md

Install pre-built version of llama.cpp

Install via	Windows	Mac	Linux
Winget	✅
Homebrew		✅	✅
MacPorts		✅
Nix		✅	✅

Winget (Windows)

winget install llama.cpp

The package is automatically updated with new llama.cpp releases. More info: ggml-org/llama.cpp#8188

Homebrew (Mac and Linux)

brew install llama.cpp

The formula is automatically updated with new llama.cpp releases. More info: ggml-org/llama.cpp#7668

MacPorts (Mac)

sudo port install llama.cpp

See also: https://ports.macports.org/port/llama.cpp/details/

Nix (Mac and Linux)

nix profile install nixpkgs#llama-cpp

For flake enabled installs.

Or

nix-env --file '<nixpkgs>' --install --attr llama-cpp

For non-flake enabled installs.

This expression is automatically updated within the nixpkgs repo.