Skip to content

Releases: SharpAI/llama-server-build

Release list

llama-server b9982

llama-server b9982

Choose a tag to compare

View all tags
@github-actions github-actions released this 13 Jul 08:35
b9982
3f014d5

Pre-built llama-server binaries from llama.cpp b9982.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9878

llama-server b9878

Choose a tag to compare

View all tags
@github-actions github-actions released this 06 Jul 09:55
b9878
3f014d5

Pre-built llama-server binaries from llama.cpp b9878.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9838

llama-server b9838

Choose a tag to compare

View all tags
@github-actions github-actions released this 29 Jun 10:33
b9838
3f014d5

Pre-built llama-server binaries from llama.cpp b9838.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9756

llama-server b9756

Choose a tag to compare

View all tags
@github-actions github-actions released this 22 Jun 11:24
b9756
3f014d5

Pre-built llama-server binaries from llama.cpp b9756.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9642

llama-server b9642

Choose a tag to compare

View all tags
@github-actions github-actions released this 15 Jun 11:58
b9642
3f014d5

Pre-built llama-server binaries from llama.cpp b9642.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9553

llama-server b9553

Choose a tag to compare

View all tags
@github-actions github-actions released this 08 Jun 10:28
b9553
3f014d5

Pre-built llama-server binaries from llama.cpp b9553.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9305

llama-server b9305

Choose a tag to compare

View all tags
@github-actions github-actions released this 25 May 09:53
b9305
3f014d5

Pre-built llama-server binaries from llama.cpp b9305.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9204

llama-server b9204

Choose a tag to compare

View all tags
@github-actions github-actions released this 18 May 09:37
b9204
3f014d5

Pre-built llama-server binaries from llama.cpp b9204.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b9102

llama-server b9102

Choose a tag to compare

View all tags
@github-actions github-actions released this 11 May 09:16
b9102
3f014d5

Pre-built llama-server binaries from llama.cpp b9102.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading

llama-server b8943

llama-server b8943

Choose a tag to compare

View all tags
@github-actions github-actions released this 27 Apr 07:49
b8943
3f014d5

Pre-built llama-server binaries from llama.cpp b8943.

Downloads — Linux

Variant File
x64 CPU llama-server-*-linux-x64-cpu.tar.gz
x64 CUDA 12.8 llama-server-*-linux-x64-cuda-12.tar.gz
x64 CUDA 13.1 llama-server-*-linux-x64-cuda-13.tar.gz
x64 Vulkan llama-server-*-linux-x64-vulkan.tar.gz
arm64 CPU llama-server-*-linux-arm64-cpu.tar.gz
arm64 CUDA 12.8 llama-server-*-linux-arm64-cuda-12.tar.gz
arm64 CUDA 13.1 llama-server-*-linux-arm64-cuda-13.tar.gz

Downloads — Windows

Variant File
x64 CPU llama-server-*-windows-x64-cpu.zip
x64 CUDA 12.4 llama-server-*-windows-x64-cuda-12.zip
x64 Vulkan llama-server-*-windows-x64-vulkan.zip

Downloads — macOS

Variant File
arm64 Metal llama-server-*-macos-arm64-metal.tar.gz
x64 CPU llama-server-*-macos-x64-cpu.tar.gz

CUDA SM targets: 75;80;86;89;90;100;120

Loading