feat: wire gpu backend#1

Merged

mudler merged 8 commits into

mainfrom

feat/gpu-backend

May 29, 2026

Commits on May 29, 2026

build: propagate GPU backend choice to backend.cpp via RFDETR_USE_* defines

mudler
and
claude
committed
backend: add gpu backend + sched fields to BackendCtx

mudler
and
claude
committed
backend: init GPU backend + scheduler, weight buft accessor, sched compute
mudler
committed
init: realize weights on GPU backend buffer when a device is active
mudler
committed
forward: allocate + compute graphs through the backend scheduler
mudler
committed
test: GPU backend smoke test (skips on CPU-only builds)

mudler
and
claude
committed
docs: GPU offload is wired (CUDA/Metal/Vulkan/HIP); on-hardware validation pending

mudler
and
claude
committed
docs: GPU validated on NVIDIA GB10 — 23.6ms F16, 11.6x vs same-box CPU
mudler
committed