#

speculative-decode

Here is 1 public repository matching this topic...

Tom1tk / pflash-turboquant-hip

PFlash speculative prefill + TurboQuant KV cache compression for llama.cpp — HIP/ROCm port for AMD RDNA3 (gfx1100)

hip rocm llama-cpp pflash speculative-decode

Updated May 7, 2026
C++

Improve this page

Add a description, image, and links to the speculative-decode topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the speculative-decode topic, visit your repo's landing page and select "manage topics."