feat: integrate Llama.cpp and enhance engine stability for cross-platform usage#616

Open

krishjp wants to merge 11 commits intoPrunaAI:mainfrom

krishjp:feat/llama-cpp

Commits on Apr 6, 2026

feat: implement llama.cpp algorithm
krishjp
committed
feat: llama.cpp conversion by forcing f16 for tiny models and bypass device checks for llama-cpp models due to a lack of model.parameters() support
krishjp
committed
fix: preserve enum membership for callables in engine to support Python 3.13
krishjp
committed
feat: integrate Llama.cpp and enhance engine stability for cross-platform usage
krishjp
committed
fix: integrity verification of remote scripts
krishjp
committed
fix: ruff typechecking and shutil.move on GGUF file handling
krishjp
committed
feat: updated llama support with rebased head branch commits
krishjp
committed