Support llama.cpp tuning and multi-GPU

[nullnuller]

Wonder why it can't be directly used with llama.cpp?
Also, it would be great to have multi-GPU support.

[Viceman256]

Hey @nullnuller just to keep you updated, these are both on the roadmap!