Support for local LLMs

[iwr-redmond]

It would be helpful to add a package like xllamacpp to facilitate local VLM inference rather than being reliant on the Google API.

The xllamacpp package supports Vulkan and MPS inference as well as CUDA. Sample inference code can be reviewed here.

[Creepybits]

Thank you for your suggestion. I will look into it as soon as I get a bit of free time, most likely this weekend.