I'm attempting to use a headless server with a K80 as my main AI box, but this doesn't really seem possible at the moment with lms and llmster. lms is missing many of the features of the desktop app, or is missing documentation for such features, which basically means they don't exist. The only options for lms server are start, stop, and status. Things that I can do on desktop but seemingly not with lms:
- set the server port number
- manage api keys
- enable/disable authentication
- enable/disable serving on the local network, which seems to be necessary for other PC's to be able to use the API
- manage mcp servers (I did find the mcp.json file, so seemingly that exists but I didn't see documented anywhere)
- enable/disable api calls to said MCP servers
- enable/disable JIT model loading
- set the TTL for JIT model loading
- enable/disable CORS
Is there some config file somewhere I'm missing?
thanks!
I'm attempting to use a headless server with a K80 as my main AI box, but this doesn't really seem possible at the moment with lms and llmster. lms is missing many of the features of the desktop app, or is missing documentation for such features, which basically means they don't exist. The only options for
lms serverare start, stop, and status. Things that I can do on desktop but seemingly not with lms:Is there some config file somewhere I'm missing?
thanks!