An open-source cloud-native of large multi-modal models (LMMs) serving framework.
-
Updated
Sep 5, 2023 - Python
An open-source cloud-native of large multi-modal models (LMMs) serving framework.
A lightweight, self-hosted autonomous coding agent runtime powered by Ollama, designed for tool-calling, streaming, and real-world code execution — all running on Kaggle
Use local Large Language Models for production use cases, and perform benchmarking for task-specific performance evaluation across models.
Find the request volume where self-hosting an open LLM beats paying a proprietary API — with a cost-vs-volume crossover chart.
Add a description, image, and links to the llm-hosting topic page so that developers can more easily learn about it.
To associate your repository with the llm-hosting topic, visit your repo's landing page and select "manage topics."