Apiary is an open-source LLM Gateway for managing requests across leading providers. It routes all LLM requests through a single API endpoint, simplifying access to multiple models with a unified API, centralized management of features like routing, caching, and guardrails, and built-in observability.
Apiary includes pre-configured serverless infrastructure that can be deployed with minimal setup. It runs entirely within your own AWS account, ensuring full control over your data.
To learn more about Apiary, please refer to our in-depth case study.
- Provision Your Infrastructure - Apiary's CLI tool facilitates easy deployment of its AWS infrastructure. Follow the setup instructions in our installation guide.
- Send LLM Requests - Use Apiary's SDK in your applications to easily send client requests to multiple LLM providers.
For a detailed dive into the Apiary app, please read our case study.