A lightweight, unified dashboard and reporting tool powered by OmniRoute — The Free AI Gateway.
Connect to 237+ AI providers through a single endpoint. Generate code, chat with models, and automate beautiful Markdown reports—all while saving up to 95% of your tokens using OmniRoute's built-in compression.
(Note: To install the core OmniRoute gateway itself, please clone the official OmniRoute repo or install via npm install -g omniroute)
You can run this entire project locally in under 2 minutes.
pip install -r requirements.txtProgrammatically generate an automated report via OmniRoute:
python generate_report.pyStart the Streamlit explorer to chat interactively with OmniRoute:
streamlit run app.py- Python: Core logic and scripting.
- Streamlit: Fast, responsive frontend for the visual AI explorer.
- OpenAI SDK: Communicates natively with OmniRoute via its OpenAI-compatible
/v1endpoint.
README.md: The document you are reading; setup and project overview.requirements.txt: Contains minimal dependencies (openai,streamlit).app.py: The visual Streamlit dashboard for interactive OmniRoute querying.generate_report.py: A command-line script that queries OmniRoute to generate a formatted Markdown report.outputs.md: The generated visual report showing AI analysis results.
- Unified AI Benchmarking: Test different models (via OmniRoute's
autorouting) on the same prompt without changing API keys. - Automated Code Reviews: Use
generate_report.pyin a CI/CD pipeline to generate markdown PR reviews. - Token-Optimized Chats: Chat through
app.pyleveraging OmniRoute's Caveman compression for cost savings. - Resilient AI Pipelines: Build scripts that never fail due to rate limits by utilizing OmniRoute's 4-tier fallback system.
- Local-First Development: Develop AI features locally against
localhost:20128without worrying about cloud latency or internet drops.
- Multi-Model Comparison View: A split-screen UI in Streamlit to compare answers from two different models simultaneously.
- Cost & Token Analytics Panel: Visualize the token savings achieved by OmniRoute's compression in real-time.
- Custom System Prompt Library: Allow users to save and load different system prompts for coding, writing, or analysis.
- PDF/Document Parsing: Upload documents in Streamlit and have OmniRoute process and summarize them.
- Streaming Report Generation: Stream the markdown report generation live to the console instead of waiting for the full response.