A voice-first AI operating system powered by 6 specialized Mistral models, 28 autonomous tools, and 10,000+ integrations โ built for the Mistral AI Worldwide Hackathon 2026.
๐ Live Demo ยท ๐ฌ Demo Video ยท ๐ข MiMi Tech AI
MISSI is a voice-first AI operating system that understands you in 10 languages, intelligently routes every query to the optimal Mistral model, executes multi-step workflows autonomously, and responds with natural human-like speech.
Speak โ MISSI routes to the best model โ Executes tools autonomously โ Speaks back naturally.
| Feature | MISSI | Typical Chatbots |
|---|---|---|
| Model Selection | 6 specialized Mistral models, auto-routed per query | Single model |
| Voice | Voxtral STT + ElevenLabs TTS, continuous conversation | Text only or basic TTS |
| Tools | 28 built-in + 10,000+ via Composio | Limited or none |
| Languages | 10 languages, auto-detected from browser | English only |
| Integrations | Gmail, Calendar, GitHub, Slack, Notion, Drive | None or manual |
| Documents | Professional HTML reports with charts & tables | Plain text |
MISSI analyzes every message and selects the optimal Mistral model in real-time:
| Query Type | Model | Trigger Examples |
|---|---|---|
| General intelligence | mistral-large-latest ๐ง |
Research, analysis, questions |
| Fast responses | mistral-small-latest โก |
Greetings, simple queries |
| Deep reasoning | magistral-medium-latest ๐งฎ |
Math, logic, proofs, comparisons |
| Creative writing | mistral-medium-latest ๐จ |
Stories, poems, creative content |
| Code generation | codestral-latest ๐ป |
Programming, debugging, scripts |
| Image analysis | pixtral-large-latest ๐๏ธ |
Photo analysis, OCR, diagrams |
Additional models used internally:
voxtral-small-latestโ Speech-to-text (Mistral-native STT)mistral-ocr-latestโ Document OCR and analysis
| Tool | Description |
|---|---|
web_search |
Real-time web search via Brave API |
read_webpage |
Extract content from any URL |
wikipedia |
Wikipedia knowledge in any language |
news_headlines |
Latest news via Google News RSS |
get_weather |
Weather + 3-day forecast (Open-Meteo) |
get_time |
Current time in any timezone |
get_location |
Browser geolocation |
| Tool | Description |
|---|---|
get_stock_price |
Real-time stock prices (Yahoo Finance) |
get_crypto_price |
Live crypto prices (CoinGecko) |
calculate |
Mathematical computations |
analyze_data |
Statistical analysis & pattern finding |
unit_convert |
Temperature, length, weight, volume, speed, data |
generate_chart |
Bar, line, pie, area charts (SVG) |
| Tool | Description |
|---|---|
run_code |
Execute JavaScript in sandbox |
generate_code |
Production code via Codestral |
create_document |
Professional HTML reports with tables & metrics |
analyze_document |
OCR via mistral-ocr-latest |
translate |
Multi-language translation |
summarize_text |
Intelligent text summarization |
define_word |
Dictionary with synonyms & examples |
random_fact |
Curated facts & trivia |
| Tool | Description |
|---|---|
search_gmail / read_gmail |
Gmail inbox search & reading |
get_calendar |
Google Calendar events |
get_github |
GitHub repos, issues, create issues |
search_files |
Google Drive file search |
set_reminder |
Browser notification reminders |
change_voice |
Switch between 6 ElevenLabs voices |
MISSI's voice pipeline is designed for natural, continuous conversation:
- Voxtral STT โ Mistral-native speech-to-text (not browser APIs)
- Intelligent Processing โ Auto-routes to optimal model
- ElevenLabs TTS โ Full response spoken as continuous natural speech
- Auto-Relisten โ Immediately listens for your next input
- Continuous Conversation โ Speak naturally back-and-forth
- 10 Languages โ Auto-detected from browser, switchable in UI
- 6 Switchable Voices โ Sarah, Aria, Rachel, Eric, Roger, Charlie
- VoiceOrb Visualization โ Animated state indicator (idle โ listening โ thinking โ speaking)
- Keyboard Shortcuts โ Space (voice), Escape (stop), โK (clear)
MISSI generates professional documents rendered in a side panel:
- HTML Documents โ Styled reports with tables, metrics, charts
- Traffic Light Controls โ Close (๐ด), minimize (๐ก), fullscreen (๐ข)
- Download โ HTML or Markdown format
- Print-Ready โ Optimized CSS for printing
Documents include CSS components: stat cards, info cards, comparison grids, progress bars, timelines, and data tables.
One-click OAuth connection via Composio:
| Integration | Status | Features |
|---|---|---|
| ๐ง Gmail | โ Connected | Search, read, send emails |
| ๐ Google Calendar | โ Connected | View, create, manage events |
| ๐ GitHub | โ Connected | Repos, issues, create issues |
| ๐ฌ Slack | Available | Messages, channels |
| ๐ Notion | Available | Pages, databases |
| ๐ Google Drive | Available | Files, sharing |
| โ 10,000+ more | Via Composio | Managed OAuth & token refresh |
MISSI auto-detects the browser language and switches the entire UI:
- 10 Languages: ๐ฉ๐ช DE ยท ๐บ๐ธ EN ยท ๐ซ๐ท FR ยท ๐ช๐ธ ES ยท ๐ฎ๐น IT ยท ๐ต๐น PT ยท ๐ฏ๐ต JA ยท ๐ฐ๐ท KO ยท ๐จ๐ณ ZH ยท ๐ท๐บ RU
- Welcome screen, badges, placeholders, footer โ all localized
- AI responses match the selected language
- TTS automatically selects the optimal voice model per language
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ MISSI Frontend (Next.js 16) โ
โ VoiceOrb โ Web Audio API โ ElevenLabs TTS โ
โ Voxtral STT โ Chat โ Vision โ Canvas Panel โ
โโโโโโโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ SSE Streaming
โโโโโโโโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ Intelligent Model Router โ
โ Query Analysis โ Optimal Model Selection โ
โ โกsmall ๐ง large ๐ปcodestral ๐๏ธpixtral ๐งฎmagistral ๐จmedium โ
โโโโโโโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ Autonomous Planning Engine โ
โ Task Decomposition โ Multi-Step Execution โ
โ Up to 8 rounds ร 28 tools โ
โโโโโโโโโโโโโโโโโโโโโโโโฌโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ
โโโโโโโโโโโโโโโโโโโโโโโโผโโโโโโโโโโโโโโโโโโโโโโโโโโโ
โ 28 Built-in Tools + 10,000+ via Composio โ
โ SearchโWeatherโCodeโFinanceโDocsโGmailโGitHubโโฆ โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโ
| Layer | Technology |
|---|---|
| Frontend | Next.js 16.1.6, React 19, TypeScript, Tailwind CSS 4 |
| AI Models | Mistral AI SDK 1.14.1 (6 models + intelligent routing) |
| Speech-to-Text | Voxtral Small (Mistral-native) |
| Text-to-Speech | ElevenLabs (Turbo v2.5 + Multilingual v2) |
| Integrations | Composio V3 Tool Router Session API |
| Charts | Custom SVG generation engine |
| Markdown | react-markdown + remark-gfm |
| Deployment | Vercel |
git clone https://github.com/MimiTechAi/missi.git
cd missi
npm install
# Configure environment
cp .env.example .env.local
# Add your API keys (see below)
npm run dev
# Open http://localhost:3000MISTRAL_API_KEY=your_mistral_api_key
ELEVENLABS_API_KEY=your_elevenlabs_api_key
COMPOSIO_API_KEY=your_composio_api_key # Optional: for Gmail, Calendar, GitHub- ๐ Global Winner โ Full Mistral ecosystem: 6 models + 28 tools + autonomous planning
- ๐๏ธ Best Voice Use Case (ElevenLabs) โ Continuous voice conversation in 10 languages
- ๐ค Best Use of Agent Skills โ 28 tools with multi-step autonomous execution
- ๐ Best Integration (Composio) โ Gmail, Calendar, GitHub + 10,000+ tools
MiMi Tech AI โ Michael Bemler & Michael Soppa
๐ mimitechai.com ยท ๐ github.com/MimiTechAi
MIT
Built with โค๏ธ for the Mistral AI Worldwide Hackathon 2026