Skip to content

MimiTechAi/missi

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

99 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿค– MISSI โ€” Mistral Intelligent Super System Interface

A voice-first AI operating system powered by 6 specialized Mistral models, 28 autonomous tools, and 10,000+ integrations โ€” built for the Mistral AI Worldwide Hackathon 2026.

๐ŸŒ Live Demo ยท ๐ŸŽฌ Demo Video ยท ๐Ÿข MiMi Tech AI


What is MISSI?

MISSI is a voice-first AI operating system that understands you in 10 languages, intelligently routes every query to the optimal Mistral model, executes multi-step workflows autonomously, and responds with natural human-like speech.

Speak โ†’ MISSI routes to the best model โ†’ Executes tools autonomously โ†’ Speaks back naturally.

Why MISSI Stands Out

Feature MISSI Typical Chatbots
Model Selection 6 specialized Mistral models, auto-routed per query Single model
Voice Voxtral STT + ElevenLabs TTS, continuous conversation Text only or basic TTS
Tools 28 built-in + 10,000+ via Composio Limited or none
Languages 10 languages, auto-detected from browser English only
Integrations Gmail, Calendar, GitHub, Slack, Notion, Drive None or manual
Documents Professional HTML reports with charts & tables Plain text

๐Ÿง  6-Model Intelligent Routing

MISSI analyzes every message and selects the optimal Mistral model in real-time:

Query Type Model Trigger Examples
General intelligence mistral-large-latest ๐Ÿง  Research, analysis, questions
Fast responses mistral-small-latest โšก Greetings, simple queries
Deep reasoning magistral-medium-latest ๐Ÿงฎ Math, logic, proofs, comparisons
Creative writing mistral-medium-latest ๐ŸŽจ Stories, poems, creative content
Code generation codestral-latest ๐Ÿ’ป Programming, debugging, scripts
Image analysis pixtral-large-latest ๐Ÿ‘๏ธ Photo analysis, OCR, diagrams

Additional models used internally:

  • voxtral-small-latest โ€” Speech-to-text (Mistral-native STT)
  • mistral-ocr-latest โ€” Document OCR and analysis

๐Ÿ› ๏ธ 28 Agent Tools

Core Intelligence

Tool Description
web_search Real-time web search via Brave API
read_webpage Extract content from any URL
wikipedia Wikipedia knowledge in any language
news_headlines Latest news via Google News RSS
get_weather Weather + 3-day forecast (Open-Meteo)
get_time Current time in any timezone
get_location Browser geolocation

Finance & Data

Tool Description
get_stock_price Real-time stock prices (Yahoo Finance)
get_crypto_price Live crypto prices (CoinGecko)
calculate Mathematical computations
analyze_data Statistical analysis & pattern finding
unit_convert Temperature, length, weight, volume, speed, data
generate_chart Bar, line, pie, area charts (SVG)

Creation & Documents

Tool Description
run_code Execute JavaScript in sandbox
generate_code Production code via Codestral
create_document Professional HTML reports with tables & metrics
analyze_document OCR via mistral-ocr-latest
translate Multi-language translation
summarize_text Intelligent text summarization
define_word Dictionary with synonyms & examples
random_fact Curated facts & trivia

Integrations (Composio โ€” Permission-Gated)

Tool Description
search_gmail / read_gmail Gmail inbox search & reading
get_calendar Google Calendar events
get_github GitHub repos, issues, create issues
search_files Google Drive file search
set_reminder Browser notification reminders
change_voice Switch between 6 ElevenLabs voices

๐ŸŽ™๏ธ Voice System

MISSI's voice pipeline is designed for natural, continuous conversation:

  1. Voxtral STT โ€” Mistral-native speech-to-text (not browser APIs)
  2. Intelligent Processing โ€” Auto-routes to optimal model
  3. ElevenLabs TTS โ€” Full response spoken as continuous natural speech
  4. Auto-Relisten โ€” Immediately listens for your next input

Voice Features

  • Continuous Conversation โ€” Speak naturally back-and-forth
  • 10 Languages โ€” Auto-detected from browser, switchable in UI
  • 6 Switchable Voices โ€” Sarah, Aria, Rachel, Eric, Roger, Charlie
  • VoiceOrb Visualization โ€” Animated state indicator (idle โ†’ listening โ†’ thinking โ†’ speaking)
  • Keyboard Shortcuts โ€” Space (voice), Escape (stop), โŒ˜K (clear)

๐Ÿ“„ Canvas Panel

MISSI generates professional documents rendered in a side panel:

  • HTML Documents โ€” Styled reports with tables, metrics, charts
  • Traffic Light Controls โ€” Close (๐Ÿ”ด), minimize (๐ŸŸก), fullscreen (๐ŸŸข)
  • Download โ€” HTML or Markdown format
  • Print-Ready โ€” Optimized CSS for printing

Documents include CSS components: stat cards, info cards, comparison grids, progress bars, timelines, and data tables.


๐Ÿ”Œ 10,000+ Integrations (Composio)

One-click OAuth connection via Composio:

Integration Status Features
๐Ÿ“ง Gmail โœ… Connected Search, read, send emails
๐Ÿ“… Google Calendar โœ… Connected View, create, manage events
๐Ÿ™ GitHub โœ… Connected Repos, issues, create issues
๐Ÿ’ฌ Slack Available Messages, channels
๐Ÿ“ Notion Available Pages, databases
๐Ÿ“ Google Drive Available Files, sharing
โž• 10,000+ more Via Composio Managed OAuth & token refresh

๐ŸŒ Internationalization

MISSI auto-detects the browser language and switches the entire UI:

  • 10 Languages: ๐Ÿ‡ฉ๐Ÿ‡ช DE ยท ๐Ÿ‡บ๐Ÿ‡ธ EN ยท ๐Ÿ‡ซ๐Ÿ‡ท FR ยท ๐Ÿ‡ช๐Ÿ‡ธ ES ยท ๐Ÿ‡ฎ๐Ÿ‡น IT ยท ๐Ÿ‡ต๐Ÿ‡น PT ยท ๐Ÿ‡ฏ๐Ÿ‡ต JA ยท ๐Ÿ‡ฐ๐Ÿ‡ท KO ยท ๐Ÿ‡จ๐Ÿ‡ณ ZH ยท ๐Ÿ‡ท๐Ÿ‡บ RU
  • Welcome screen, badges, placeholders, footer โ€” all localized
  • AI responses match the selected language
  • TTS automatically selects the optimal voice model per language

๐Ÿ—๏ธ Architecture

โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚            MISSI Frontend (Next.js 16)          โ”‚
โ”‚  VoiceOrb โ† Web Audio API โ† ElevenLabs TTS     โ”‚
โ”‚  Voxtral STT โ†’ Chat โ†’ Vision โ†’ Canvas Panel    โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                       โ”‚ SSE Streaming
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚          Intelligent Model Router                โ”‚
โ”‚    Query Analysis โ†’ Optimal Model Selection      โ”‚
โ”‚  โšกsmall ๐Ÿง large ๐Ÿ’ปcodestral ๐Ÿ‘๏ธpixtral ๐Ÿงฎmagistral ๐ŸŽจmedium โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                       โ”‚
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚        Autonomous Planning Engine                โ”‚
โ”‚    Task Decomposition โ†’ Multi-Step Execution     โ”‚
โ”‚    Up to 8 rounds ร— 28 tools                    โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”ฌโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜
                       โ”‚
โ”Œโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ–ผโ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”
โ”‚     28 Built-in Tools + 10,000+ via Composio    โ”‚
โ”‚  Searchโ”‚Weatherโ”‚Codeโ”‚Financeโ”‚Docsโ”‚Gmailโ”‚GitHubโ”‚โ€ฆ โ”‚
โ””โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”€โ”˜

๐Ÿš€ Tech Stack

Layer Technology
Frontend Next.js 16.1.6, React 19, TypeScript, Tailwind CSS 4
AI Models Mistral AI SDK 1.14.1 (6 models + intelligent routing)
Speech-to-Text Voxtral Small (Mistral-native)
Text-to-Speech ElevenLabs (Turbo v2.5 + Multilingual v2)
Integrations Composio V3 Tool Router Session API
Charts Custom SVG generation engine
Markdown react-markdown + remark-gfm
Deployment Vercel

๐Ÿƒ Quick Start

git clone https://github.com/MimiTechAi/missi.git
cd missi
npm install

# Configure environment
cp .env.example .env.local
# Add your API keys (see below)

npm run dev
# Open http://localhost:3000

Environment Variables

MISTRAL_API_KEY=your_mistral_api_key
ELEVENLABS_API_KEY=your_elevenlabs_api_key
COMPOSIO_API_KEY=your_composio_api_key    # Optional: for Gmail, Calendar, GitHub

๐Ÿ† Hackathon Categories

  • ๐ŸŒ Global Winner โ€” Full Mistral ecosystem: 6 models + 28 tools + autonomous planning
  • ๐ŸŽ™๏ธ Best Voice Use Case (ElevenLabs) โ€” Continuous voice conversation in 10 languages
  • ๐Ÿค– Best Use of Agent Skills โ€” 28 tools with multi-step autonomous execution
  • ๐Ÿ”— Best Integration (Composio) โ€” Gmail, Calendar, GitHub + 10,000+ tools

๐Ÿ‘ฅ Team

MiMi Tech AI โ€” Michael Bemler & Michael Soppa

๐ŸŒ mimitechai.com ยท ๐Ÿ™ github.com/MimiTechAi


๐Ÿ“„ License

MIT


Built with โค๏ธ for the Mistral AI Worldwide Hackathon 2026

About

MISSI - Mistral Intelligent System for Seamless Interaction | Voice-first AI with 21 tools, 4 Mistral models, ElevenLabs TTS

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors