ChefChef — Turn YouTube Cooking Videos into Hands-Free Recipes

AI Cooking Agent · Voice Control · Real-Time Q&A · Instant Translation

Website · App Store · Google Play

English · 日本語 · 한국어 · 繁體中文 · 简体中文

---

The Problem

You find an amazing cooking video on YouTube. You start cooking. Then:

• 🔁 Constant pausing — hands are wet, tapping the screen every 30 seconds
• 🤷 Lost in the video — "Wait, how much soy sauce was that?"
• 🌍 Language barrier — great recipe, but it's in Japanese

YouTube is built for watching. Not for cooking.

The Solution

ChefChef is an AI Cooking Agent that transforms any YouTube cooking video into an interactive, hands-free cooking experience.

Paste a YouTube link → get structured steps → cook with voice control.

Features

🎬 Video → Structured Recipe Steps

AI analyzes the video and extracts precise ingredients, measurements, cooking steps, and timestamps — all synced with the original video. No more rewinding.

🎙️ Voice Control & AI Q&A

Cook hands-free. Say "next step" to advance, or ask questions mid-recipe:

"Can I substitute butter for oil?" "How do I know when the onions are ready?"

ChefChef knows which step you're on and gives context-aware answers — like having a chef standing next to you.

🌍 Instant Translation (5 Languages)

Discover recipes from Japanese, Korean, Chinese, and English-speaking YouTube creators — all translated into your language.

Language	Status
🇺🇸 English	✅ Supported
🇯🇵 Japanese	✅ Supported
🇰🇷 Korean	✅ Supported
🇹🇼 Traditional Chinese	✅ Supported
🇨🇳 Simplified Chinese	✅ Supported

📱 Mobile-First Experience

The mobile app is where the magic happens — optimized for kitchen use:

• Voice-first navigation — no touching the screen with messy hands
• Step auto-follow — the recipe advances as you cook
• Offline-friendly — recipes are cached for kitchen use
• Smart reminders — integrates with iOS Reminders for meal planning

How It Works

1. Find a recipe      →  Search on ChefChef or paste any YouTube cooking URL
2. AI extracts steps  →  Ingredients, steps, timing — all structured automatically
3. Cook hands-free    →  Voice control, ask questions, translate — all in real-time

Tech Stack

Layer	Technology
Web	Next.js 15, React 19, TypeScript, Tailwind CSS
Mobile	React Native (Expo SDK 54)
Backend	Supabase (PostgreSQL + Auth)
AI / LLM	Qwen (Alibaba), DeepSeek, GLM-4 (Zhipu AI), Moonshot (Kimi), OpenAI GPT, Claude (Anthropic), Gemini, Mistral
Speech & NLP	Azure AI Speech, OpenAI Whisper, Google Cloud Speech-to-Text
Deployment	Vercel (web), EAS Build (mobile)
i18n	5 languages, fully localized UI + content

Architecture

ChefChef is a cross-platform application with shared business logic:

┌──────────────────────────────────────────────────┐
│                    Clients                        │
│                                                   │
│   ┌─────────────┐          ┌──────────────────┐  │
│   │   Web App   │          │   Mobile App     │  │
│   │  (Next.js)  │          │ (React Native)   │  │
│   │  chefchef.  │          │  iOS / Android   │  │
│   │    app      │          │                  │  │
│   └──────┬──────┘          └────────┬─────────┘  │
│          │                          │             │
│          └──────────┬───────────────┘             │
│                     │                             │
│            ┌────────▼────────┐                    │
│            │  Shared Module  │                    │
│            │  (@shared/)     │                    │
│            └────────┬────────┘                    │
└─────────────────────┼────────────────────────────┘
                      │
         ┌────────────▼────────────┐
         │      Supabase           │
         │  PostgreSQL + Auth      │
         └────────────┬────────────┘
                      │
         ┌────────────▼────────────┐
         │   AI Orchestration      │
         │                         │
         │  ┌───────────────────┐  │
         │  │  LLM Router       │  │
         │  │  (Multi-Provider) │  │
         │  └────────┬──────────┘  │
         │           │             │
         │  ┌────────▼──────────┐  │
         │  │ Qwen · DeepSeek   │  │
         │  │ GLM-4 · Moonshot  │  │
         │  │ GPT · Claude      │  │
         │  │ Gemini · Mistral  │  │
         │  └────────┬──────────┘  │
         │           │             │
         │  ┌────────▼──────────┐  │
         │  │  Speech Engine    │  │
         │  │  Azure · Whisper  │  │
         │  │  Cloud STT        │  │
         │  └───────────────────┘  │
         └─────────────────────────┘

What's Open Source

This repository contains selected UI components and localization files from ChefChef. Our AI engine, backend services, and core infrastructure remain proprietary.

Contributing

We welcome contributions! See CONTRIBUTING.md for guidelines.

Areas where contributions are especially welcome:

• 🌍 Translations — Help us support more languages
• 🎨 UI improvements — Better accessibility, design tweaks
• 🐛 Bug reports — Found something off? Let us know
• 📖 Documentation — Help others understand the codebase

Links

Resource	URL
🌐 Website	www.chefchef.app
📱 iOS App	App Store
🤖 Android App	Google Play
🐛 Bug Reports	GitHub Issues

License

This project is licensed under the MIT License.

---

YouTube is for watching. ChefChef is for cooking.

Try ChefChef Free →