Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
49 commits
Select commit Hold shift + click to select a range
c782ccd
better site
a0d00kc Feb 14, 2026
f5d68f2
Merge branch 'develop' of github.com:Meesho/BharatMLStack into docs/s…
a0d00kc Feb 14, 2026
dba9bb5
Merge pull request #318 from Meesho/docs/slig-fix
a0d00kc Feb 14, 2026
0f25b5c
Merge pull request #319 from Meesho/develop
a0d00kc Feb 14, 2026
5a6a3f8
fix
a0d00kc Feb 14, 2026
6ca1029
Merge pull request #320 from Meesho/develop
a0d00kc Feb 14, 2026
6c10077
fix
a0d00kc Feb 14, 2026
e35adf5
Merge pull request #321 from Meesho/develop
a0d00kc Feb 14, 2026
550ebee
Predator Components Docs
hjmeesho Feb 15, 2026
24a1240
predator docs
hjmeesho Feb 15, 2026
b582fb9
category json for all components
hjmeesho Feb 15, 2026
ca29554
package json changes
hjmeesho Feb 15, 2026
6c324cb
FIxing category json for version v1.0.0
Feb 15, 2026
2a8a615
version and image predator fix
hjmeesho Feb 15, 2026
43e3d4b
Added description of architechture for predator
Feb 15, 2026
bd3c9ec
go client for inferflow
Feb 15, 2026
5a0541a
primary theme updated
hjmeesho Feb 15, 2026
18d57fc
update readme
Feb 15, 2026
cd886c9
primary color changes
hjmeesho Feb 15, 2026
54973e9
refactor caller id
Feb 15, 2026
b2a9b62
update readme
Feb 15, 2026
5e48649
sync refactor
Feb 15, 2026
bd91840
changed background color with the theme
hjmeesho Feb 15, 2026
d1355c0
Changes the color based on theme
hjmeesho Feb 15, 2026
e02073d
Merge pull request #324 from Meesho/ft/inferflow_client
a0d00kc Feb 15, 2026
af76468
Merge pull request #323 from Meesho/feat/predator-docs
a0d00kc Feb 15, 2026
28fa764
Merge pull request #325 from Meesho/develop
a0d00kc Feb 15, 2026
dc32eb4
helm
a0d00kc Feb 16, 2026
893c9fa
Merge branch 'develop' into feat/helm-chart
a0d00kc Feb 16, 2026
1fadff5
fix
a0d00kc Feb 16, 2026
74f5ecb
fix
a0d00kc Feb 16, 2026
911ea63
Merge pull request #326 from Meesho/feat/helm-chart
a0d00kc Feb 16, 2026
8f8413e
Merge pull request #327 from Meesho/develop
a0d00kc Feb 16, 2026
609ba7a
fix readme
a0d00kc Feb 16, 2026
7047ec1
Merge pull request #328 from Meesho/fix/skye-readme
a0d00kc Feb 16, 2026
64745af
fix
a0d00kc Feb 16, 2026
5174bbb
logo fix
a0d00kc Feb 16, 2026
d4dbe73
fix
a0d00kc Feb 16, 2026
866df3f
fix
a0d00kc Feb 16, 2026
99ae33d
fix
a0d00kc Feb 16, 2026
9c20c2e
fix
a0d00kc Feb 16, 2026
b5d1494
fix
a0d00kc Feb 16, 2026
c437568
fix
a0d00kc Feb 16, 2026
94b6cad
fix
a0d00kc Feb 16, 2026
d13ee3a
fix
a0d00kc Feb 16, 2026
365d902
Merge pull request #329 from Meesho/fix/base-readme
a0d00kc Feb 16, 2026
e7f7e77
Merge pull request #330 from Meesho/develop
a0d00kc Feb 16, 2026
4d891d1
Merge pull request #332 from Meesho/feat/doc-links
Adit2607 Feb 16, 2026
ab168c7
Merge pull request #332 from Meesho/feat/doc-links (#333)
Adit2607 Feb 16, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
160 changes: 68 additions & 92 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,9 @@
# BharatMLStack

<div align="center">
<img src="assets/bharatmlstack.jpg" alt="BharatMLStack Logo" width="400"/>
<picture>
<source media="(prefers-color-scheme: dark)" srcset="assets/bharatmlstack-logo.png" />
<source media="(prefers-color-scheme: light)" srcset="assets/bharatmlstack-logo.png" />
<img src="assets/bharatmlstack-logo.png" alt="BharatMLStack" width="100%"/>
</picture>
</div>


Expand All @@ -20,131 +22,105 @@

## What is BharatMLStack?

BharatMLStack is a comprehensive, production-ready machine learning infrastructure platform designed to democratize ML capabilities across India and beyond. Our mission is to provide a robust, scalable, and accessible ML stack that empowers organizations to build, deploy, and manage machine learning solutions at massive scale.
BharatMLStack is a production-ready, cloud-agnostic ML infrastructure platform that powers real-time feature serving, model inference, and embedding search at massive scale. Built and battle-tested at [Meesho](https://meesho.com), it is designed to help organizations ship ML to production faster, cheaper, and more reliably.

## Our Vision

- 🎯 **Democratize Machine Learning**: Make advanced ML infrastructure accessible to organizations of all sizes
- 🚀 **Scale Without Limits**: Built to handle millions of requests per second with enterprise-grade reliability
- 🇮🇳 **Bharat-First Approach**: Optimized for Indian market needs while maintaining global standards
- ⚡ **Real-Time Intelligence**: Enable instant decision-making with sub-millisecond feature serving
- 🔧 **Developer-Friendly**: Intuitive APIs and interfaces that accelerate ML development cycles
BharatMLStack is built around **four core tenets**:

## Star History
### Workflow Integration & Productivity
> Ship ML to production faster than ever.

[![Star History Chart](https://api.star-history.com/svg?repos=Meesho/BharatMLStack&type=Date)](https://www.star-history.com/#Meesho/BharatMLStack&Date)
- **3x faster** experiment-to-deployment cycles
- **95% reduction** in model onboarding time

## Running at Million Scale
### Cloud-Agnostic & Lock-In Free
> Run anywhere. Own your stack.

BharatMLStack is battle-tested in production environments, powering:
- **1M+ feature vector retrievals per second** across distributed deployments
- **Sub-10ms latency** for real-time feature retrieval
- **99.99% uptime** with auto-scaling and fault tolerance
- **Petabyte-scale** feature storage and processing
- **Multi-region deployments** with global load balancing
- Runs across **public cloud, on-prem, and edge**
- Kubernetes-native with zero vendor lock-in

## Document
- [Doc](https://meesho.github.io/BharatMLStack/)
- [Blogs](https://meesho.github.io/BharatMLStack/blog)
## Core Components
### Economic Efficiency
> Do more with less.

### 📋 Current Releases

| Component | Version | Description |
|-----------|---------|-------------|
| 🚀 **Horizon** | `v1.0.0` | Control Plane & Backend |
| 🎨 **Trufflebox UI** | `v1.0.0` | ML Management Console |
| 🗄️ **Online Feature Store** | `v1.0.0` | Real-Time Features |
| 🐹 **Go SDK** | `v1.0.0` | Go Client Library |
| 🐍 **Python SDK** | `v1.0.1` | Python Client Library |
| 🚀 **Numerix** | `v1.0.0` | Mathematical Compute Engine |

### 🚀 Horizon - Control Plane & Backend
The central control plane for BharatMLStack components, serving as the backend for Trufflebox UI.
- **Component orchestration**: Manages and coordinates all BharatMLStack services
- **API gateway**: Unified interface for all MLOps and workflows

### 🎨 Trufflebox UI - ML Management Console
Modern web interface for managing ML models, features, and experiments. Currently it supports:
- **Feature Registry**: Centralized repository for feature definitions and metadata
- **Feature Cataloging**: Discovery and search capabilities for available features
- **Online Feature Store Control System**: Management interface for feature store operations
- **Approval Flows**: Workflow management for feature deployment and changes

### 🗄️ Online Feature Store - Real-Time Features
High-performance feature store for real-time ML inference and training.
- **Real-time serving**: Sub-10ms feature retrieval at scale
- **Streaming ingestion**: Process millions of feature updates per second
- **Feature Backward Compatible Versioning**: Track and manage feature evolution
- **Multi-source integration**: Push from stream, batch and real-time sources

### 🗄️ Numerix - Mathematical Compute Engine
High-performance feature store for real-time ML inference and training.
- **Matrix Operations**: High-performance matrix computations and transformations
- **gRPC API**: Fast binary protocol for efficient data transfer
- **Multi-format Support**: String and byte-based matrix formats
- **Optimized Performance**: Built with Rust for maximum efficiency
- **Scalable Architecture**: Designed for distributed processing

## Key Differentiators

- ✨ **Production-Ready**: Battle-tested components used in high-traffic production systems
- 🌐 **Cloud Agnostic**: Kubernetes-native, so deploy on the cloud you love
- 📊 **Observability**: Built-in monitoring, logging
- **60–70% lower** infrastructure costs vs hyperscaler managed services
- Optimized resource utilization across CPU and GPU workloads

## Quick Start
### Availability & Scalability
> Enterprise-grade reliability at internet scale.

🚀 **Get started with BharatMLStack in minutes!**
- **99.99% uptime** across clusters
- **1M+ QPS** with low latency

For comprehensive setup instructions, examples, and deployment guides, see our detailed Quick Start documentation:
## Designed Truly for Bharat Scale

📖 **[Quick Start Guide →](./quick-start/README.md)**
Built for the demands of one of the world's largest e-commerce platforms:

### What You'll Find:
| Metric | Performance |
|--------|-------------|
| **Feature Store** | 2.4M QPS (batch of 100 id lookups) |
| **Model Inference** | 1M+ QPS |
| **Embedding Search** | 500K QPS |
| **Feature Retrieval Latency** | Sub-10ms |

- **🐳 Docker Setup**: Complete stack deployment with Docker Compose
- **📊 Sample Data**: Pre-configured examples to get you started
- **🔍 Health Checks**: Verify your deployment is working
- **📝 Step-by-Step Tutorials**: From installation to first feature operations
## Core Components

### TL;DR - One Command Setup:
| Component | Description | Version | Docs |
|-----------|-------------|---------|------|
| **[TruffleBox UI](./trufflebox-ui/)** | Web console for feature registry, cataloging, and approval workflows | `v1.3.0` | [Docs](https://meesho.github.io/BharatMLStack/trufflebox-ui/v1.0.0/userguide) |
| **[Online Feature Store](./online-feature-store/)** | Sub-10ms feature retrieval at millions of QPS with streaming ingestion | `v1.2.0` | [Docs](https://meesho.github.io/BharatMLStack/category/online-feature-store) |
| **[Inferflow](./inferflow/)** | DAG-based real-time inference orchestration for composable ML pipelines | `v1.0.0` | [Docs](https://meesho.github.io/BharatMLStack/category/inferflow) |
| **[Numerix](./numerix/)** | Rust-powered math compute engine for high-performance matrix ops | `v1.0.0` | [Docs](https://meesho.github.io/BharatMLStack/category/numerix) |
| **[Skye](./skye/)** | Vector similarity search with pluggable backends | `v1.0.0` | [Docs](https://meesho.github.io/BharatMLStack/category/skye) |
| **[Go SDK](./go-sdk/)** | Go client for Feature Store, Interaction Store, and logging | `v1.3.0` | [Docs](https://meesho.github.io/BharatMLStack/category/go-sdk) |
| **[Python SDK](./py-sdk/)** | Python client libraries for Feature Store and inference logging | `v1.0.1` | [Docs](https://meesho.github.io/BharatMLStack/category/python-sdk) |
| **[Interaction Store](./interaction-store/)** | ScyllaDB-backed store for user interaction signals at sub-10ms | — | — |
| **[Horizon](./horizon/)** | Control plane that orchestrates all services and powers TruffleBox UI | `v1.3.0` | — |

> Full documentation at [meesho.github.io/BharatMLStack](https://meesho.github.io/BharatMLStack/) | [Blogs](https://meesho.github.io/BharatMLStack/blog)
- [All Blog Posts](https://meesho.github.io/BharatMLStack/blog)

## Quick Start

```bash
# Clone and start the complete stack
git clone https://github.com/Meesho/BharatMLStack.git
cd BharatMLStack/quick-start
ONFS_VERSION=<version> HORIZON_VERSION=<version> TRUFFLEBOX_VERSION=<version> NUMERIX_VERSION=<version> ./start.sh
#Set versions
ONFS_VERSION=v1.2.0 HORIZON_VERSION=v1.3.0 TRUFFLEBOX_VERSION=v1.3.0 NUMERIX_VERSION=v1.0.0

./start.sh
```

Then follow the [Quick Start Guide](./quick-start/README.md) for detailed setup and usage instructions.
For step-by-step setup, Docker Compose details, sample data, and health checks, see the full **[Quick Start Guide](./quick-start/README.md)**.

## Architecture

BharatMLStack follows a microservices architecture designed for scalability and maintainability. Several components are to be open-sourced

<div align="center">
<img src="assets/bharatmlstack-layered.png" alt="BharatMLStack Logo" width="1000"/>
<img src="assets/bharatmlstack-architecture.png" alt="BharatMLStack Architecture" width="1000"/>
</div>

### 🚀 Quick Navigation
## Use-Cases

BharatMLStack powers a wide range of ML-driven applications:

| Component | Documentation | Quick Start |
|-----------|--------------|-------------|
| **Online Feature Store** | [Docs](https://meesho.github.io/BharatMLStack/category/online-feature-store) | [Setup](./quick-start/README.md) |
| **Go SDK** | [Docs](./go-sdk/README.md) | [Examples](./go-sdk/README.md) |
| **Python SDK** | [Docs](./py-sdk/README.md) | [Quickstart](./py-sdk/README.md) |
| **User Guide** | [Docs](https://meesho.github.io/BharatMLStack/trufflebox-ui/v1.0.0/userguide) | [Setup](./quick-start/README.md) |
| **Numerix** | [Docs](https://meesho.github.io/BharatMLStack/category/numerix) | [Setup](./quick-start/README.md) |
| Use-Case | What BharatMLStack Enables |
|----------|---------------------------|
| **Personalized Candidate Generation** | Retrieve and rank millions of candidates in real time using feature vectors and embedding similarity |
| **Personalized Ranking** | Serve user, item, and context features at ultra-low latency to power real-time ranking models |
| **Fraud & Risk Detection** | Stream interaction signals and features to detect anomalies and fraudulent patterns in milliseconds |
| **Image Search** | Run embedding search at 500K QPS to match visual queries against massive product catalogs |
| **LLM Recommender Systems** | Orchestrate LLM inference pipelines with feature enrichment for next-gen recommendation engines |
| **DL & LLM Deployments at Scale** | Deploy and scale deep learning and large language models across GPU clusters with Inferflow orchestration |

## Contributing

We welcome contributions from the community! Please see our [Contributing Guide](CONTRIBUTING.md) for details on how to get started.

## Community & Support

- 💬 **Discord**: Join our [community chat](https://discord.gg/XkT7XsV2AU)
- 🐛 **Issues**: Report bugs and request features on [GitHub Issues](https://github.com/Meesho/BharatMLStack/issues)
- 📧 **Email**: Contact us at [ml-oss@meesho.com](mailto:ml-oss@meesho.com )
- **Discord**: Join our [community chat](https://discord.gg/XkT7XsV2AU)
- **Issues**: Report bugs and request features on [GitHub Issues](https://github.com/Meesho/BharatMLStack/issues)
- **Email**: Contact us at [ml-oss@meesho.com](mailto:ml-oss@meesho.com)

## License

Expand Down
Binary file added assets/bharatmlstack-architecture.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added assets/bharatmlstack-logo.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
9 changes: 2 additions & 7 deletions docs-src/docs/inferflow/v1.0.0/_category_.json
Original file line number Diff line number Diff line change
@@ -1,9 +1,4 @@
{
"label": "v1.0.0",
"position": 1,
"link": {
"type": "generated-index",
"description": "Inferflow v1.0.0",
"slug": "/inferflow/v1.0.0"
}
"label": "v1.0.0",
"position": 1
}
14 changes: 14 additions & 0 deletions docs-src/docs/inferflow/v1.0.0/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
---
title: v1.0.0
description: Inferflow v1.0.0
sidebar_position: 0
slug: /inferflow/v1.0.0
---

import DocCardList from '@theme/DocCardList';

# Inferflow v1.0.0

Inferflow is a graph-driven feature retrieval and model inference orchestration engine. It dynamically resolves entity relationships via configurable DAGs, retrieves features from the Online Feature Store, and orchestrates model scoring.

<DocCardList />
57 changes: 57 additions & 0 deletions docs-src/docs/intro.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,57 @@
---
sidebar_position: 0
title: BharatMLStack Documentation
slug: intro
---

# BharatMLStack Documentation

Welcome to the BharatMLStack documentation. BharatMLStack is an open-source, end-to-end ML infrastructure stack built for scale, speed, and simplicity. Explore the components below to get started.

---

## Quick Start

Get up and running with BharatMLStack in minutes. Step-by-step instructions, sample data, and Docker Compose setup for local development and testing.

**[Go to Quick Start &rarr;](/category/quick-start)**

---

## Online Feature Store

Sub-10ms, high-throughput access to machine learning features for real-time inference. Supports batch and streaming ingestion, schema validation, and compact versioned feature groups.

**[Go to Online Feature Store &rarr;](/category/online-feature-store)**

---

## Inferflow

Graph-driven feature retrieval and model inference orchestration engine. Dynamically resolves entity relationships, retrieves features, and orchestrates model scoring — all without custom code.

**[Go to Inferflow &rarr;](/category/inferflow)**

---

## Trufflebox UI

Modern, feature-rich UI framework for MLOps management. Supports feature catalog, user management, and admin operations with approval flows.

**[Go to Trufflebox UI &rarr;](/category/trufflebox-ui)**

---

## SDKs

Client libraries for Go and Python to interact with the Online Feature Store and other platform components. Includes gRPC clients, REST APIs, and Apache Spark integration.

**[Go to SDKs &rarr;](/category/sdks)**

---

## Numerix

High-performance compute engine for ultra-fast element-wise matrix operations. Built in Rust with SIMD acceleration for sub-5ms p99 latency.

**[Go to Numerix &rarr;](/category/numerix)**
2 changes: 1 addition & 1 deletion docs-src/docs/numerix/_category_.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
{
"label": "Numerix",
"position": 6,
"position": 7,
"link": {
"type": "generated-index",
"description": "Numerix is a mathematical compute engine for BharatML Stack. It is used to perform mathematical operations on matrices and vectors."
Expand Down
7 changes: 1 addition & 6 deletions docs-src/docs/numerix/v1.0.0/_category_.json
Original file line number Diff line number Diff line change
@@ -1,10 +1,5 @@
{
"label": "v1.0.0",
"position": 1,
"link": {
"type": "generated-index",
"description": "Numerix v1.0.0",
"slug": "/numerix/v1.0.0"
}
"position": 1
}

14 changes: 14 additions & 0 deletions docs-src/docs/numerix/v1.0.0/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
---
title: v1.0.0
description: Numerix v1.0.0
sidebar_position: 0
slug: /numerix/v1.0.0
---

import DocCardList from '@theme/DocCardList';

# Numerix v1.0.0

Numerix is a mathematical compute engine for BharatML Stack. It is used to perform mathematical operations on matrices and vectors.

<DocCardList />
9 changes: 2 additions & 7 deletions docs-src/docs/online-feature-store/v1.0.0/_category_.json
Original file line number Diff line number Diff line change
@@ -1,9 +1,4 @@
{
"label": "v1.0.0",
"position": 1,
"link": {
"type": "generated-index",
"description": "Online Feature Store v1.0.0",
"slug": "/online-feature-store/v1.0.0"
}
"label": "v1.0.0",
"position": 1
}
14 changes: 14 additions & 0 deletions docs-src/docs/online-feature-store/v1.0.0/index.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
---
title: v1.0.0
description: Online Feature Store v1.0.0
sidebar_position: 0
slug: /online-feature-store/v1.0.0
---

import DocCardList from '@theme/DocCardList';

# Online Feature Store v1.0.0

A high-performance, scalable, and production-grade feature store built for modern machine learning systems. It supports both real-time and batch workflows, with low-latency feature retrieval.

<DocCardList />
8 changes: 8 additions & 0 deletions docs-src/docs/predator/_category_.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
{
"label": "Predator",
"position": 7,
"link": {
"type": "generated-index",
"description": "Predator is a scalable, high-performance model inference service built as a wrapper around NVIDIA Triton Inference Server, designed to serve ML models with low latency in Kubernetes, with OnFS and Interflow integration."
}
}
4 changes: 4 additions & 0 deletions docs-src/docs/predator/v1.0.0/_category_.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
{
"label": "v1.0.0",
"position": 1
}
Loading
Loading