Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 6 additions & 6 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
<div align="center">

# InfiniMetrics
# InfiniBench

**An InfiniTensor-Featured Comprehensive Accelerator Evaluation Framework**

[![Format Check](https://img.shields.io/badge/Format_Check-passing-success)](https://github.com/InfiniTensor/InfiniMetrics)
[![Issues](https://img.shields.io/github/issues/InfiniTensor/InfiniMetrics)](https://github.com/InfiniTensor/InfiniMetrics/issues)
[![Pull Requests](https://img.shields.io/github/issues-pr/InfiniTensor/InfiniMetrics)](https://github.com/InfiniTensor/InfiniMetrics/pulls)
[![License](https://img.shields.io/badge/License-MIT-green.svg)](https://github.com/InfiniTensor/InfiniMetrics/blob/master/LICENSE)
[![Format Check](https://img.shields.io/badge/Format_Check-passing-success)](https://github.com/InfiniTensor/InfiniBench)
[![Issues](https://img.shields.io/github/issues/InfiniTensor/InfiniBench)](https://github.com/InfiniTensor/InfiniBench/issues)
[![Pull Requests](https://img.shields.io/github/issues-pr/InfiniTensor/InfiniBench)](https://github.com/InfiniTensor/InfiniBench/pulls)
[![License](https://img.shields.io/badge/License-MIT-green.svg)](https://github.com/InfiniTensor/InfiniBench/blob/master/LICENSE)

A unified, modular testing framework for comprehensive performance evaluation of accelerator hardware and software stacks.

Expand All @@ -17,7 +17,7 @@ A unified, modular testing framework for comprehensive performance evaluation of

## 🎯 Overview

**InfiniMetrics** provides standardized interfaces for benchmarking across multiple layers:
**InfiniBench** provides standardized interfaces for benchmarking across multiple layers:

- **Hardware-Level**: GPU memory bandwidth, cache performance, compute capabilities
- **Operator-Level**: Individual operation performance (FLOPS, latency)
Expand Down
12 changes: 6 additions & 6 deletions README_CN.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
# InfiniMetrics
# InfiniBench

<div align="center">

**面向 InfiniTensor 的全面加速器评估框架**

[![Format Check](https://img.shields.io/badge/Format_Check-passing-success)](https://github.com/InfiniTensor/InfiniMetrics)
[![Issues](https://img.shields.io/github/issues/InfiniTensor/InfiniMetrics)](https://github.com/InfiniTensor/InfiniMetrics/issues)
[![Pull Requests](https://img.shields.io/github/issues-pr/InfiniTensor/InfiniMetrics)](https://github.com/InfiniTensor/InfiniMetrics/pulls)
[![License](https://img.shields.io/badge/License-MIT-green.svg)](https://github.com/InfiniTensor/InfiniMetrics/blob/master/LICENSE)
[![Format Check](https://img.shields.io/badge/Format_Check-passing-success)](https://github.com/InfiniTensor/InfiniBench)
[![Issues](https://img.shields.io/github/issues/InfiniTensor/InfiniBench)](https://github.com/InfiniTensor/InfiniBench/issues)
[![Pull Requests](https://img.shields.io/github/issues-pr/InfiniTensor/InfiniBench)](https://github.com/InfiniTensor/InfiniBench/pulls)
[![License](https://img.shields.io/badge/License-MIT-green.svg)](https://github.com/InfiniTensor/InfiniBench/blob/master/LICENSE)

一个统一、模块化的测试框架,专为加速卡和软件栈的全面性能评估而设计。

Expand All @@ -17,7 +17,7 @@

## 🎯 项目概述

**InfiniMetrics** 提供了标准化的接口,用于在多个层次进行基准测试:
**InfiniBench** 提供了标准化的接口,用于在多个层次进行基准测试:

- **硬件层**:GPU 内存带宽、缓存性能、计算能力
- **算子层**:单个操作的性能(FLOPS、延迟)
Expand Down
18 changes: 9 additions & 9 deletions dashboard/app.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Main Streamlit application for InfiniMetrics dashboard."""
"""Main Streamlit application for InfiniBench dashboard."""

import streamlit as st
import pandas as pd
Expand All @@ -8,27 +8,27 @@
import sys
from datetime import datetime
from typing import Optional
from infinimetrics.common.constants import AcceleratorType
from infinibench.common.constants import AcceleratorType

# Add project root to path
project_root = Path(__file__).parent
sys.path.append(str(project_root))

from components.header import render_header
from utils.data_loader import InfiniMetricsDataLoader
from utils.data_loader import InfiniBenchDataLoader
from common import show_data_source_info

# Page configuration
st.set_page_config(
page_title="InfiniMetrics Dashboard",
page_title="InfiniBench Dashboard",
page_icon="🏭",
layout="wide",
initial_sidebar_state="expanded",
)

# Initialize session state
if "data_loader" not in st.session_state:
st.session_state.data_loader = InfiniMetricsDataLoader()
st.session_state.data_loader = InfiniBenchDataLoader()
if "selected_accelerators" not in st.session_state:
st.session_state.selected_accelerators = []
if "use_mongodb" not in st.session_state:
Expand Down Expand Up @@ -69,11 +69,11 @@ def main():
if use_mongodb != st.session_state.use_mongodb:
st.session_state.use_mongodb = use_mongodb
if use_mongodb:
st.session_state.data_loader = InfiniMetricsDataLoader(
st.session_state.data_loader = InfiniBenchDataLoader(
use_mongodb=True, fallback_to_files=True
)
else:
st.session_state.data_loader = InfiniMetricsDataLoader()
st.session_state.data_loader = InfiniBenchDataLoader()

show_data_source_info(style="sidebar")
st.markdown("---")
Expand All @@ -85,7 +85,7 @@ def main():
if not use_mongodb and results_dir != str(
st.session_state.data_loader.results_dir
):
st.session_state.data_loader = InfiniMetricsDataLoader(results_dir)
st.session_state.data_loader = InfiniBenchDataLoader(results_dir)

auto_refresh = st.toggle("自动刷新", value=False)
if auto_refresh:
Expand Down Expand Up @@ -136,7 +136,7 @@ def render_dashboard(run_id_filter: str):
font-size: 1.3em;
line-height: 1.6;
">
<strong>InfiniMetrics Dashboard</strong> 用于统一展示
<strong>InfiniBench Dashboard</strong> 用于统一展示
<strong>通信(NCCL / 集合通信)</strong>、
<strong>训练(Training / 分布式训练)</strong>、
<strong>推理(直接推理 / 服务性能)</strong>、
Expand Down
4 changes: 2 additions & 2 deletions dashboard/common.py
Original file line number Diff line number Diff line change
Expand Up @@ -27,9 +27,9 @@ def init_page(page_title: str, page_icon: str):

# Initialize DataLoader (respect MongoDB setting)
if "data_loader" not in st.session_state:
from utils.data_loader import InfiniMetricsDataLoader
from utils.data_loader import InfiniBenchDataLoader

st.session_state.data_loader = InfiniMetricsDataLoader(
st.session_state.data_loader = InfiniBenchDataLoader(
use_mongodb=st.session_state.use_mongodb,
fallback_to_files=True,
)
Expand Down
4 changes: 2 additions & 2 deletions dashboard/components/header.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Header component for InfiniMetrics dashboard."""
"""Header component for InfiniBench dashboard."""

import streamlit as st

Expand Down Expand Up @@ -28,7 +28,7 @@ def render_header():
)

st.markdown(
'<div class="main-header">🏭 InfiniMetrics 测试结果展示平台</div>',
'<div class="main-header">🏭 InfiniBench 测试结果展示平台</div>',
unsafe_allow_html=True,
)
st.markdown(
Expand Down
2 changes: 1 addition & 1 deletion dashboard/pages/communication.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
create_summary_table_comm,
)

init_page("通信测试分析 | InfiniMetrics", "🔗")
init_page("通信测试分析 | InfiniBench", "🔗")


def main():
Expand Down
2 changes: 1 addition & 1 deletion dashboard/pages/hardware.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
plot_hw_cache,
)

init_page("硬件测试分析 | InfiniMetrics", "🔧")
init_page("硬件测试分析 | InfiniBench", "🔧")


def main():
Expand Down
2 changes: 1 addition & 1 deletion dashboard/pages/inference.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,7 @@
create_summary_table_infer,
)

init_page("推理测试分析 | InfiniMetrics", "🚀")
init_page("推理测试分析 | InfiniBench", "🚀")


def main():
Expand Down
2 changes: 1 addition & 1 deletion dashboard/pages/operator.py
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
render_operator_performance_charts,
)

init_page("算子测试分析 | InfiniMetrics", "⚡")
init_page("算子测试分析 | InfiniBench", "⚡")


def main():
Expand Down
2 changes: 1 addition & 1 deletion dashboard/pages/training.py
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,7 @@
render_config_details,
)

init_page("训练测试分析 | InfiniMetrics", "🏋️")
init_page("训练测试分析 | InfiniBench", "🏋️")


def main():
Expand Down
6 changes: 3 additions & 3 deletions dashboard/utils/data_loader.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Unified data loader for InfiniMetrics dashboard."""
"""Unified data loader for InfiniBench dashboard."""

from __future__ import annotations

Expand All @@ -16,7 +16,7 @@
logger = logging.getLogger(__name__)


class InfiniMetricsDataLoader:
class InfiniBenchDataLoader:
"""
Unified data loader supporting multiple sources.

Expand Down Expand Up @@ -237,7 +237,7 @@ def _enhance_summaries(
)

__all__ = [
"InfiniMetricsDataLoader",
"InfiniBenchDataLoader",
"DataSource",
"FileDataSource",
"get_friendly_size",
Expand Down
2 changes: 1 addition & 1 deletion dashboard/utils/data_sources.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Data source implementations for InfiniMetrics dashboard."""
"""Data source implementations for InfiniBench dashboard."""

import json
import logging
Expand Down
2 changes: 1 addition & 1 deletion dashboard/utils/data_utils.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Data utility functions for InfiniMetrics dashboard."""
"""Data utility functions for InfiniBench dashboard."""
import json
import logging

Expand Down
2 changes: 1 addition & 1 deletion dashboard/utils/mongo_data_source.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""MongoDB data source for InfiniMetrics dashboard."""
"""MongoDB data source for InfiniBench dashboard."""

import logging
import sys
Expand Down
2 changes: 1 addition & 1 deletion dashboard/utils/visualizations/__init__.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Visualization functions for InfiniMetrics dashboard.
"""Visualization functions for InfiniBench dashboard.

This package provides visualization utilities organized by test type:
- base: Common/legacy visualization functions
Expand Down
2 changes: 1 addition & 1 deletion dashboard/utils/visualizations/base.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Visualization functions for InfiniMetrics dashboard."""
"""Visualization functions for InfiniBench dashboard."""

import plotly.graph_objects as go
import pandas as pd
Expand Down
2 changes: 1 addition & 1 deletion dashboard/utils/visualizations/hardware.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""Hardware-specific visualization functions for InfiniMetrics dashboard."""
"""Hardware-specific visualization functions for InfiniBench dashboard."""

import plotly.graph_objects as go
import pandas as pd
Expand Down
2 changes: 1 addition & 1 deletion db/__init__.py
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
#!/usr/bin/env python3
"""
InfiniMetrics MongoDB integration module.
InfiniBench MongoDB integration module.

This module provides:
- MongoDB connection management (client.py)
Expand Down
2 changes: 1 addition & 1 deletion db/client.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""MongoDB connection management for InfiniMetrics."""
"""MongoDB connection management for InfiniBench."""

import logging
from typing import Optional
Expand Down
6 changes: 3 additions & 3 deletions db/config.py
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
#!/usr/bin/env python3
"""MongoDB configuration for InfiniMetrics."""
"""MongoDB configuration for InfiniBench."""

from dataclasses import dataclass
import os
Expand All @@ -10,7 +10,7 @@ class DatabaseConfig:
"""MongoDB configuration settings."""

mongo_uri: str = "mongodb://localhost:27017"
database_name: str = "infinimetrics"
database_name: str = "infinibench"
collection_name: str = "test_runs"
summary_collection_name: str = "dispatcher_summaries"
connection_timeout_ms: int = 5000
Expand All @@ -21,7 +21,7 @@ def from_env(cls) -> "DatabaseConfig":
"""Load configuration from environment variables."""
return cls(
mongo_uri=os.getenv("MONGO_URI", "mongodb://localhost:27017"),
database_name=os.getenv("MONGO_DB_NAME", "infinimetrics"),
database_name=os.getenv("MONGO_DB_NAME", "infinibench"),
collection_name=os.getenv("MONGO_COLLECTION", "test_runs"),
summary_collection_name=os.getenv(
"MONGO_SUMMARY_COLLECTION", "dispatcher_summaries"
Expand Down
6 changes: 3 additions & 3 deletions docs/README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# InfiniMetrics Documentation
# InfiniBench Documentation

Welcome to the InfiniMetrics documentation. This hub provides quick access to all documentation resources.
Welcome to the InfiniBench documentation. This hub provides quick access to all documentation resources.

## Quick Navigation

Expand All @@ -27,4 +27,4 @@ Welcome to the InfiniMetrics documentation. This hub provides quick access to al

---

For questions or support, please visit the [InfiniTensor GitHub repository](https://github.com/InfiniTensor/InfiniMetrics).
For questions or support, please visit the [InfiniTensor GitHub repository](https://github.com/InfiniTensor/InfiniBench).
8 changes: 4 additions & 4 deletions docs/architecture.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
# Project Architecture

This document describes the architecture and organization of the InfiniMetrics framework.
This document describes the architecture and organization of the InfiniBench framework.

## Directory Structure

```
InfiniMetrics/
InfiniBench/
├── main.py # Main entry point
├── infinimetrics/
├── infinibench/
│ ├── adapter.py # Base adapter interface
│ ├── dispatcher.py # Test orchestration
│ ├── executor.py # Universal test executor
Expand Down Expand Up @@ -52,7 +52,7 @@ InfiniMetrics/

```mermaid
flowchart TB
subgraph InfiniMetrics["InfiniMetrics"]
subgraph InfiniBench["InfiniBench"]
Input[Input Files] --> Dispatcher[Dispatcher]
Dispatcher --> Executor[Executor]
Executor --> AdapterRegistry["Adapter Registry"]
Expand Down
2 changes: 1 addition & 1 deletion docs/configuration.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Configuration Guide

This guide explains how to configure and run tests in InfiniMetrics.
This guide explains how to configure and run tests in InfiniBench.

## Input File Format

Expand Down
4 changes: 2 additions & 2 deletions docs/dashboard.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# InfiniMetrics Dashboard User Guide
# InfiniBench Dashboard User Guide
## 1. Dashboard Overview

InfiniMetrics Dashboard provides a unified interface to visualize benchmark and evaluation results of AI accelerators across the following scenarios:
InfiniBench Dashboard provides a unified interface to visualize benchmark and evaluation results of AI accelerators across the following scenarios:

- Communication (NCCL / Collective Communication)

Expand Down
Loading
Loading