Skip to content

Document new Executions tab in Test Cases #1886

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
mintlify wants to merge 2 commits into
base: main
Choose a base branch
from
Open

Document new Executions tab in Test Cases #1886

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
1d633a0
Update docs/inspector/test-cases.mdx
mintlify[bot] Apr 21, 2026
7696311
Update docs/inspector/test-cases.mdx
mintlify[bot] Apr 21, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 12 additions & 5 deletions docs/inspector/test-cases.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -83,14 +83,16 @@ You can run tests in two ways:

## Analyzing Results

### Results & Runs View
### Suite Overview

Click Results & Runs in the sidebar to see overall analytics:

- **Accuracy Donut** - Overall accuracy percentage
- **Accuracy Chart** - Shows pass rates across runs (line connects multiple runs)
- **Performance by Model** - Bar chart comparing models

The suite overview provides three different views to analyze your test results from different angles.

<iframe
className="w-full aspect-video rounded-xl"
src="https://www.youtube.com/embed/iglDMsuTwf4"
Expand All @@ -99,14 +101,19 @@ Click Results & Runs in the sidebar to see overall analytics:
allowFullScreen
></iframe>

Use the dropdown to switch between "Runs" and "Test Cases" views:

**Runs view:**
- **Run History** - Shows all your runs with their metrics (Run ID, Start time, Duration, Passed, Failed, Accuracy, Tokens)
Use the tabs to switch between "Test cases", "Executions", and "Runs" views:

**Test Cases view:**
- **Test Cases Table** - List of all tests with Test Case Name, Iterations, Avg Accuracy, Avg Duration

**Executions view:**
- **Execution Timeline** - Flat list of every test execution across all test cases, sorted by most recent
- Shows test case name, result (passed/failed/pending/cancelled), and timestamp
- Click any execution to view its details in the compare view

**Runs view:**
- **Run History** - Shows all your runs with their metrics (Run ID, Start time, Duration, Passed, Failed, Accuracy, Tokens)

### Run Detail View

When you click on a run:
Expand Down
Loading