Skip to content

Improve tool discovery prompt and migrate to simulator-management workflow #222

Improve tool discovery prompt and migrate to simulator-management workflow

Improve tool discovery prompt and migrate to simulator-management workflow #222

Triggered via pull request August 7, 2025 22:21
Status Failure
Total duration 1m 10s
Artifacts

ci.yml

on: pull_request
Matrix: build-and-test
Fit to window
Zoom out
Zoom in

Annotations

4 errors
build-and-test (24.x)
Process completed with exit code 1.
src/mcp/tools/discovery/__tests__/discover_tools.test.ts > discover_tools > Prompt Generation > should provide clear selection guidelines in prompt: src/mcp/tools/discovery/__tests__/discover_tools.test.ts#L696
AssertionError: expected 'You are an expert assistant for the X…' to contain 'Choose ONLY ONE workflow' - Expected + Received - Choose ONLY ONE workflow + You are an expert assistant for the XcodeBuildMCP server. Your task is to select the most relevant workflow for a user's Apple development request. + + The user wants to perform the following task: "Build my app" + + IMPORTANT: Select EXACTLY ONE workflow that best matches the user's task. In most cases, users are working with a project or workspace. Use this selection guide: + + Primary (project/workspace-based) workflows: + - iOS simulator with .xcworkspace: choose "simulator-workspace" + - iOS simulator with .xcodeproj: choose "simulator-project" + - iOS physical device with .xcworkspace: choose "device-workspace" + - iOS physical device with .xcodeproj: choose "device-project" + - macOS with .xcworkspace: choose "macos-workspace" + - macOS with .xcodeproj: choose "macos-project" + - Swift Package Manager (no Xcode project): choose "swift-package" + + Secondary (task-based, no project/workspace needed): + - Simulator management (boot, list, open, status bar, appearance, GPS/location): choose "simulator-management" + - Logging or log capture (simulator or device): choose "logging" + - UI automation/gestures/screenshots on a simulator app: choose "ui-testing" + - System/environment diagnostics or validation: choose "diagnostics" + - Create new iOS/macOS projects from templates: choose "project-scaffolding" + + All available workflows: + Available workflows: + + Respond with ONLY a JSON array containing ONE workflow name that best matches the task (e.g., ["simulator-workspace"]). ❯ src/mcp/tools/discovery/__tests__/discover_tools.test.ts:696:22
src/mcp/tools/discovery/__tests__/discover_tools.test.ts > discover_tools > Prompt Generation > should include task description in LLM prompt: src/mcp/tools/discovery/__tests__/discover_tools.test.ts#L659
AssertionError: expected 'You are an expert assistant for the X…' to contain 'Project Type Selection Guide' - Expected + Received - Project Type Selection Guide + You are an expert assistant for the XcodeBuildMCP server. Your task is to select the most relevant workflow for a user's Apple development request. + + The user wants to perform the following task: "I need to build my React Native iOS app for the simulator and run tests" + + IMPORTANT: Select EXACTLY ONE workflow that best matches the user's task. In most cases, users are working with a project or workspace. Use this selection guide: + + Primary (project/workspace-based) workflows: + - iOS simulator with .xcworkspace: choose "simulator-workspace" + - iOS simulator with .xcodeproj: choose "simulator-project" + - iOS physical device with .xcworkspace: choose "device-workspace" + - iOS physical device with .xcodeproj: choose "device-project" + - macOS with .xcworkspace: choose "macos-workspace" + - macOS with .xcodeproj: choose "macos-project" + - Swift Package Manager (no Xcode project): choose "swift-package" + + Secondary (task-based, no project/workspace needed): + - Simulator management (boot, list, open, status bar, appearance, GPS/location): choose "simulator-management" + - Logging or log capture (simulator or device): choose "logging" + - UI automation/gestures/screenshots on a simulator app: choose "ui-testing" + - System/environment diagnostics or validation: choose "diagnostics" + - Create new iOS/macOS projects from templates: choose "project-scaffolding" + + All available workflows: + Available workflows: + 1. simulator-workspace: iOS Simulator Workspace - iOS development for workspaces + + Respond with ONLY a JSON array containing ONE workflow name that best matches the task (e.g., ["simulator-workspace"]). ❯ src/mcp/tools/discovery/__tests__/discover_tools.test.ts:659:22
src/mcp/tools/discovery/__tests__/discover_tools.test.ts > discover_tools > Export Field Validation (Literal) > should have correct description: src/mcp/tools/discovery/__tests__/discover_tools.test.ts#L118
AssertionError: expected 'Analyzes a natural language task desc…' to be 'Analyzes a natural language task desc…' // Object.is equality Expected: "Analyzes a natural language task description to enable a relevant set of Xcode and Apple development tools. For best results, specify the target platform (iOS, macOS, watchOS, tvOS, visionOS) and project type (.xcworkspace or .xcodeproj)." Received: "Analyzes a natural language task description and enables the most relevant development workflow. Prioritizes project/workspace workflows (simulator/device/macOS) and also supports task-based workflows (simulator-management, logging, diagnostics) and Swift packages." ❯ src/mcp/tools/discovery/__tests__/discover_tools.test.ts:118:41