Improve tool discovery prompt and migrate to simulator-management workflow #222
Annotations
4 errors
|
build-and-test (24.x)
Process completed with exit code 1.
|
|
src/mcp/tools/discovery/__tests__/discover_tools.test.ts > discover_tools > Prompt Generation > should provide clear selection guidelines in prompt:
src/mcp/tools/discovery/__tests__/discover_tools.test.ts#L696
AssertionError: expected 'You are an expert assistant for the X…' to contain 'Choose ONLY ONE workflow'
- Expected
+ Received
- Choose ONLY ONE workflow
+ You are an expert assistant for the XcodeBuildMCP server. Your task is to select the most relevant workflow for a user's Apple development request.
+
+ The user wants to perform the following task: "Build my app"
+
+ IMPORTANT: Select EXACTLY ONE workflow that best matches the user's task. In most cases, users are working with a project or workspace. Use this selection guide:
+
+ Primary (project/workspace-based) workflows:
+ - iOS simulator with .xcworkspace: choose "simulator-workspace"
+ - iOS simulator with .xcodeproj: choose "simulator-project"
+ - iOS physical device with .xcworkspace: choose "device-workspace"
+ - iOS physical device with .xcodeproj: choose "device-project"
+ - macOS with .xcworkspace: choose "macos-workspace"
+ - macOS with .xcodeproj: choose "macos-project"
+ - Swift Package Manager (no Xcode project): choose "swift-package"
+
+ Secondary (task-based, no project/workspace needed):
+ - Simulator management (boot, list, open, status bar, appearance, GPS/location): choose "simulator-management"
+ - Logging or log capture (simulator or device): choose "logging"
+ - UI automation/gestures/screenshots on a simulator app: choose "ui-testing"
+ - System/environment diagnostics or validation: choose "diagnostics"
+ - Create new iOS/macOS projects from templates: choose "project-scaffolding"
+
+ All available workflows:
+ Available workflows:
+
+ Respond with ONLY a JSON array containing ONE workflow name that best matches the task (e.g., ["simulator-workspace"]).
❯ src/mcp/tools/discovery/__tests__/discover_tools.test.ts:696:22
|
|
src/mcp/tools/discovery/__tests__/discover_tools.test.ts > discover_tools > Prompt Generation > should include task description in LLM prompt:
src/mcp/tools/discovery/__tests__/discover_tools.test.ts#L659
AssertionError: expected 'You are an expert assistant for the X…' to contain 'Project Type Selection Guide'
- Expected
+ Received
- Project Type Selection Guide
+ You are an expert assistant for the XcodeBuildMCP server. Your task is to select the most relevant workflow for a user's Apple development request.
+
+ The user wants to perform the following task: "I need to build my React Native iOS app for the simulator and run tests"
+
+ IMPORTANT: Select EXACTLY ONE workflow that best matches the user's task. In most cases, users are working with a project or workspace. Use this selection guide:
+
+ Primary (project/workspace-based) workflows:
+ - iOS simulator with .xcworkspace: choose "simulator-workspace"
+ - iOS simulator with .xcodeproj: choose "simulator-project"
+ - iOS physical device with .xcworkspace: choose "device-workspace"
+ - iOS physical device with .xcodeproj: choose "device-project"
+ - macOS with .xcworkspace: choose "macos-workspace"
+ - macOS with .xcodeproj: choose "macos-project"
+ - Swift Package Manager (no Xcode project): choose "swift-package"
+
+ Secondary (task-based, no project/workspace needed):
+ - Simulator management (boot, list, open, status bar, appearance, GPS/location): choose "simulator-management"
+ - Logging or log capture (simulator or device): choose "logging"
+ - UI automation/gestures/screenshots on a simulator app: choose "ui-testing"
+ - System/environment diagnostics or validation: choose "diagnostics"
+ - Create new iOS/macOS projects from templates: choose "project-scaffolding"
+
+ All available workflows:
+ Available workflows:
+ 1. simulator-workspace: iOS Simulator Workspace - iOS development for workspaces
+
+ Respond with ONLY a JSON array containing ONE workflow name that best matches the task (e.g., ["simulator-workspace"]).
❯ src/mcp/tools/discovery/__tests__/discover_tools.test.ts:659:22
|
|
src/mcp/tools/discovery/__tests__/discover_tools.test.ts > discover_tools > Export Field Validation (Literal) > should have correct description:
src/mcp/tools/discovery/__tests__/discover_tools.test.ts#L118
AssertionError: expected 'Analyzes a natural language task desc…' to be 'Analyzes a natural language task desc…' // Object.is equality
Expected: "Analyzes a natural language task description to enable a relevant set of Xcode and Apple development tools. For best results, specify the target platform (iOS, macOS, watchOS, tvOS, visionOS) and project type (.xcworkspace or .xcodeproj)."
Received: "Analyzes a natural language task description and enables the most relevant development workflow. Prioritizes project/workspace workflows (simulator/device/macOS) and also supports task-based workflows (simulator-management, logging, diagnostics) and Swift packages."
❯ src/mcp/tools/discovery/__tests__/discover_tools.test.ts:118:41
|