Add ui touch and ui pen commands

.claude/skills/winapp-ui-automation/SKILL.md

@@ -12,7 +12,7 @@ version: 0.4.1
 
 ## Prerequisites
 - For UIA mode (any app): No setup needed — works with any running Windows app
-- For input-injecting verbs (`click`, `hover`, `drag`, `scroll --wheel`, `send-keys --via send-input`): an **unlocked, interactive desktop** with the target window foregroundable. On a locked/secure desktop they fail fast with `no_interactive_desktop`. The UIA-pattern verbs (`inspect`, `search`, `get-*`, `wait-for`, `set-value`, `invoke`, `scroll --direction/--to`, `screenshot`) are headless/locked-session friendly — prefer them in CI.
+- For input-injecting verbs (`click`, `hover`, `drag`, `touch`, `pen`, `scroll --wheel`, `send-keys --via send-input`): an **unlocked, interactive desktop** with the target window foregroundable. On a locked/secure desktop they fail fast with `no_interactive_desktop`. The UIA-pattern verbs (`inspect`, `search`, `get-*`, `wait-for`, `set-value`, `invoke`, `scroll --direction/--to`, `screenshot`) are headless/locked-session friendly — prefer them in CI.
 
 ## Common patterns
 
@@ -157,6 +157,34 @@ winapp ui drag itm-card-9f8e itm-trash-0001 -a myapp --right
 ```
 - A selector drags from/to the element's center; `x,y` are app coordinates in the same space `ui inspect`/`search` report. Element endpoints are re-resolved just before the drag and fail with `target_moved` if still animating; on a locked/secure desktop the drag fails with `no_interactive_desktop`.
 
+### Touch gestures (tap, swipe, pinch, stretch, long-press)
+Inject synthetic touch. The contact anchor is an element selector (its center) or an explicit `--at x,y` app coordinate. Prefers the modern synthetic-pointer device and falls back to the legacy touch-injection API.
+```powershell
+# Tap an element center; or tap explicit app coordinates
+winapp ui touch btn-ok-1a2b -a myapp
+winapp ui touch -a myapp --at 320,240
+
+# Long-press, swipe, and two-finger pinch/stretch (zoom)
+winapp ui touch tile-photo-7b3c -a myapp --gesture long-press --hold-ms 600
+winapp ui touch -a myapp --at 100,300 --gesture swipe --to-point 400,300
+winapp ui touch img-map-9f8e -a myapp --gesture pinch --distance 200
+winapp ui touch img-map-9f8e -a myapp --gesture stretch --distance 200
+```
+- Gestures: `tap` (default), `double-tap`, `long-press`, `swipe`, `pinch`, `stretch`. `--fingers` 1–10 (pinch/stretch always 2). Refuses without a non-zero foregrounded target (`no_target`/`foreground_not_target`/`no_interactive_desktop`); every coordinate is bounds-checked against the target window and rejected with `invalid_arguments` if outside. If injected touch is unsupported on the device, the command surfaces the real Win32 error rather than a false success.
+
+### Pen / stylus (taps and ink strokes)
+Inject synthetic pen input (Windows 10 1809+). Target an element center, an explicit `--at`, or a full `--path` ink stroke, with pressure/tilt/eraser control.
+```powershell
+# Pen tap at element center; firm tap at explicit coords
+winapp ui pen canvas-1a2b -a myapp
+winapp ui pen -a myapp --at 320,240 --pressure 0.8
+
+# Draw an ink stroke, or erase along one
+winapp ui pen -a myapp --path "100,100 150,120 210,140 260,120"
+winapp ui pen -a myapp --path "100,100 260,100" --eraser
+```
+- `--pressure` 0.0–1.0, `--tilt-x`/`--tilt-y` ±90°, `--eraser` for the eraser end. Same injection safety as `touch`: requires a non-zero foregrounded target window and bounds-checks every ink point (out-of-bounds → `invalid_arguments`, nothing injected).
+
 ### Read element state
 ```powershell
 # Read text/value content (works for RichEditBox, TextBox, ComboBox, Slider, labels)
@@ -434,6 +462,55 @@ Press the mouse button at one point, move to another, then release. 'drag <from>
 | `--right` | Drag with the right mouse button instead of the left button | (none) |
 | `--window` | Target window by HWND (stable handle from list output). Takes precedence over --app. | (none) |
 
+### `winapp ui touch`
+
+Inject synthetic touch input using the Windows touch-injection API. Supports tap, double-tap, long-press, swipe, pinch and stretch gestures at an element's center or explicit app x,y coordinates. Requires an unlocked, interactive desktop with the target window foregroundable.
+
+#### Arguments
+<!-- auto-generated from cli-schema.json -->
+| Argument | Required | Description |
+|----------|----------|-------------|
+| `<selector>` | No | Semantic slug (e.g., btn-minimize-d1a0) or text to search by name/automationId |
+
+#### Options
+<!-- auto-generated from cli-schema.json -->
+| Option | Description | Default |
+|--------|-------------|---------|
+| `--app` | Target app (process name, window title, or PID). Lists windows if ambiguous. | (none) |
+| `--at` | Explicit start point as app coordinates x,y (as reported by 'ui inspect'). Defaults to the selector's element center. | (none) |
+| `--distance` | Distance in pixels for pinch/stretch (finger spread) or a directionless swipe. | (none) |
+| `--duration-ms` | Glide time in milliseconds for moving gestures (swipe/pinch/stretch). | `300` |
+| `--fingers` | Number of touch contacts (default: 1). Pinch/stretch always use 2. | `1` |
+| `--gesture` | Gesture to perform: tap, double-tap, long-press, swipe, pinch, stretch (default: tap). | `tap` |
+| `--hold-ms` | Milliseconds to hold contacts down before lifting (long-press hold time). | (none) |
+| `--json` | Format output as JSON | (none) |
+| `--to-point` | End point x,y for a swipe (app coordinates). | (none) |
+| `--window` | Target window by HWND (stable handle from list output). Takes precedence over --app. | (none) |
+
+### `winapp ui pen`
+
+Inject synthetic pen/stylus input using the Windows synthetic-pointer API. Taps or draws ink strokes with configurable pressure, tilt and eraser mode, at an element's center or explicit app x,y coordinates. Requires an unlocked, interactive desktop with the target window foregroundable (Windows 10 1809+).
+
+#### Arguments
+<!-- auto-generated from cli-schema.json -->
+| Argument | Required | Description |
+|----------|----------|-------------|
+| `<selector>` | No | Semantic slug (e.g., btn-minimize-d1a0) or text to search by name/automationId |
+
+#### Options
+<!-- auto-generated from cli-schema.json -->
+| Option | Description | Default |
+|--------|-------------|---------|
+| `--app` | Target app (process name, window title, or PID). Lists windows if ambiguous. | (none) |
+| `--at` | Pen contact point as app coordinates x,y (as reported by 'ui inspect'). Defaults to the selector's element center. Ignored when --path is given. | (none) |
+| `--eraser` | Use the eraser end of the pen instead of the tip. | (none) |
+| `--json` | Format output as JSON | (none) |
+| `--path` | Ink stroke path as a whitespace-separated list of x,y pairs, e.g. "10,10 20,30 40,50". | (none) |
+| `--pressure` | Pen pressure from 0.0 to 1.0 (default: 0.5). | `0.5` |
+| `--tilt-x` | Pen tilt along the x-axis in degrees (-90 to 90, default: 0). | (none) |
+| `--tilt-y` | Pen tilt along the y-axis in degrees (-90 to 90, default: 0). | (none) |
+| `--window` | Target window by HWND (stable handle from list output). Takes precedence over --app. | (none) |
+
 ### `winapp ui hover`
 
 Move the mouse to an element's center to trigger hover effects (tooltips, flyouts, visual states). Uses SendInput for realistic mouse movement and waits for a configurable dwell time.

.github/plugin/skills/winapp-cli/ui-automation/SKILL.md

@@ -12,7 +12,7 @@ version: 0.4.1
 
 ## Prerequisites
 - For UIA mode (any app): No setup needed — works with any running Windows app
-- For input-injecting verbs (`click`, `hover`, `drag`, `scroll --wheel`, `send-keys --via send-input`): an **unlocked, interactive desktop** with the target window foregroundable. On a locked/secure desktop they fail fast with `no_interactive_desktop`. The UIA-pattern verbs (`inspect`, `search`, `get-*`, `wait-for`, `set-value`, `invoke`, `scroll --direction/--to`, `screenshot`) are headless/locked-session friendly — prefer them in CI.
+- For input-injecting verbs (`click`, `hover`, `drag`, `touch`, `pen`, `scroll --wheel`, `send-keys --via send-input`): an **unlocked, interactive desktop** with the target window foregroundable. On a locked/secure desktop they fail fast with `no_interactive_desktop`. The UIA-pattern verbs (`inspect`, `search`, `get-*`, `wait-for`, `set-value`, `invoke`, `scroll --direction/--to`, `screenshot`) are headless/locked-session friendly — prefer them in CI.
 
 ## Common patterns
 
@@ -157,6 +157,34 @@ winapp ui drag itm-card-9f8e itm-trash-0001 -a myapp --right
 ```
 - A selector drags from/to the element's center; `x,y` are app coordinates in the same space `ui inspect`/`search` report. Element endpoints are re-resolved just before the drag and fail with `target_moved` if still animating; on a locked/secure desktop the drag fails with `no_interactive_desktop`.
 
+### Touch gestures (tap, swipe, pinch, stretch, long-press)
+Inject synthetic touch. The contact anchor is an element selector (its center) or an explicit `--at x,y` app coordinate. Prefers the modern synthetic-pointer device and falls back to the legacy touch-injection API.
+```powershell
+# Tap an element center; or tap explicit app coordinates
+winapp ui touch btn-ok-1a2b -a myapp
+winapp ui touch -a myapp --at 320,240
+
+# Long-press, swipe, and two-finger pinch/stretch (zoom)
+winapp ui touch tile-photo-7b3c -a myapp --gesture long-press --hold-ms 600
+winapp ui touch -a myapp --at 100,300 --gesture swipe --to-point 400,300
+winapp ui touch img-map-9f8e -a myapp --gesture pinch --distance 200
+winapp ui touch img-map-9f8e -a myapp --gesture stretch --distance 200
+```
+- Gestures: `tap` (default), `double-tap`, `long-press`, `swipe`, `pinch`, `stretch`. `--fingers` 1–10 (pinch/stretch always 2). Refuses without a non-zero foregrounded target (`no_target`/`foreground_not_target`/`no_interactive_desktop`); every coordinate is bounds-checked against the target window and rejected with `invalid_arguments` if outside. If injected touch is unsupported on the device, the command surfaces the real Win32 error rather than a false success.
+
+### Pen / stylus (taps and ink strokes)
+Inject synthetic pen input (Windows 10 1809+). Target an element center, an explicit `--at`, or a full `--path` ink stroke, with pressure/tilt/eraser control.
+```powershell
+# Pen tap at element center; firm tap at explicit coords
+winapp ui pen canvas-1a2b -a myapp
+winapp ui pen -a myapp --at 320,240 --pressure 0.8
+
+# Draw an ink stroke, or erase along one
+winapp ui pen -a myapp --path "100,100 150,120 210,140 260,120"
+winapp ui pen -a myapp --path "100,100 260,100" --eraser
+```
+- `--pressure` 0.0–1.0, `--tilt-x`/`--tilt-y` ±90°, `--eraser` for the eraser end. Same injection safety as `touch`: requires a non-zero foregrounded target window and bounds-checks every ink point (out-of-bounds → `invalid_arguments`, nothing injected).
+
 ### Read element state
 ```powershell
 # Read text/value content (works for RichEditBox, TextBox, ComboBox, Slider, labels)
@@ -434,6 +462,55 @@ Press the mouse button at one point, move to another, then release. 'drag <from>
 | `--right` | Drag with the right mouse button instead of the left button | (none) |
 | `--window` | Target window by HWND (stable handle from list output). Takes precedence over --app. | (none) |
 
+### `winapp ui touch`
+
+Inject synthetic touch input using the Windows touch-injection API. Supports tap, double-tap, long-press, swipe, pinch and stretch gestures at an element's center or explicit app x,y coordinates. Requires an unlocked, interactive desktop with the target window foregroundable.
+
+#### Arguments
+<!-- auto-generated from cli-schema.json -->
+| Argument | Required | Description |
+|----------|----------|-------------|
+| `<selector>` | No | Semantic slug (e.g., btn-minimize-d1a0) or text to search by name/automationId |
+
+#### Options
+<!-- auto-generated from cli-schema.json -->
+| Option | Description | Default |
+|--------|-------------|---------|
+| `--app` | Target app (process name, window title, or PID). Lists windows if ambiguous. | (none) |
+| `--at` | Explicit start point as app coordinates x,y (as reported by 'ui inspect'). Defaults to the selector's element center. | (none) |
+| `--distance` | Distance in pixels for pinch/stretch (finger spread) or a directionless swipe. | (none) |
+| `--duration-ms` | Glide time in milliseconds for moving gestures (swipe/pinch/stretch). | `300` |
+| `--fingers` | Number of touch contacts (default: 1). Pinch/stretch always use 2. | `1` |
+| `--gesture` | Gesture to perform: tap, double-tap, long-press, swipe, pinch, stretch (default: tap). | `tap` |
+| `--hold-ms` | Milliseconds to hold contacts down before lifting (long-press hold time). | (none) |
+| `--json` | Format output as JSON | (none) |
+| `--to-point` | End point x,y for a swipe (app coordinates). | (none) |
+| `--window` | Target window by HWND (stable handle from list output). Takes precedence over --app. | (none) |
+
+### `winapp ui pen`
+
+Inject synthetic pen/stylus input using the Windows synthetic-pointer API. Taps or draws ink strokes with configurable pressure, tilt and eraser mode, at an element's center or explicit app x,y coordinates. Requires an unlocked, interactive desktop with the target window foregroundable (Windows 10 1809+).
+
+#### Arguments
+<!-- auto-generated from cli-schema.json -->
+| Argument | Required | Description |
+|----------|----------|-------------|
+| `<selector>` | No | Semantic slug (e.g., btn-minimize-d1a0) or text to search by name/automationId |
+
+#### Options
+<!-- auto-generated from cli-schema.json -->
+| Option | Description | Default |
+|--------|-------------|---------|
+| `--app` | Target app (process name, window title, or PID). Lists windows if ambiguous. | (none) |
+| `--at` | Pen contact point as app coordinates x,y (as reported by 'ui inspect'). Defaults to the selector's element center. Ignored when --path is given. | (none) |
+| `--eraser` | Use the eraser end of the pen instead of the tip. | (none) |
+| `--json` | Format output as JSON | (none) |
+| `--path` | Ink stroke path as a whitespace-separated list of x,y pairs, e.g. "10,10 20,30 40,50". | (none) |
+| `--pressure` | Pen pressure from 0.0 to 1.0 (default: 0.5). | `0.5` |
+| `--tilt-x` | Pen tilt along the x-axis in degrees (-90 to 90, default: 0). | (none) |
+| `--tilt-y` | Pen tilt along the y-axis in degrees (-90 to 90, default: 0). | (none) |
+| `--window` | Target window by HWND (stable handle from list output). Takes precedence over --app. | (none) |
+
 ### `winapp ui hover`
 
 Move the mouse to an element's center to trigger hover effects (tooltips, flyouts, visual states). Uses SendInput for realistic mouse movement and waits for a configurable dwell time.