@agent-forge/plugin-desktop-windows-input

Bounded Windows desktop input capability plugin for Agent Forge, extracted from the host's src/plugins/desktop (D-075 S3). It registers desktop_execute (one focus/click/type/key/scroll action against an observed UIA target, always followed by a fresh observation) and, only when the injected runtime exposes a replay method, desktop_replay. The shipped production facade intentionally exposes no replay.

The plugin refuses to register any tool when the host runs in readonly mode. On non-Windows platforms importing the package does not throw; tools report an explicit unsupported result instead of probing or falling back to a different driver.

Install

# from a local checkout
agent-forge plugin install ./plugins/desktop-windows-input

# from npm
agent-forge plugin install @ai-agent-forge/plugin-desktop-windows-input

The package ships two manifests: agent-forge.json (ecosystem manifest for the deterministic plugin resolver, platform.os: ["windows"]) and plugin.json (host-load manifest consumed by loadCapabilityPluginFromManifest, entry ./dist/entry.js).

Library surface

import { DesktopWindowsInputAdapter, WindowsUiAutomationDriver } from "@agent-forge/plugin-desktop-windows-input";

• DesktopWindowsInputAdapter — production input facade (no replay method).
• WindowsUiAutomationDriver(options?) — PowerShell UIA driver; supports command/timeoutMs/spawnSync/platform injection for brokers and tests.
• DesktopWindowsAdapter — full-control adapter with replay, carried for host wiring parity with the observe package.
• createDesktopInputCapabilityFactoryV1(runtime) — registers desktop_execute (and desktop_replay when the runtime provides it) on a CapabilityAPI.
• Default export of dist/entry.js — the precomposed factory used by external plugin loading.

The UIA adapter code is a deliberate inlined copy shared with @agent-forge/plugin-desktop-windows-observe so both packages stay self-contained.

Development

npm install --ignore-scripts        # repo root, creates the workspace symlink
npm run build                       # plugins/desktop-windows-input (tsgo)
npm test                            # vitest; the entry fidelity test requires `npm run build` first