@testwatch/cli
Run your TestWatch end-to-end tests from any CI and wait for the verdict.
export TESTWATCH_API_KEY=tw_… # TestWatch → Settings → API keys
npx @testwatch/cli run --app <app id> --wait --junit testwatch.xml
--wait waits for the final verdict, after TestWatch has checked every failure:
| Verdict | Meaning |
|---|---|
pass | every test passed (flaky passes included) |
real_bug | the app is broken |
needs_review | a test failed and needs a person (often: the app changed) |
infra | the app or its login wasn't usable, or the run was cancelled |
Exit codes:
| Code | Meaning |
|---|---|
0 | the verdict isn't in --fail-on (default real_bug,needs_review,infra) |
1 | the verdict is in --fail-on |
2 | usage, auth, plan, network or timeout error |
130 | interrupted. The run is cancelled unless --no-cancel-on-abort is set. |
Other options:
--env <name>: the environment to run against--env-url <deployed url>: a deployed URL. It matches an environment's own URL or one of its preview patterns.--url <preview url>: run against this preview URL (with--env, or the app's default environment). It must match the environment's preview patterns. Not with--env-url.--tag <t>(repeatable)--tests <ids>--account <name|id>: sign every test that signs in as this account (default: each test's own login). Tests where it isn't used on the environment are skipped; tests that don't sign in stay signed out.--timeout 30m--jsontestwatch whoamichecks a key.
Preview runs print Preview · <host>. When TestWatch proposes a PR fix for a test on that
branch, the report prints PR fix proposed — accept: <link>: accept it in TestWatch, then re-run
the job. Tests that ran with an accepted PR fix are marked (ran with accepted PR fix). The exit
code doesn't change.
On GitHub Actions it writes a job summary, annotations and the outputs run-id, url and
verdict. There is also a ready-made action: testwatch-dev/action@v1.
Security and support
- Manufacturer: Vasyl Harastei (TestWatch), Solná 24/23, 746 01 Opava - Město, Czech Republic.
- Report a vulnerability: [email protected]. Disclosure policy: https://testwatch.dev/security#report.
- Support period: security fixes for each major version for at least 5 years after each major version's release.
- SBOM: generate a software bill of materials for the installed package with
npm sbom(e.g.npm sbom --sbom-format cyclonedxin a project that depends on@testwatch/cli). - The CLI has no runtime dependencies. Fixed vulnerabilities are published as GitHub security advisories on github.com/testwatch-dev.