DevAssure Skill
This skill helps you set up, configure, and use the
DevAssure CLI (
) — a command-line tool for running end-to-end UI tests from natural language instructions and YAML/CSV files. DevAssure uses an AI agent to execute browser-based tests described in plain English.
Use this skill whenever the user asks about DevAssure, DevAssure CLI, DevAssure Invisible Agent, or wants to set up, configure, write, or run end-to-end UI tests using the DevAssure CLI tool (
npm package). Trigger this skill for any mention of: devassure, devassure cli, devassure init, devassure run, devassure tests, .devassure folder, DevAssure test cases, DevAssure YAML test files, DevAssure CSV tests, DevAssure CI/CD integration, DevAssure actions, DevAssure tools, DevAssure test data, DevAssure personas, DevAssure preferences, or natural-language UI test automation with DevAssure. Also trigger when the user wants to write YAML test cases for DevAssure, configure DevAssure projects, set up DevAssure in a CI/CD pipeline, filter or run DevAssure tests by tag/priority/folder, view DevAssure reports, or manage DevAssure sessions. Even if the user just says "set up e2e tests with devassure" or "write devassure test cases" or "run end to ene tests", "set up e2e tests", "run e2e tests", "execute the tests", "execute the tests from csv", use this skill.
Quick Reference
For full CLI command reference, configuration file formats, actions, tools, and advanced examples, read:
references/cli-reference.md
— Complete command list, all config file formats, actions, tools, library tools, FAQ, and examples.
references/cli-troubleshooting.md
— Web app login issues ("Something went wrong"), VPN/host allowlist, and links to official troubleshooting docs.
Always consult the reference file before answering detailed questions about specific commands, flags, or config file schemas. Use the troubleshooting reference for login, VPN, and connectivity problems.
Prerequisites
- Node.js 18+
- A DevAssure account (free trial available at https://app.devassure.io/sign_up)
Installation
bash
npm install -g @devassure/cli
Verify:
Note: The package requires global installation.
(local) will fail.
Core Workflow
1. Authenticate
bash
# Interactive (opens browser for OAuth2)
devassure login
# Token-based (for CI/CD)
devassure add-token <your-token>
2. Initialize a project
This creates a
folder with:
- — App description and rules
- — URLs, credentials, test data per environment
- — User personas
- — Browser and execution settings
- — Folder for YAML test case files
- — Reusable action definitions
3. Write test cases
Test cases are YAML files in
.
Single test — one case per file as a mapping:
yaml
summary: Login and verify dashboard
steps:
- Open the application url
- Log in with admin credentials from test data
- Verify dashboard loads and shows admin menu
- Log out
priority: P0
tags:
- smoke
- login
Multiple tests — several cases in the same file when they belong to the same group or feature. Use a top-level list (each item is one test):
yaml
- summary: Login and verify dashboard
steps:
- Open the application url
- Log in with admin credentials from test data
- Verify dashboard loads and shows admin menu
- Log out
priority: P0
tags: [smoke, login]
- summary: Login and verify user name with welcome message
steps:
- Open the application url
- Log in with admin credentials from test data
- Verify dashboard the welcome message contains the user name
priority: P2
tags: [login]
Only
and
are required. Steps are written in
natural language — the DevAssure AI agent interprets and executes them in a browser.
4. Run tests
bash
# Run all tests
devassure run-tests
# Filter by tags, priority, or folder
devassure run-tests --tag=smoke,regression --priority=P0,P1
# Run from CSV file
devassure run-tests --csv=test-cases.csv
# Archive reports after run
devassure run-tests --archive=./reports
5. View reports
bash
devassure open-report --last
devassure summary --last --json
Key Concepts
Test Data ()
Define URLs, user credentials, and custom data per environment (default, uat, staging, etc.). The
environment is used when
is not specified.
Actions ()
Reusable step sequences. Define an action in a YAML file with
,
, and
. Reference actions by name in test steps.
Tools (.devassure/tools/index.yaml
)
Custom commands/scripts that the agent can invoke during test execution. Supports args, output markers, timeouts, and environment variables.
Library Tools ()
Built-in tools like
(synthetic data) and
(TOTP codes).
Preferences ()
Configure browser (chromium/chrome/edge), resolution, headless mode, and worker count.
CI/CD Integration
bash
# Authenticate with token (no browser needed)
devassure add-token $DEVASSURE_TOKEN
# Run tests with filters and archive results
devassure run-tests --tag=regression --priority=P0 --archive=./test-reports
# Get JSON summary for CI parsing
devassure summary --last --json
# Clean up old sessions
devassure cleanup --retain-days 7
Supports proxy via
/
environment variables.
When Helping Users
- Setting up a new project: Walk them through → → writing test cases → .
- Writing test cases: Help write YAML test files with natural language steps. Keep steps clear and action-oriented.
- CI/CD setup: Help configure token-based auth, test filtering, report archiving, and cleanup.
- Troubleshooting: Check Node.js version (18+), global install, authentication status. For web login errors, HTTPS/mixed content, firewall, and VPN host allowlists, see
references/cli-troubleshooting.md
.
- Advanced config: Refer to
references/cli-reference.md
for tools, actions, library tools, and full config schemas.