deskctl

Original：🇺🇸 English

Translated

2 scripts

Non-interactive X11 desktop control for AI agents. Use when the task involves controlling a Linux desktop - clicking, typing, reading windows, waiting for UI state, or taking screenshots inside a sandbox or VM.

2installs

Sourceharivansh-afk/deskctl

Added on2026-03-27

NPX Install

npx skill4agent add harivansh-afk/deskctl deskctl

SKILL.md Content

View Translation Comparison →

deskctl

Non-interactive desktop control CLI for Linux X11 agents.

All output follows the runtime contract defined in references/runtime-contract.md. Every command returns a stable JSON envelope when called with

--json

. Use

--json

whenever you need to parse output programmatically.

Quick start

bash

npm install -g deskctl
deskctl doctor
deskctl snapshot --annotate

If

deskctl

was installed through npm, refresh it later with:

bash

deskctl upgrade --yes

Agent loop

Every desktop interaction follows: observe -> wait -> act -> verify.

bash

deskctl snapshot --annotate        # observe
deskctl wait window --selector 'title=Chromium' --timeout 10  # wait
deskctl click 'title=Chromium'      # act
deskctl snapshot                   # verify

See workflows/observe-act.sh for a reusable script. See workflows/poll-condition.sh for polling loops.

Selectors

bash

ref=w1          # snapshot ref (short-lived)
id=win1         # stable window ID (session-scoped)
title=Chromium   # match by title
class=chromium   # match by WM class
focused         # currently focused window

Bare strings like

chromium

do fuzzy matching but fail on ambiguity. Prefer explicit selectors.

References

references/runtime-contract.md - output contract, stable fields, error kinds
references/commands.md - all available commands

Workflows

workflows/observe-act.sh - main observe-act loop
workflows/poll-condition.sh - poll for a condition on screen

deskctl

NPX Install

Tags

SKILL.md Content

deskctl

Quick start

Agent loop

Selectors

References

Workflows