Requirements
- Target platform
- OpenClaw
- Install method
- Manual import
- Extraction
- Extract archive
- Prerequisites
- OpenClaw
- Primary doc
- SKILL.md
Tencent SkillHub ยท Developer Tools
Linux GUI Control
Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis.
skill openclawclawhub Free
Control the Linux desktop GUI using xdotool, wmctrl, and dogtail. Use when you need to interact with non-browser applications, simulate mouse/keyboard input, manage windows, or inspect the UI hierarchy of applications on X11/GNOME. Supports: (1) Clicking/typing in apps, (2) Resizing/moving windows, (3) Extracting text-based UI trees from apps (A11y), (4) Taking screenshots for visual analysis.
โฌ 0 downloads โ
0 stars Unverified but indexed
Install for OpenClaw
Quick setup
- Download the package from Yavira.
- Extract the archive and review SKILL.md first.
- Import or place the package into your OpenClaw setup.
Package facts
- Download mode
- Yavira redirect
- Package format
- ZIP package
- Source platform
- Tencent SkillHub
- What's included
- SKILL.md, scripts/gui_action.sh, scripts/inspect_ui.py
Validation
- Use the Yavira download entry.
- Review SKILL.md after the package is downloaded.
- Confirm the extracted package contains the expected setup assets.
Install with your agent
Agent handoff
Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually.
- Download the package from Yavira.
- Extract it into a folder your agent can access.
- Paste one of the prompts below and point your agent at the extracted folder.
New install
I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete.
Upgrade existing
I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run.
Trust & source
Release facts
- Source
- Tencent SkillHub
- Verification
- Indexed source record
- Version
- 1.0.0
Provenance
- Publisher
- dreamtraveler13
- Source page
- View original listing
- Canonical URL
- Open canonical page
Documentation
Linux GUI Control
This skill provides tools and procedures for automating interactions with the Linux desktop environment.
1. Identify Target Window
Use wmctrl to find the exact name of the window you want to control. wmctrl -l
2. Inspect UI Hierarchy
For apps supporting accessibility (GNOME apps, Electron apps with --force-renderer-accessibility), use the inspection script to find button names without taking screenshots. python3 scripts/inspect_ui.py "<app_name>"
3. Perform Actions
Use xdotool via the helper script for common actions. # Activate window ./scripts/gui_action.sh activate "<window_name>" # Click coordinates ./scripts/gui_action.sh click 500 500 # Type text ./scripts/gui_action.sh type "Hello World" # Press a key ./scripts/gui_action.sh key "Return"
Operating an App via Text UI
List windows with wmctrl -l. Activate the target window. Run scripts/inspect_ui.py to get the list of buttons and inputs. Use xdotool key Tab and Return to navigate, or click if coordinates are known. If text-based inspection fails, fallback to taking a screenshot and using vision.
Forcing Accessibility in Electron Apps
Many modern apps (VS Code, Discord, Cider, Chrome) need a flag to expose their UI tree: pkill <app> nohup <app> --force-renderer-accessibility > /dev/null 2>&1 &
Tool Reference
wmctrl: Window management (list, activate, move, resize). xdotool: Input simulation (click, type, key, mousemove). dogtail: UI tree extraction via AT-SPI (Accessibility bus). scrot: Lightweight screenshot tool.
Category context
Code helpers, APIs, CLIs, browser automation, testing, and developer operations.
Source: Tencent SkillHub
Largest current source with strong distribution and engagement signals.
Package contents
Included in package
2 Scripts1 Docs
- SKILL.md
- scripts/gui_action.sh
- scripts/inspect_ui.py