Requirements
- Target platform
- OpenClaw
- Install method
- Manual import
- Extraction
- Extract archive
- Prerequisites
- OpenClaw
- Primary doc
- SKILL.md
Mouse and keyboard automation using xdotool. Use when clicking Chrome extension icons, typing into GUI apps, switching browser tabs, automating desktop UI, o...
Mouse and keyboard automation using xdotool. Use when clicking Chrome extension icons, typing into GUI apps, switching browser tabs, automating desktop UI, o...
Hand the extracted package to your coding agent with a concrete install brief instead of figuring it out manually.
I downloaded a skill package from Yavira. Read SKILL.md from the extracted folder and install it by following the included instructions. Tell me what you changed and call out any manual steps you could not complete.
I downloaded an updated skill package from Yavira. Read SKILL.md from the extracted folder, compare it with my current installation, and upgrade it while preserving any custom configuration unless the package docs explicitly say otherwise. Summarize what changed and any follow-up checks I should run.
Automate mouse, keyboard, and window operations on the Linux desktop. Primary use: clicking Chrome extension icons, interacting with GUI apps when browser CDP isn't connected.
# Find a window xdotool search --name "Google Chrome" # Click at screen coordinates xdotool mousemove 1800 56 click 1 # Type text into focused window xdotool type "hello world" # Screenshot current state scrot /tmp/snap.png
# Find Chrome window, focus it, click at position WIN=$(xdotool search --name "Google Chrome" | head -1) xdotool windowactivate --sync "$WIN" sleep 0.3 xdotool mousemove X Y click 1
Use this when you need to click an element but don't know its exact position: bash ~/.openclaw/workspace/skills/xdotool-control/scripts/snap_verify_click.sh \ "Google Chrome" \ # Window name pattern "extension_icon" \ # What to look for (label for your snap files) 1830 56 # Coordinates to click Or use the full loop script for unknown positions: bash ~/.openclaw/workspace/skills/xdotool-control/scripts/find_and_click.sh \ "Google Chrome" \ /tmp/target_icon.png \ # Template image to match (ImageMagick compare) 10 # Max attempts
bash ~/.openclaw/workspace/skills/xdotool-control/scripts/click_extension.sh "OpenClaw" # or bash ~/.openclaw/workspace/skills/xdotool-control/scripts/click_extension.sh "Dawn" This focuses Chrome and clicks the extensions puzzle-piece area, then scans for the named extension.
# Switch to next tab WIN=$(xdotool search --name "Google Chrome" | head -1) xdotool windowactivate --sync "$WIN" xdotool key ctrl+Tab # Switch to specific tab (1-indexed) xdotool key ctrl+2 # Tab 2 xdotool key ctrl+3 # Tab 3 # Open new tab xdotool key ctrl+t # Type a URL into address bar xdotool key ctrl+l sleep 0.2 xdotool type "https://example.com" xdotool key Return
WIN=$(xdotool search --name "Terminal" | head -1) xdotool windowactivate --sync "$WIN" sleep 0.2 xdotool type --clearmodifiers "command to type here" xdotool key Return
SESSION=$(tmux ls | grep claude-session | head -1 | cut -d: -f1) tmux send-keys -t "$SESSION" "Yes" Enter
# List all windows with names xdotool search --name "" | while read wid; do name=$(xdotool getwindowname "$wid" 2>/dev/null) [ -n "$name" ] && echo "$wid $name" done | head -20 # Get window geometry (position + size) xdotool getwindowgeometry $WIN_ID # Move window to front xdotool windowraise $WIN_ID # Resize window xdotool windowsize $WIN_ID 1280 800 # Move window xdotool windowmove $WIN_ID 0 0
# Full desktop screenshot scrot /tmp/desktop.png # Specific window scrot -u /tmp/active_window.png # Currently active window # Crop a region (x,y,width,height) scrot -a 1400,0,480,60 /tmp/toolbar.png # With delay scrot -d 2 /tmp/delayed.png Read screenshots with Claude's Read tool โ it renders images inline.
# Chrome toolbar extension icons are typically at: # y โ 56 (vertical center of toolbar) # x varies by number of pinned extensions, roughly: # Last icon: screen_width - 30 # Second-to-last: screen_width - 60 # Puzzle piece: screen_width - 90 (unpinned extensions menu)
# Always auto-detect screen width โ never hardcode read SCREEN_W SCREEN_H <<< $(xdotool getdisplaygeometry) TOOLBAR_Y=56 # Take a toolbar snapshot first to verify positions scrot -a "$((SCREEN_W-300)),0,300,70" /tmp/toolbar_snap.png # Read /tmp/toolbar_snap.png to see icon positions visually # Then click xdotool mousemove $((SCREEN_W - 60)) $TOOLBAR_Y click 1
# Required sudo apt-get install xdotool scrot # Optional โ enables template matching in find_and_click.sh sudo apt-get install imagemagick # Check all deps at once: for dep in xdotool scrot convert; do command -v "$dep" &>/dev/null && echo "โ $dep" || echo "โ $dep (missing)" done
Always windowactivate --sync before clicking โ without --sync, the click may fire before focus lands Add sleep 0.3 after focus change before interacting with Chrome Coordinates are screen-absolute, not window-relative โ factor in window position from getwindowgeometry xdotool type vs xdotool key: use type for text strings, key for special keys (ctrl+t, Return, Escape) --clearmodifiers on type prevents Shift/Ctrl state from leaking into typed text scrot -u captures only the currently active window โ make sure to activate the right window first ImageMagick compare can do pixel-level template matching for verify loops (see find_and_click.sh)
Code helpers, APIs, CLIs, browser automation, testing, and developer operations.
Largest current source with strong distribution and engagement signals.