Setup & Installation
Or with the ClawHub CLI, for registry-managed skill folders outside a full OpenClaw workspace:
Version History
midscene-ios-automation 1.0.4 - Added explicit documentation of required environment variables in the skill manifest with an env section. - Included security guidance for protecting API keys and recommended adding `.env` to `.gitignore`. - No functional changes; documentation update only.
What This Skill Does
Vision-driven iOS automation that operates entirely from screenshots, requiring no DOM access or accessibility labels. Sends natural language commands to any iOS app via WebDriverAgent and a vision-capable LLM. Works with apps built on any technology stack.
Works on any iOS app regardless of how it was built, since it reads the screen visually instead of relying on accessibility labels or DOM structure.
When to use it
- Automating repetitive UI tasks in iOS apps during QA testing
- Extracting data from iOS apps that lack a web or API interface
- Navigating iOS settings programmatically for device configuration
- Verifying iOS app UI flows without writing XCTest or UITest code
- Capturing screen state during multi-step iOS app walkthroughs
Example Workflow
Here's how your AI assistant might use this skill in practice.
User asks: Open Settings, go to Wi-Fi, and tell me the name of the connected network
- 1Connect to the iOS device via WebDriverAgent
- 2Take a screenshot to confirm the current screen state
- 3Run act with prompt "open Settings and navigate to Wi-Fi, tell me the connected network name"
- 4Take a screenshot to capture the Wi-Fi screen
- 5Disconnect from the device and report the network name found
Connected Wi-Fi network name extracted from the Settings > Wi-Fi screen
Requirements
Accounts, API keys, or tools you or your AI assistant may need to set up while using this skill.