#gui-automation Repositories
Discover 19 active open source GitHub repositories tagged with #gui-automation, accumulating 72,628 total stars (averaging 3,822 stars per project). Leading this topic is microsoft/OmniParser with 25,630 stars.
19 repositories total
A cross-platform GUI automation Python module for human beings. Used to programmatically control the mouse & keyboard.
๐พ Open Computer Use โ Open-Source Alternative to Codex Computer Use
Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook โ no data leaves your device. Mano-P is an open-source GUI-VLA project that supports local inference on Mac mini/MacBook or via compute stick, enabling purely vision-driven cross-platform GUI automation operations. Data is processed entirely locally, supporting planning and execution of complex multi-step tasks.
For EHRs, payer portals, and any app your team clicks through. A person or an agent shows the task; OpenAdapt turns it into a local program that repeats the steps with no model calls, checks each save, and stops when something doesn't match.
OpenGUI is an Android GUI agent framework for phone-use AI that can see, plan, and operate real mobile apps through the GUI.
This repository provides valuable reference for researchers in the field of multimodality, please start your exploratory travel in RL-based Reasoning MLLMs!
AgentCPM-GUI: An on-device GUI agent for operating Android apps, enhancing reasoning ability with reinforcement fine-tuning for efficient task execution.
[dsh] A more powerful visual toolkit designed for text-only models: one-line installation and usage, direct image recognition by pasting images, multi-image Q&A, screenshot-to-frontend UI restoration, and more๏ฝDeepSeek Harness-native integration for agent-vision-toolkit: image Q&A, long-screenshot OCR, UI restoration, grounding, pixel diff, Artifacts, and Web UI.
State of the Art 82% OSWorld Computer Using Agent, production-ready. Remote and Local! Setup using one API Key
Official implementation of AppAgentX: Evolving GUI Agents as Proficient Smartphone Users
Simple rEFInd install script for the Steam Deck (with GUI customization)
Frequently Asked Questions
What is the most popular #gui-automation repository on GitHub?
The top ranked open source #gui-automation project on GitHub is microsoft/OmniParser with 25,630 stars. A simple screen parsing tool towards pure vision based GUI agent
Which programming languages are most used in #gui-automation repositories?
Among the top ranked #gui-automation projects on GitHub, the most common programming languages are Python, TypeScript, Jupyter Notebook, C.
How is the #gui-automation repository ranking calculated?
We track 19 active open source repositories tagged with #gui-automation (500+ stars), totaling 72,628 stars with an average of 3,822 stars per repository. Rankings update daily from the GitHub API.