computer-use-agents

Mano-P: Open-source GUI-VLA agent for edge devices. #1 on OSWorld (specialized, 58.2%). Runs locally on Apple M4 Mac mini/MacBook — no data leaves your device.Mano-P 是一个开源 GUI-VLA 项目，支持在 Mac mini/MacBook 上或通过算力棒本地运行推理，实现纯视觉驱动的跨平台 GUI 自动化操作。数据完全本地处理，支持复杂多步骤任务规划与执行。

Agent Desktop gives any agent reliable computer use on the desktop. Built with Rust, it sees any app's real UI structure through OS accessibility trees and operates it — refs stay stable and actions stay safe to retry, instead of guessing from pixels.

[ICLR 2026 Oral] ScaleCUA is the open-sourced computer use agents that can operate on cross-platform environments (Windows, macOS, Ubuntu, Android).

"AnyTool: Universal Tool-Use Layer for AI Agents"

Open-source alternative to Claude Co-Work built by Claude. with BYOK

[ECCV 2026] Official Repository for "DualTAP: A Dual-Task Adversarial Protector for Mobile MLLM Agents"

A Swift library for macOS automation — mouse, keyboard, screenshots, image recognition, and AI-powered agents.

Open-source framework for computer use agents: VeriGen verifiable task synthesis, online RL training (AgentRL), and OSWorld/ScienceBoard evaluation.

let LLMs control your desktop for tasks

AOI: a model-agnostic perception layer giving computer-use agents adaptive video + audio perception with zero retraining, plus DynaCU-Bench (100 dynamic browser tasks). Paper + benchmark + code.

Repository for the implementation of MacArena

Papers, benchmarks, demos, and tools for multimodal coding agents: visual feedback for UI, CAD, 3D, games, charts, and robotics.

DeskForge: Dense Supervision from Desktop Environments for Computer-Use Agents

Computer Use Examples with API Integration Full Stack

A Lightweight Desktop GUI Agent via Dynamic Focus Vision and Hierarchical Memory. Your AI-powered hands and eyes for desktop automation.

Official code for "Relevance Does Not Imply Applicability: Experience Activation for Personal GUI Agents".

A clicker for LLMs: operate web pages and desktop screens via shell commands.

Volcengine Mobile Use Agent plugin for DeepSeek Harness

AI-powered desktop automation agent. Takes screenshots, sends to any LLM (OpenAI-compatible), receives a ctions, executes mouse/keyboard operations, and loops until task is complete. Supports SOM (element indexing via Windows UIA) and pure vision modes AI 驱动的桌面自动化 Agent。截图 → 发送给 LLM → 执行鼠标键盘操作 → 循环直到任务完成。支持 SOM 模式（Windows UIA 元素索引）和纯视觉模式。

Lightweight recorder that logs everyday computer use as structured traces for agent development