at-spi

Verified control of the whole desktop for agents on Windows and Linux: apps with no API, windows, shell, browser. MCP server + CLI + REST API.

⛔ 已停止维护（EOL 2026-09-13，仓库只读）· Deprecated & archived：给纯文本模型的数理化视觉通道 + GUI 控制；已被 DeepSeek-V4.1 原生多模态取代。Numeric-grade vision channel + GUI control for text-only models — superseded by native multimodal DeepSeek-V4.1.

Edit text anywhere with AI! ✨

Gnome's at-spi (Assistive Technology Service Provider Interface) bindings for Rust.

Linux/X11 computer-use tools for AI agents — Pi, Claude Code, OpenCode, any MCP-aware client. AT-SPI + xdotool, ~1k LOC. Drop-in replacement for the macOS pi-computer-use.

AI-native Linux, desktop to server — 187 tools and a semantic Wayland compositor to control your OS through natural language

Context-aware Windows-style middle-click autoscrolling for Linux on GNOME Wayland and X11

A high-performance C++ Hyprland compositor plugin & Python D-Bus AT-SPI Coordinate Fusion engine for 100% pixel-perfect, visionless AI agent desktop automation under Wayland.

A small Model Context Protocol server for GNOME Wayland desktop automation

a dockable magnifier for hyperland based of windows xp own mnagnifier app

Building a tree of objects on the accessibility bus.

Cross-platform desktop automation CLI for LLM agents — control apps via native accessibility APIs on Windows, Linux, and macOS

Playwright-like testing tool for Linux desktop applications test automtion

LAI — a native OS agent for Linux. Drives the desktop via the AT-SPI accessibility tree instead of guessing from screenshots

Gather stats on AT-SPI2 events

Computer use for Hyprland — an MCP server giving AI agents semantic and pixel-level control of Wayland apps, with persistent versioned per-app memory.

Semantic I/O and capability broker for Linux agents — typed, policy-gated control of desktop apps, native APIs, and MCPs.

Apex Commander — desktop hands for your agents. AT-SPI-first Linux computer-use via CLI + MCP.

MCP server exposing the official ChatGPT Desktop app (Ubuntu/Linux) as 6 MCP tools via AT-SPI accessibility — idempotent, interference-safe, stress-tested.