FreeVisit Website
What is Openclick?
Openclick (ai & automation): Drive macOS UI automation from natural language prompts using LLMs. Openclick is an experimental command-line interface (CLI) tool designed to automate macOS user interface (UI) actions using large language models (LLMs) and the macOS Accessibility APIs. Users provide a natural language prompt, which an LLM then translates into a plan of UI actions (such as clicks, keystrokes, and accessibility reads). Key capabilities: Natural language prompt-to-UI action conversion, Integration with macOS Accessibility APIs, Pre-execution plan review, editing, and abort options, Support for various LLMs (OpenAI, Anthropic, DeepSeek, Ollama, LM Studio, custom adapters), Flexible deployment as CLI, menu bar app, or daemon. Openclick is free to use with no paid tier.
TL;DR - Openclick
- Automates macOS UI actions using natural language prompts and LLMs.
- Translates prompts into UI action plans (clicks, keystrokes, reads) via Accessibility APIs.
- Supports various LLMs, including local and cloud options, with plan review before execution.
Pricing: Free forever
Best for: Individuals & startups
Pros & Cons
Pros
- Simplifies macOS automation with natural language
- Provides user control with plan review before execution
- Offers flexibility with bring-your-own-model support (local and cloud)
- Ensures privacy by keeping prompts and screen contents local by default
- Open-source and MIT-licensed, encouraging community contributions
Cons
- Currently experimental with potential rough edges
- Effectiveness depends on the quality of the LLM and app's Accessibility support
- Requires Node 20+ and accessibility permissions setup
Key Features
Natural language prompt-to-UI action conversionIntegration with macOS Accessibility APIsPre-execution plan review, editing, and abort optionsSupport for various LLMs (OpenAI, Anthropic, DeepSeek, Ollama, LM Studio, custom adapters)Flexible deployment as CLI, menu bar app, or daemonLocal-by-default privacy with no accounts or telemetryDetailed logging of all Accessibility API calls
Pricing
Free
Openclick is completely free to use with no hidden costs.
About Openclick
LCLouis CorneloupOpenclick is an experimental command-line interface (CLI) tool designed to automate macOS user interface (UI) actions using large language models (LLMs) and the macOS Accessibility APIs. Users provide a natural language prompt, which an LLM then translates into a plan of UI actions (such as clicks, keystrokes, and accessibility reads). Openclick then executes this plan on the macOS system.
This tool is ideal for developers, power users, and anyone looking to automate repetitive macOS tasks without writing complex scripts. It offers a flexible approach by allowing users to bring their own LLM, supporting cloud-based models like OpenAI and Anthropic, as well as local options via Ollama or LM Studio. Before execution, the generated plan is printed, giving users the opportunity to review, edit, or abort the actions, ensuring control and safety. It can be used as a CLI, a menu bar app, or a long-running daemon for scripts and hooks.
Reviews
Be the first to review Openclick
Your take helps the next buyer. Verified LinkedIn reviewers get a badge.
Write a reviewExplore More
Openclick FAQ
How does openclick ensure user safety and control before executing UI actions?
Openclick prioritizes user safety by printing the model's proposed plan of UI actions before anything is executed. Users can review this plan, make edits if necessary, or choose to abort the operation entirely. Additionally, it defaults to a '--dry-run' mode, and every Accessibility API call is logged for transparency.
What kind of LLMs can I use with openclick, and how do I configure them?
Openclick supports a variety of LLMs, including cloud-based services like OpenAI, Anthropic, DeepSeek, Meta, and Mistral, as well as local models via Ollama or LM Studio. Users can bring their own API keys and switch between models per run using the '--model' flag. This allows for flexibility and enhanced privacy when dealing with sensitive information by using local models.
Beyond the command line, are there other ways to interact with or deploy openclick?
Yes, openclick offers multiple interaction methods. In addition to its primary CLI interface, it can be used as a menu bar application for quick access or configured as a long-running daemon. The daemon mode is particularly useful for integrating openclick into scripts and system hooks for continuous automation.
What are the core technical components that make openclick function?
Openclick is built around two main components: an LLM that interprets user prompts and generates a plan of UI actions, and a runner that executes this plan by interacting directly with the macOS Accessibility APIs. It acts as a thin shell connecting these two powerful systems to enable natural language-driven UI automation.
What are the system requirements for running openclick on macOS?
To run openclick, your macOS system needs to have Node.js version 20 or higher installed. Additionally, you must grant openclick the necessary accessibility permissions within your macOS system settings for it to be able to interact with and control other applications' user interfaces.
Source: openclick.sh