Skip to main content

Google Adds “Computer Use” to Gemini on Apple Silicon Macs, Enabling Background Automation

Google Adds “Computer Use” to Gemini on Apple Silicon Macs, Enabling Background Automation

THE TECH CHRONICLE  ·  technology  ·  Friday, November 20, 2026
Google Adds “Computer Use” to Gemini on Apple Silicon Macs, Enabling Background Automation

The feature is limited to Apple Silicon Macs running macOS Sequoia 15.0 or later and is available only to Google AI Plus, Pro, or…

By TechPulse Blog

On November 19 2026, Google announced that the Gemini app for macOS now supports “computer use,” a capability that lets the AI operate desktop applications and web sites in a separate background window while the user’s screen and cursor remain untouched. The feature is limited to Apple Silicon Macs running macOS Sequoia 15.0 or later and is available only to Google AI Plus, Pro, or Ultra subscribers in the United States.

Key Takeaways

  • Google’s Gemini can now click, type, navigate menus, and fill forms across desktop apps and websites without taking control of the user’s screen.
  • The automation runs in an isolated background window that streams a live preview inside the Gemini chat.
  • Access requires an Apple Silicon Mac, macOS Sequoia 15.0+, a paid Google AI Plus/Pro/Ultra plan, and the user must be 18 years or older.
  • Typical use cases demonstrated include 3‑D modeling in Blender, batch photo editing, extracting shipping quotes from PDFs, and assembling multi‑source presentations.
  • Activation is as simple as adding “@Computer use” to a natural‑language prompt.
Metric Value Why it matters
Feature launch date Nov 19 2026 Marks the first AI‑driven desktop automation on macOS without screen hijacking.
Supported hardware Apple Silicon Macs Leverages the ARM‑based architecture for low‑latency AI inference.
Subscription tier Google AI Plus, Pro, Ultra Positions the feature as a premium productivity add‑on.
Geographic rollout United States (English) Initial market focus allows Google to refine controls before broader release.

What “Computer Use” Actually Does

The new capability extends Gemini’s earlier file‑access functions by granting the model the ability to manipulate graphical user interfaces. In practice, Gemini can launch an app, press buttons, type text, navigate menus, and submit forms—all while running inside a sandboxed window that does not interfere with the user’s active workspace. A live preview of the background session is embedded in the chat pane, giving users real‑time visibility and the option to intervene.

Technical Workflow on macOS

When a user includes the token “@Computer use” in a prompt, Gemini translates the natural‑language request into a sequence of UI actions. These actions are executed by a lightweight automation engine that communicates with macOS through standard accessibility APIs. Because the engine runs in a separate process, the primary desktop environment remains responsive, and the cursor is not hijacked. Users can whitelist specific applications, pause execution, or reject any action flagged as sensitive before it is committed.

Demonstrated Use Cases

Google’s showcase video illustrates a parent asking Gemini to convert a child’s butterfly sketch into an animated 3‑D model using Blender, then display the result in an augmented‑reality web app. Additional scenarios include:

  • Batch‑processing a folder of photos—resizing, applying filters, and exporting to a shared album.
  • Scanning PDFs for shipping dimensions, calculating quotes from multiple carrier websites, and compiling the results into a spreadsheet.
  • Gathering data from several online sources, synthesizing it into a slide deck, and applying a consistent design template.

Availability, Requirements, and Pricing Model

The feature is currently limited to English‑speaking users in the United States who are 18 years or older and who hold a personal Google account. Access requires a subscription to one of Google’s paid AI tiers—AI Plus, Pro, or Ultra. The hardware prerequisite is an Apple Silicon Mac running macOS Sequoia 15.0 or later, ensuring compatibility with the latest security and performance enhancements.

From File Access to Full Desktop Automation

Earlier in 2026, Google introduced Gemini Spark for Mac, which allowed the assistant to read and write local files, effectively turning documents into spreadsheets or summarizing text. However, that version could not interact with the graphical elements of installed software. “Computer use” bridges that gap, moving Gemini from a passive data‑retrieval tool to an active desktop collaborator capable of completing multi‑step workflows that previously required manual user input.

Why It Matters

By decoupling AI‑driven automation from the user’s visible workspace, Google addresses a long‑standing usability concern: screen hijacking. The background‑only model preserves workflow continuity while still delivering the productivity boost of AI‑assisted task execution. For power users on Apple Silicon hardware, the feature offers a new layer of integration that could reshape how creative and business applications are orchestrated, especially as large language models become more adept at interpreting intent and translating it into precise UI actions.

Frequently asked questions

Who can use Gemini’s computer‑use feature?

The feature is available to Google AI Plus, Pro, or Ultra subscribers who are at least 18 years old, have a personal Google account, and reside in the United States.

What hardware and software are required?

An Apple Silicon Mac running macOS Sequoia 15.0 or newer is mandatory. The feature does not work on Intel‑based Macs or older macOS versions.

How does Gemini avoid taking over my screen?

All UI actions occur inside an isolated background window. A live preview is streamed into the Gemini chat, and users retain full control of the cursor and primary desktop.

Is there an additional cost beyond the subscription tier?

Computer use is bundled with the paid AI Plus, Pro, or Ultra plans; it is not offered as a free add‑on.

How do I trigger the automation?

Include “@Computer use” in a natural‑language prompt and describe the desired outcome; Gemini will translate the request into UI actions.

Bottom Line

Google’s rollout of “computer use” for Gemini on Apple Silicon Macs introduces a sandboxed, background‑only automation layer that lets the AI manipulate desktop applications and web interfaces without disrupting the user’s view. Limited to paid subscribers in the United States, the feature expands Gemini’s utility from file handling to full‑scale workflow execution, marking a notable step toward seamless AI‑augmented productivity on macOS.

The next phase will likely involve broader language support, expanded geographic availability, and tighter integration with third‑party macOS apps as developers expose more accessibility hooks for AI‑driven control.

Reporting based on: original source.

Comments

Popular posts from this blog

Tracking your plastic: Exposing recycling myths

Tracking your plastic: Exposing recycling myths Marketplace journalists go undercover overseas and pose as recycling brokers to expose the lucrative plastic recycling business. We reveal that Malaysian companies are willing to break the law to buy Canadian plastic and show how some of it is dumped and burned in illegal landfills, where the toxic fumes and run-off appear to be making people sick. Back in Canada, we buy nine tonnes of plastic and secretly track where big companies are taking it. Will it actually get recycled? »»» Subscribe to CBC News to watch more videos: http://bit.ly/1RreYWS Connect with CBC News Online: For breaking news, video, audio and in-depth coverage: http://bit.ly/1Z0m6iX Find CBC News on Facebook: http://bit.ly/1WjG36m Follow CBC News on Twitter: http://bit.ly/1sA5P9H For breaking news on Twitter: http://bit.ly/1WjDyks Follow CBC News on Instagram: http://bit.ly/1Z0iE7O Download the CBC News app for iOS: http://apple.co/25mpsUz Download the CBC News app for ...

Red states now legalizing recreational marijuana too

Red states now legalizing recreational marijuana too The 2020 election proved how broadly accepted recreational marijuana has become throughout the US and across party lines, with measures to legalize recreational pot breezing to victories in Arizona, New Jersey, Montana and South Dakota. (Nov. 12) Subscribe for more Breaking News: https://ift.tt/18F6bii Website: https://apnews.com Twitter: https://twitter.com/AP Facebook: https://ift.tt/2Nv6Z1g Google+: https://ift.tt/seidce Instagram: https://ift.tt/2G5Qog8 ​ You can license this story through AP Archive: https://ift.tt/2ImtqJ5

Two virus survivors get double lung transplants

Two virus survivors get double lung transplants A young paralegal and a car mechanic received lifesaving double lung transplants at Northwestern Medicine in Chicago after COVID-19 destroyed their lungs. (July 30) Subscribe for more Breaking News: https://ift.tt/18F6bii Website: https://apnews.com Twitter: https://twitter.com/AP Facebook: https://ift.tt/2Nv6Z1g Google+: https://ift.tt/seidce Instagram: https://ift.tt/2G5Qog8 ​ You can license this story through AP Archive: https://ift.tt/310Ng1O