Skip to content

UI-TARS

Category: OSS Agent (GUI Automation / Vision-Language Model)

UI-TARS is an open-source multimodal agent built on a vision-language model (VLM) that can perceive and interact with graphical user interfaces across desktop, mobile, and gaming environments. It was developed by ByteDance and is the underlying model powering the Agent TARS ecosystem.

The model interprets screenshots, reasons about the UI state, and outputs executable actions (clicks, typing, scrolling) as structured pyautogui code. It achieves state-of-the-art results on GUI interaction benchmarks including OSWorld, ScreenSpot, and AndroidWorld.

Key facts

FieldValue
MaintainerByteDance / ByteDance-Seed
LicenseApache 2.0 (free, open-source)
Stars11,000+
CategoryOSS Agent - GUI automation via native VLM
PricingFree
Model weightsHuggingFace: ByteDance-Seed/UI-TARS-1.5-7B

Variants

PackageWhat it is
ui-tars (PyPI)Python post-processing library: parse model outputs into pyautogui code
UI-TARS-desktopElectron desktop app with local/remote operators
@agent-tars/cli (npm)CLI wrapper that routes tasks to a UI-TARS or cloud model backend

Safety note

Because UI-TARS can autonomously navigate GUIs including CAPTCHA flows, ByteDance includes a safety notice: the model must not be used for unauthorized access, credential theft, or any activity that bypasses access controls. Internal safety evaluations are ongoing. Always operate within the terms of the target system.