microsoft/UFO

microsoft/UFO

Description: UFO³: Weaving the Digital Agent Galaxy

Language: Python

License: MIT

Stars: 9127

Forks: 1033

Open issues: 75

Created: 2024-01-08T05:07:52Z

Pushed: 2026-06-26T04:16:32Z

Default branch: main

Fork: no

Archived: no

README:

UFO³ : Weaving the Digital Agent Galaxy

From Single Device Agent to Multi-Device Galaxy

📖 Language / 语言: English | 中文

📚 Quick Links: 🌌 UFO³ README • 🖥️ UFO² README • 📖 Full Documentation

---

🎯 Choose Your Path

UFO³ Multi-Device Agent Galaxy

✨ NEW & RECOMMENDED

Perfect for:

• 🔗 Cross-device collaboration workflows
• 📊 Complex multi-step automation
• 🎯 DAG-based task orchestration
• 🌍 Heterogeneous platform integration

Key Features:

• Constellation: Task decomposition into executable DAGs
• Dynamic DAG editing for adaptive workflow evolution
• Asynchronous execution with parallel task coordination
• Unified AIP protocol for secure agent communication

📖 [Galaxy Documentation →](./galaxy/README.md) 📖 [Galaxy Quick Start →](https://microsoft.github.io/UFO/getting_started/quick_start_galaxy/) ⭐ Online Docs

UFO² Desktop AgentOS

STABLE & BATTLE-TESTED

Perfect for:

• 💻 Single Windows automation
• ⚡ Quick task execution
• 🎓 Learning agent basics
• 🛠️ Simple workflows

Key Features:

• Deep Windows OS integration
• Hybrid GUI + API actions
• Proven reliability
• Easy setup
• Can serve as Galaxy device agent

📖 [UFO² Documentation →](./ufo/README.md)

---

🎬 See UFO³ Galaxy in Action

Watch how UFO³ Galaxy orchestrates complex workflows across multiple devices:

---

🌟 What's New in UFO³?

Evolution Timeline

%%{init: {'theme':'base', 'themeVariables': { 'primaryColor':'#E8F4F8','primaryTextColor':'#1A1A1A','primaryBorderColor':'#7CB9E8','lineColor':'#A8D5E2','secondaryColor':'#B8E6F0','tertiaryColor':'#D4F1F4','fontSize':'16px','fontFamily':'Segoe UI, Arial, sans-serif'}}}%%
graph LR
A["🎈 UFO
February 2024
GUI Agent for Windows"]
B["🖥️ UFO²
April 2025
Desktop AgentOS"]
C["🌌 UFO³ Galaxy
November 2025
Multi-Device Orchestration"]

A -->|Evolve| B
B -->|Scale| C

style A fill:#E8F4F8,stroke:#7CB9E8,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
style B fill:#C5E8F5,stroke:#5BA8D0,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15
style C fill:#A4DBF0,stroke:#3D96BE,stroke-width:2.5px,color:#1A1A1A,rx:15,ry:15

🚀 UFO³ = Galaxy (Multi-Device Orchestration) + UFO² (Device Agent)

UFO³ introduces Galaxy, a revolutionary multi-device orchestration framework that coordinates intelligent agents across heterogeneous platforms. Built on five tightly integrated design principles:

1. 🌟 Declarative Decomposition into Dynamic DAG - Requests decomposed into structured DAG with TaskStars and dependencies for automated scheduling and runtime rewriting

2. 🔄 Continuous Result-Driven Graph Evolution - Living constellation that adapts to execution feedback through controlled rewrites and dynamic adjustments

3. ⚡ Heterogeneous, Asynchronous & Safe Orchestration - Capability-based device matching with async execution, safe locking, and formally verified correctness

4. 🔌 Unified Agent Interaction Protocol (AIP) - WebSocket-based secure coordination layer with fault tolerance and automatic reconnection

5. 🛠️ Template-Driven MCP-Empowered Device Agents - Lightweight toolkit for rapid agent development with MCP integration for tool augmentation

| Aspect | UFO² | UFO³ Galaxy | |--------|------|-------------| | Architecture | Single Windows Agent | Multi-Device Orchestration | | Task Model | Sequential ReAct Loop | DAG-based Constellation Workflows | | Scope | Single device, multi-app | Multi-device, cross-platform | | Coordination | HostAgent + AppAgents | ConstellationAgent + TaskOrchestrator | | Device Support | Windows Desktop | Windows, Linux, Android (more coming) | | Task Planning | Application-level | Device-level with dependencies | | Execution | Sequential | Parallel DAG execution | | Device Agent Role | Standalone | Can serve as Galaxy device agent | | Complexity | Simple to Moderate | Simple to Very Complex | | Learning Curve | Low | Moderate | | Cross-Device Collaboration | ❌ Not Supported | ✅ Core Feature | | Setup Difficulty | ✅ Easy | ⚠️ Moderate | | Status | ✅ LTS (Long-Term Support) | ⚡ Active Development |

🎓 Migration Path

For UFO² Users: 1. ✅ Keep using UFO² – Fully supported, actively maintained 2. 🔄 Gradual adoption – Galaxy can use UFO² as Windows device agent 3. 📈 Scale up – Move to Galaxy when you need multi-device capabilities 4. 📚 Learning resources – [Migration Guide](./documents/docs/getting_started/migration_ufo2_to_galaxy.md)

---

✨ Capabilities at a Glance

🌌 Galaxy Framework – What's Different?

🌟 Constellation Planning

User Request
↓
ConstellationAgent
↓
[Task DAG]
/ | \
Task1 Task2 Task3
(Win) (Linux)(Mac)

Benefits:

• Cross-device dependency tracking
• Parallel execution optimization
• Cross-device dataflow management

🎯 Device Assignment

Selection Criteria
• Platform
• Resource
• Task requirements
• Performance history
↓
Auto-Assignment
↓
Optimal Devices

Smart Matching:

• Capability-based selection
• Real-time resource monitoring
• Dynamic reallocation

📊 Orchestration

Task1 → Running ✅
Task2 → Pending ⏸️
Task3 → Running 🔄
↓
Completion
↓
Final Report

Orchestration:

• Real-time status updates
• Automatic error recovery
• Progress tracking with feedback

---

🪟 UFO² Desktop AgentOS – Core Strengths

UFO² serves dual roles: standalone Windows automation and Galaxy device agent for Windows platforms.

As Galaxy Device Agent:

• Receives tasks from ConstellationAgent via Galaxy orchestration layer
• Executes Windows-specific operations using proven UFO² capabilities
• Reports status and results back to TaskOrchestrator
• Participates in cross-device workflows seamlessly

---

🚀 Quick Start Guide

Choose your path and follow the detailed setup guide:

🌌 Galaxy Quick Start

For cross-device orchestration

# 1. Install
pip install -r requirements.txt

# 2. Configure ConstellationAgent
copy config\galaxy\agent.yaml.template config\galaxy\agent.yaml
# Edit and add your API keys

# 3. Configure devices
# Edit config\galaxy\devices.yaml to register your devices

#...