目录：

UI Agents 知识星球UI Agents 综述资料【Update 2024.12.01】UI Agents 其他汇总信息UI Agents 论文列表【Update 2024.11.09】

UI Agents 知识星球

 

UI Agents 综述资料【Update 2024.12.01】

• UI Agents（智能体）技术综述, Bilibili, Youtube, Breezedeus, 2024.11

• [2411.18279] Large Language Model-Brained GUI Agents: A Survey

• [2411.04890] GUI Agents with Foundation Models: A Comprehensive Survey, Huawei Noah’s Ark Lab

• [2411.02006] Foundations and Recent Trends in Multimodal Mobile Agents: A Survey

UI Agents 其他汇总信息

• https://github.com/showlab/Awesome-GUI-Agent

UI Agents 论文列表【Update 2024.11.09】

• [2411.00820] AutoGLM: Autonomous Foundation Agents for GUIs, Zhipu

• [2411.02337] WebRL: Training LLM Web Agents via Self-Evolving Online Curriculum Reinforcement Learning, Zhipu

• [2410.24024] AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents, Zhipu

• [2410.15164] SPA-Bench: A Comprehensive Benchmark for SmartPhone Agent Evaluation

• [2410.19461] EDGE: Enhanced Grounded GUI Understanding with Enriched Multi-Granularity Synthetic Data

• [2410.22552] Auto-Intent: Automated Intent Discovery and Self-Exploration for Large Language Model Web Agents

• [2410.23555] From Context to Action: Analysis of the Impact of State Representation and Context on the Generalization of Multi-Turn Web Navigation Agents

• [2410.22916] Explainable Behavior Cloning: Teaching Large Language Model Agents through Learning by Demonstration

• [2410.17520] MobileSafetyBench: Evaluating Safety of Autonomous Agents in Mobile Device Control

• [2410.19609] OpenWebVoyager: Building Multimodal Web Agents via Iterative Real-World Exploration, Feedback and Optimization

• [2406.19263] Read Anywhere Pointed: Layout-aware GUI Screen Reading with Tree-of-Lens Grounding

• [2405.16247] AutoManual: Generating Instruction Manuals by LLM Agents via Interactive Environmental Learning

• [2312.11190] VisionTasker: Mobile Task Automation Using Vision Based UI Understanding and LLM Task Planning