Teach-and-Repeat: Accurately Extracting Operational Knowledge from Mobile Screen

arXiv:2604.09815v1 Announce Type: new Abstract: Computer-use agents that combine GUI interaction with structured API calls via the Model Context Protocol (MCP) show promise for

arXiv:2605.26546v1 Announce Type: new Abstract: Mobile graphical user interface (GUI) agents enable AI models to autonomously operate smartphones on behalf of users. However, most

arXiv:2604.06995v1 Announce Type: new Abstract: Existing Graphical User Interface (GUI) reasoning tasks remain challenging, particularly in UI understanding. Current methods

arXiv:2610.20939v1 Announce Type: new Abstract: Online reinforcement learning (RL) with verifiable rewards has driven rapid progress in mathematics, coding, and tool use, but

arXiv:2604.09574v1 Announce Type: new Abstract: The rise of autonomous GUI agents has triggered adversarial countermeasures from digital platforms, yet existing research

arXiv:2609.30887v1 Announce Type: new Abstract: Mobile GUI agents complete tasks using GUI actions like taps and swipes. These actions are broadly applicable across applications,

arXiv:2605.01208v1 Announce Type: new Abstract: Vision-language model based graphical user interface (GUI) agents have shown strong interaction capabilities. However, they often