INREACT: An Inspire-Then-Reinforce Training Framework For Multimodal GUI Agent

,

• Publication year

  2025

• Venue

  Conference on Empirical Methods in Natural Language Processing

• Publication date

  Unknown publication date

• Fields of study

  Computer Science, Education

• Identifiers
  DOI 10.18653/v1/2025.findings-emnlp.486
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• AutoGUI: Scaling GUI Grounding with Automatic Functionality Annotations from LLMs

  2025cited by this paper
• Visual-RFT: Visual Reinforcement Fine-Tuning

  2025cited by this paper
• UI-TARS: Pioneering Automated GUI Interaction with Native Agents

  2025cited by this paper
• The Thirteenth International Conference on Learning Representations, ICLR 2025, Singapore, April 24-28, 2025

  2025cited by this paper
• GUI-R1 : A Generalist R1-Style Vision-Language Action Model For GUI Agents

  2025cited by this paper
• ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use

  2025influential reference
• VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Model

  2025cited by this paper
• UI-R1: Enhancing Efficient Action Prediction of GUI Agents by Reinforcement Learning

  2025cited by this paper
• SpiritSight Agent: Advanced GUI Agent with One Look

  2025cited by this paper
• InfiGUIAgent: A Multimodal Generalist GUI Agent with Native Reasoning and Reflection

  2025influential reference
• Harnessing Webpage UIs for Text-Rich Visual Understanding

  2024cited by this paper
• ShowUI: One Vision-Language-Action Model for GUI Visual Agent

  2024influential reference
• Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction

  2024cited by this paper
• Aria-UI: Visual Grounding for GUI Instructions

  2024cited by this paper
• OmniParser for Pure Vision Based GUI Agent

  2024cited by this paper
• SeeClick: Harnessing GUI Grounding for Advanced Visual GUI Agents

  2024influential reference
• Mobile-Agent: Autonomous Multi-Modal Mobile Device Agent with Visual Perception

  2024cited by this paper
• DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models

  2024cited by this paper
• OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web

  2024cited by this paper
• Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

  2024cited by this paper
• AutoWebGLM: A Large Language Model-based Web Navigating Agent

  2024cited by this paper
• GUICourse: From General Vision Language Models to Versatile GUI Agents

  2024cited by this paper
• Chain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation

  2024influential reference
• Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution

  2024influential reference
• AppAgent: Multimodal Agents as Smartphone Users

  2023cited by this paper
• Intern VL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks

  2023cited by this paper
• Qwen-VL: A Frontier Large Vision-Language Model with Versatile Abilities

  2023influential reference
• Mind2Web: Towards a Generalist Agent for the Web

  2023influential reference
• ReAct: Synergizing Reasoning and Acting in Language Models

  2022influential reference
• ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshots

  2022cited by this paper
• ZeRO: Memory optimizations Toward Training Trillion Parameter Models

  2019cited by this paper
• Pattern Recognition

  2014cited by this paper
• On to experiment

  1988cited by this paper

• No citing papers are available for this paper.