arXiv

See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation

Title: See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation

Abstract: Achieving reliable robotic manipulation hinges on the ability to measure task advancement through clear, actionable milestones. This awareness of progress allows a system to anchor its current operational status, predict verifiable intermediate outcomes, and identify and recover from failures when movement halts. To implement this capability, we present \textbf{S}ee, \textbf{P}lan, \textbf{R}ewind (SPR), a progress-conscious vision-language-action framework that dynamically translates language commands into a series of spatial subgoals. SPR functions via a continuous loop comprising three stages: Seeing the present condition and the forthcoming milestone, Planning a path to the subsequent 2D waypoint, and Rewinding to a recoverable position if failure occurs, all while tracking progress against the anticipated sequence. This closed-loop methodology facilitates effective error correction without the need for extra training data or supplementary models. Comprehensive experiments confirm the framework’s efficacy, generalizability, and resilience: SPR surpasses the MolmoAct baseline by 5\% on the LIBERO benchmark. Furthermore, on the demanding LIBERO-Plus benchmark, which features unseen instructions and initial states, SPR demonstrates state-of-the-art robustness with the minimal performance decline, outperforming OpenVLA-OFT and UniVLA to exhibit superior out-of-distribution robustness.


Source: arXiv Generated at: 2026-06-02 00:00:00 UTC

Related Articles

Withings Debuts New Smart Scale Marketed Toward GLP-1 Users
Bloomberg

Withings Debuts New Smart Scale Marketed Toward GLP-1 Users

Withings launched a new smart scale targeting GLP-1 users, offering advanced body composition analysis. This device help...

TechCrunch

Rocket engine startup Impulse raises $500 million to hire people, not AI

Rocket engine startup Impulse Space raised $500 million to hire 200 engineers, prioritizing human expertise over AI for ...

Startup Impulse Space Raises $500 Million, Valued at $4 Billion
Bloomberg

Startup Impulse Space Raises $500 Million, Valued at $4 Billion

Impulse Space secured $500 million in funding, achieving a $4 billion valuation. This investment supports the developmen...

Walmart’s Answer to Apple Pay Wants to Be Your Favorite Financial App
Bloomberg

Walmart’s Answer to Apple Pay Wants to Be Your Favorite Financial App

Walmart’s new financial app aims to rival Apple Pay, positioning itself as a preferred digital payment and banking solut...

Nvidia Is Bigger, Stronger, and Trying to Slay the Laptop Dragon Again
Bloomberg

Nvidia Is Bigger, Stronger, and Trying to Slay the Laptop Dragon Again

Nvidia unveiled the RTX Spark Superchip at Computex 2026, aiming to challenge Intel’s PC dominance and modernize hardwar...

TechCrunch

Pacific Fusion’s latest prototype packs 440 gigawatts into an 80-nanosecond burst

Pacific Fusion’s new prototype delivers 440 gigawatts in 80 nanoseconds, securing over $1 billion in funding and enablin...