arXiv

From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model

Title: Bridging Abstraction and Instantiation: Acquiring Behavioral Representations for Vision-Language-Action Models

Abstract: Vision-Language-Action (VLA) models frequently encounter performance drops when facing distribution shifts, primarily due to difficulties in acquiring generalized behavioral representations that span diverse environments. Current methods typically rely on action-centric latent variables to build these representations; however, they are often hindered by static execution alignment and short-horizon temporal fragmentation, which result in inconsistent performance within complex scenarios. To overcome these challenges, we introduce BehaviorVLA, a framework designed to enable robust manipulation by learning temporally coherent behavioral representations. This framework comprises two symmetric modules: (1) the Visuomotor Behavior Encoder (VBE), which employs a causal Mamba-based architecture to consolidate long-horizon trajectory data into a cohesive behavior representation; and (2) the Phase-conditioned Behavior Decoder (PBD), which translates this representation into precise actions by dynamically synchronizing task-level priors with real-time execution progress. Our evaluations on RoboTwin 2.0, LIBERO, and CALVIN reveal state-of-the-art success rates of 58%, 98%, and an average length of 4.36, respectively. Furthermore, in real-world sim-to-real transfer tasks, BehaviorVLA achieves performance comparable to OpenVLA-OFT while utilizing merely 50% of the demonstration data, highlighting its exceptional data efficiency and generalization capabilities.


Source: arXiv Generated at: 2026-06-02 00:00:00 UTC

Related Articles

Withings Debuts New Smart Scale Marketed Toward GLP-1 Users
Bloomberg

Withings Debuts New Smart Scale Marketed Toward GLP-1 Users

Withings launched a new smart scale targeting GLP-1 users, offering advanced body composition analysis. This device help...

TechCrunch

Rocket engine startup Impulse raises $500 million to hire people, not AI

Rocket engine startup Impulse Space raised $500 million to hire 200 engineers, prioritizing human expertise over AI for ...

Startup Impulse Space Raises $500 Million, Valued at $4 Billion
Bloomberg

Startup Impulse Space Raises $500 Million, Valued at $4 Billion

Impulse Space secured $500 million in funding, achieving a $4 billion valuation. This investment supports the developmen...

Walmart’s Answer to Apple Pay Wants to Be Your Favorite Financial App
Bloomberg

Walmart’s Answer to Apple Pay Wants to Be Your Favorite Financial App

Walmart’s new financial app aims to rival Apple Pay, positioning itself as a preferred digital payment and banking solut...

Nvidia Is Bigger, Stronger, and Trying to Slay the Laptop Dragon Again
Bloomberg

Nvidia Is Bigger, Stronger, and Trying to Slay the Laptop Dragon Again

Nvidia unveiled the RTX Spark Superchip at Computex 2026, aiming to challenge Intel’s PC dominance and modernize hardwar...

TechCrunch

Pacific Fusion’s latest prototype packs 440 gigawatts into an 80-nanosecond burst

Pacific Fusion’s new prototype delivers 440 gigawatts in 80 nanoseconds, securing over $1 billion in funding and enablin...