arXiv

When and How Much to Imagine: Adaptive Test-Time Scaling with World Models for Visual Spatial Reasoning

Title: Optimizing Test-Time Scaling: Adaptive Imagination via World Models for Visual Spatial Reasoning

Abstract:

Although Multimodal Large Language Models (MLLMs) have advanced rapidly, their visual spatial reasoning capabilities remain inconsistent, particularly when determining how a scene appears from unseen or alternative perspectives. While recent studies have attempted to bolster reasoning through world-model-based visual imagination, critical questions persist regarding the precise timing, optimal quantity, and potential downsides of such imaginative processes. In real-world applications, unselective imagination can escalate computational costs and impair performance by introducing confounding evidence.

This study offers a comprehensive examination of test-time visual imagination as a manageable resource for spatial reasoning. We investigate the conditions under which static visual data is adequate, identify scenarios where imagination enhances reasoning, and analyze the impact of superfluous or excessive imagination on both accuracy and efficiency. To facilitate this analysis, we propose AVIC, an adaptive framework that leverages world models to explicitly evaluate the sufficiency of current visual evidence before deciding whether to engage visual imagination.

Furthermore, to acquire this gating and planning behavior without requiring annotations on the necessity or extent of imagination, we introduce AVIC-R. This variant trains the policy using GRPO, deriving rewards from question-answer correctness and penalties based on the cost of imagination. Our evaluation across spatial reasoning benchmarks (SAT, MMSI) and an embodied navigation benchmark (R2R) delineates specific contexts where imagination is essential, offers limited benefit, or proves harmful. The results demonstrate that selective control mechanisms can achieve performance levels equal to or superior to fixed imagination strategies, while significantly reducing the number of world-model calls and language tokens. Notably, AVIC-R outperforms robust proprietary baselines, such as GPT-4o and GPT-4.1, despite utilizing the world model less frequently. These findings underscore the necessity of analyzing and regulating test-time imagination to ensure efficient and dependable spatial reasoning.


Source: arXiv Generated at: 2026-06-02 00:00:00 UTC

Related Articles

Advantech's Tsai on Nvidia Collaboration, AI Strategy
Bloomberg

Advantech's Tsai on Nvidia Collaboration, AI Strategy

Advantech's Tsai discusses the Nvidia partnership and AI strategy.

SK Hynix to Double Wafer Capacity to Ease Memory Chip Crunch
Bloomberg

SK Hynix to Double Wafer Capacity to Ease Memory Chip Crunch

SK Hynix plans to double its wafer capacity to alleviate the ongoing global memory chip shortage. This expansion aims to...

AI Productivity Boost Is Overhyped | 3-Minute MLIV
Bloomberg

AI Productivity Boost Is Overhyped | 3-Minute MLIV

The video argues that AI’s productivity boost is overhyped, challenging the assumption that it will significantly enhanc...

Intel's Lip-Bu Tan on Agentic AI & Partner Networks
Bloomberg

Intel's Lip-Bu Tan on Agentic AI & Partner Networks

Intel’s Lip-Bu Tan discusses Agentic AI and the vital role of partner networks in driving innovation.

Haas Says Arm May Hit $15 Billion AI Chip Revenue Goal Early
Bloomberg

Haas Says Arm May Hit $15 Billion AI Chip Revenue Goal Early

Haas suggests Arm may achieve its $15 billion AI chip revenue target sooner than expected. This indicates strong market ...

Arm May Hit $15 Billion AI Chip Revenue Goal Early, CEO Says
Bloomberg

Arm May Hit $15 Billion AI Chip Revenue Goal Early, CEO Says

Arm’s CEO predicts the company could hit its $15 billion AI chip revenue target ahead of schedule. This optimistic outlo...