Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence

📅 2026-08-06
📈 Citations: 0
Influential: 0
📄 PDF
🤖 AI Summary
This work addresses the lack of a unified framework in existing embodied intelligence models for jointly handling heterogeneous capabilities such as perception, reasoning, action, and state verification. The authors propose an execution-centric capability taxonomy that categorizes embodied skills into four types: spatial reasoning, temporal understanding, action guidance, and state verification, each trained with dedicated expert models. Through weight-space merging and distillation of routing strategies, they achieve, for the first time, the efficient integration and preservation of multiple expert capabilities within a single model. Combining reinforcement learning, verifiable reward mechanisms, and vision-language modeling, the proposed approach significantly outperforms baseline methods on benchmarks such as Capek-StateBench, fully retaining all four capability types and successfully executing complex embodied tasks in closed-loop simulation environments.
📝 Abstract
Vision-language models are increasingly serving as the reasoning core of embodied agents. Robot execution is inherently iterative: each action reshapes the scene and physical state, continually renewing what must be perceived, reasoned about, and verified. Meeting these demands requires complementary capabilities that differ in supervision signals, prediction formats, and verification criteria. Existing approaches typically develop these capabilities against isolated, task-specific objectives, leaving open how they should be organized and integrated around execution as a whole. We present Capek 0.5, an embodied vision-language model built around an execution-centric capability taxonomy. Rather than organizing training by datasets or tasks, the taxonomy groups embodied capabilities according to their functional roles throughout execution and comprises four capability families: Spatial Reasoning, Temporal Understanding, Action Guidance, and State Verification. Each capability is first acquired by a dedicated specialist through reinforcement learning with verifiable rewards from a shared backbone, and the specialists are then consolidated into a single inference-time model through weight-space merging followed by routed policy-space distillation. We instantiate Capek 0.5 at the 2B and 35B-A3B scales and evaluate it from three complementary perspectives: comprehensive benchmark suites including Capek-StateBench, a new benchmark for state verification; a controlled study of capability retention from specialists to the unified model; and closed-loop evaluation in simulated embodied environments. Capek 0.5 improves the large majority of matched benchmark rows over its initialization, retains all four specialized capabilities in one checkpoint with quantified losses, and transfers to closed-loop embodied task execution.
Problem

Research questions and friction points this paper is trying to address.

embodied intelligence
vision-language model
execution-centric
capability integration
state verification
Innovation

Methods, ideas, or system contributions that make the work stand out.

execution-centric
capability taxonomy
weight-space merging
policy-space distillation
embodied vision-language model
🔎 Similar Papers