Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control
Abstract
World generative models are typically used through what they produce: a rendered future, a video-conditioned action, or latent context computed by a costly generative branch. We argue that their more reusable asset is the computation that constructs a future. As a generator transforms a corrupted future into a coherent trajectory, its intermediate states organize appearance, spatial layout, and interaction across levels of abstraction. Can this future-generative computation be internalized in a representation inferred from the present alone? We present Enfold, which transfers this computation into a representation predicted from the current visual context and language instruction. During training, multi-level states exposed as the generator processes the observed future supervise a current-only encoder. The learned representation is fed back to condition future generation and is read by task heads without allowing task gradients to reshape the encoder. At deployment, action prediction no longer executes the generator. Across LIBERO, RoboTwin2.0, and real-robot tasks, Enfold supports strong control while reducing action latency by 3.7times relative to Fast--WAM, Enfold-Flash reaches 10.1times. Representation analyses show that it suppresses nuisance variation and preferentially captures changes that emerge over longer horizons. When the current scene is altered by human intervention, both the generated continuation and the executed actions adapt, which is inconsistent with fixed trajectory replay. These results recast a world generator as a source of predictive control representations: its future need not be materialized at every step if its internal structure can be enfolded into the present.
Community
🚀 Enfold: Folding World-Generator Computation into Predictive Representations for Efficient Embodied Control
Do world models really need to generate a future at every control step?
Enfold explores a different idea: the most reusable asset of a world generator may not be the future it produces, but the computation that constructs that future.
During training, Enfold transfers multi-level future-generative states into a predictive representation inferred from the current observation and instruction alone. At deployment, action prediction no longer runs the world generator.
Highlights:
• 97.8% on LIBERO
• 92.02% on RoboTwin2.0
• 49 ms action latency with Enfold-Flash
• Up to 10.1× lower latency than generation-based world-action modeling
• Real-robot experiments with OOD scenes and human perturbations
The broader question we hope to explore:
Can imagination be internalized into representation rather than repeatedly materialized at inference?
Paper: arXiv:2607.26657
Code: github.com/zwl666666/enfold
Project: zwl666666.github.io/enfold
Get this paper in your agent:
hf papers read 2607.26657 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 0
No dataset linking this paper
Spaces citing this paper 0
No Space linking this paper