
Xidian University
B.Eng. · OMEGA Lab
National Scholarship
My research asks a simple question: what should an agent predict so that its prediction is genuinely useful for control?

B.Eng. · OMEGA Lab
National Scholarship

Research Assistant
Robot learning

Research Intern
Whole-body manipulation

Research Intern
Seed Robotics

PhD
World models & action
A progression from structured action generation toward world modeling inside an action-useful condition space.
Learn compact future guidance specifically for action generation.
Explore WoG ↗Before predicting a robot trajectory, first imagine how the object should move.
The same robot motion can be right or wrong depending on the desired object motion.
Generate a dense object-motion representation before synthesizing the action.
A predictive intermediate signal makes manipulation more purposeful.
Predict object motion from the current observation and language instruction.
Condition the manipulation policy on the generated motion representation.
Attach MBA to existing manipulation policies without redesigning the action backbone.
Small early errors compound when every action depends only on its predecessor.
Begin with sparse, informative moments that anchor the overall manipulation.
Autoregressive generation can follow task structure rather than time alone.

Predict key actions first, then recursively fill the intervals to form a coherent trajectory.
ICCV 2025 paper ↗The policy preserves global task structure while refining detailed local actions.
See all demos ↗
Mobile settings introduce larger visual variation and longer interaction horizons.
Base, torso, and arm actions must form a coherent whole-body trajectory.
A useful policy must transfer across objects, tasks, and environments.
Project-site videos are streamed directly; no media files are duplicated here.
ICRA 2026 paper ↗Learn what to predict for action—not what humans predefine.
Raw future pixels are rich but redundant. Hand-designed targets are compact but limiting. WoG learns the bottleneck: a condition space that retains precisely what action needs.
External project-site videos · nothing duplicated in this repository.
View all 12 demos ↗Condition supervision turns abundant human video into useful training signal.
The compact condition space filters visual noise while retaining action-relevant dynamics.
Predicted actions can be executed through practical robot interfaces.
Modeling is useful only when it changes what the agent can do.
WoG reframes world modeling from visual reconstruction into action-centric guidance.
Learn a compact condition rather than hand-designing the prediction target.
Predict future conditions together with actions—future frames are not needed at deployment.
Use abundant human video even when action annotations are sparse.
World Guidance models compact future conditions so an agent can generate precise actions—not merely plausible pixels.