As global tech leaders compete to develop AI systems that produce increasingly lifelike video content, researchers in Abu Dhabi have taken a unique approach. They’ve created a model that not only generates video but also learns how the world functions over time.
The Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) has introduced PAN, an AI world model designed to remember past events, forecast future scenarios, and execute multi-step instructions with human-like accuracy.
Developed by MBZUAI’s Institute of Foundation Models, PAN excels in maintaining continuity in lengthy sequences, enabling it to follow complex instructions like “turn left after the bridge” or “place the can on the table, then step back,” while preserving the spatial and logical integrity of the scene.
Stay informed with the latest updates. Join KT on WhatsApp Channels.
Current models such as OpenAI’s Sora and Google’s Veo often render visually stunning clips but struggle with object tracking and scene coherence over time. PAN is specifically designed to address these challenges.
“Rather than just creating video, PAN comprehends the scene’s dynamics and predicts subsequent developments,” explained researchers involved in the project.
How PAN Works
PAN achieves its functionality through a two-step process. Initially, it constructs an internal representation of the environment, identifying objects, movements, and relationships over time. It then transforms this understanding into video, continuously updating as instructions change. This methodology allows for sustained stability and realism.
The launch of PAN is timely, as simulation technology grows increasingly vital for robotics, autonomous systems, and industrial planning. PAN’s capability to track objects over time and foresee outcomes makes it a crucial tool for testing scenarios that are too risky, costly, or impractical to replicate in the real world.
Accessible to All
Developed by MBZUAI teams in Abu Dhabi, Paris, and Silicon Valley, PAN is part of a broader initiative to reduce dependence on imported technology. The model and its technical documentation are accessible at panworld.ai, positioning the UAE among a select group of entities producing world-model AI for open research.
As global corporations seek safer autonomous systems and more reliable planning, PAN presents an alternative to models that focus solely on visual appeal. Instead of merely displaying short clips, it offers a comprehensive understanding of how actions impact future results, a feature that researchers believe brings AI closer to genuine reasoning and comprehension of the physical world.
