Just recently, Microsoft Xbox unveiled Muse, an intriguing new generative AI model specifically created for “gameplay ideation.” Accompanying this launch was an article on Nature.com, a blog post, and a YouTube video. If you’re scratching your head over “gameplay ideation,” don’t worry—Microsoft clarifies that it involves crafting “game visuals, controller actions, or both.” However, its practical applications are fairly modest and aren’t meant to replace the conventional game development process.
Nevertheless, some of the data behind it piques interest. The training involved a large-scale operation on H100 GPUs. It took roughly a million training updates to stretch a single second of real gameplay into another nine seconds of genuine, responsive, simulated gameplay. The majority of the training data was sourced from multiplayer gaming sessions already in existence.
For this task, running the model on a single PC wouldn’t cut it. Microsoft had to rely on a cluster of 100 Nvidia H100 GPUs. This setup comes with significantly higher expenses and energy requirements, yet it only managed to extend the gameplay by nine seconds at a resolution of 300×180 pixels.
In the demonstration of Muse, one of the team’s most captivating achievements was its ability to clone existing props and enemies in the game environment, replicating their behavior through the AI. Given the substantial investment in hardware and energy just for AI training, one might wonder why not simply use regular game development tools to achieve the same outcome.
Even though Muse impressively managed object permanence and mimicked original game behaviors, its practical applications appear quite inefficient compared to traditional game development methods. While Muse’s future iterations might pull off more captivating tasks, as it stands, it joins a long roster of projects attempting to encapsulate gameplay entirely through AI. Despite maintaining some level of engine accuracy and object recognition, its current application as a game development tool seems far from optimal. After thoroughly diving into the material, it leaves me questioning why anyone would opt for this over conventional methods, no matter how deep into the details I delve.
If you’re keen on staying updated with more insightful reviews and the latest in tech news, consider subscribing to receive Tom’s Hardware’s top picks straight to your inbox.