"allows the model to create consistent and diverse gameplay"
Microsoft has unveiled a major step in its AI gaming efforts with the introduction of Muse, a new generative AI model.
The company says Muse could help Xbox developers create parts of games and even preserve classic titles for modern hardware.
Muse, developed by Microsoft Research, can generate game environments based on visuals or player inputs. It understands 3D game worlds and physics, allowing it to react to player interactions.
Fatima Kardar, corporate vice president of gaming AI at Microsoft, said:
“This allows the model to create consistent and diverse gameplay rendered by AI, demonstrating a major step toward generative AI models that can empower game creators.”
The model was trained using extensive gameplay data from the Xbox title Bleeding Edge.
This was made possible through a collaboration between Microsoft Research and Xbox studio Ninja Theory, both based in Cambridge.
Katja Hofmann, head of Microsoft Research’s game intelligence team, said:
“This partnership allowed us to closely collaborate with the game studio to understand what needs to be in place and how we can responsibly unlock access to a large amount of gameplay data.”
Muse accessed the equivalent of seven years of human gameplay, training on a billion image-action pairs.
The project, published in the journal Nature, remains in its early stages.
Currently, Muse can generate gameplay visuals at a resolution of 300×180 pixels, a step up from Microsoft’s earlier 128×128 models but still far below the 1080p standard for PC gaming.
Microsoft has demonstrated Muse generating gameplay and allowing players to introduce visual elements into a game to guide AI responses.
The company insists it is not designed to replace human creators.
Kardar continued: “For Xbox, the principles that drive our approach to AI are to create more value for players and game creators, bring more games to more people around the world, and recognise that the development of a great game will always be grounded in the creator’s vision and artistry.
“We believe generative AI has the potential to enhance this creativity and unlock new possibilities.”
A real-time version of Muse was also showcased, capable of generating game visuals dynamically and reacting to changes in the environment.
However, this early version ran at just 10fps and 300×180 resolution.
Microsoft is also exploring how Muse could support game preservation.
Microsoft Gaming CEO Phil Spencer said: “You could imagine a world where from gameplay data and video that a model could learn old games and really make them portable to any platform where these models could run.
“We’ve talked about game preservation as an activity for us, and these models and their ability to learn completely how a game plays without the necessity of the original engine running on the original hardware opens up a ton of opportunity.”
The company is also testing Muse for game prototyping and adding AI-powered experiences to existing titles.
Some interactive AI game experiences will be available on Copilot Labs soon, and Microsoft plans to share AI tools with Xbox players and creators earlier in development to ensure they address real needs.
Ultimately, Microsoft says individual Xbox studios will decide how to use AI in their projects.
Kardar added:
“As part of this, we have empowered creative leaders here at Xbox to decide on the use of generative AI.”
“There isn’t going to be a single solution for every game or project, and the approach will be based on the creative vision and goals of each team.”
Concerns about AI’s role in game development persist, especially as the industry faces widespread job cuts. A report found that 1 in 10 game developers lost their jobs in 2024.
Ninja Theory studio head Dom Matthews said: “We don’t intend to use this technology for the creation of content.
“I think the interesting aspect for us that’s exciting, is how can we use technology like this to make the process of making games quicker and easier for our talented team so that they can really focus on the thing that’s really special about games: the human creativity.”
Loading ...