Microsoft has launched an AI model called WHAMM (World and Human Action MaskGIT Model). This new tool can create video game environments in real time. It also responds instantly to player actions.
To show how it works, Microsoft released a short demo featuring Quake II, a classic first-person shooter from 1997. However, this version is different and is powered entirely by AI. Players can try it online through the Copilot Gaming Experience.
A Fast Upgrade from WHAM
WHAMM builds on Microsoft’s earlier model, WHAM, which came out in February 2025. However, it could only render one frame per second. WHAMM, by contrast, can produce over 10 frames per second. That means gameplay feels faster and more responsive.
Players (>18)control the action with a keyboard or controller, and as this occurs, the AI updates the game world in real time based on what the player does. This creates a new kind of interactive experience. The demo is free to try however, it only runs for 120 seconds.
Although WHAMM has displayed high performance, it has some issues. For one, users report input lag that makes the game hard to play smoothly. Also, the AI version only covers part of the Quake II map. The game stops if the player reaches the edge of the playable area.
How WHAMM Works
To make WHAMM faster, Microsoft changed its design. Earlier models generated images one piece at a time. This was slow. However, WHAMM uses a method called MaskGIT. It creates the full image at once, then refines it in steps.
Here’s how the system works:
- Backbone Transformer (500 million parameters): Creates the first version of the image.
- Refinement Transformer (250 million parameters): Improves the image by re-predicting and adjusting details.
Current Issues Microsoft Admits
While WHAMM is a big step forward, it’s still experimental. Microsoft pointed out several challenges:
- Enemy interaction: Enemies look blurry, and damage is often calculated incorrectly.
- Short memory: WHAMM remembers only 0.9 seconds of past frames. Enemies vanish if out of sight too long.
- Wrong numbers: Health bars and other stats are sometimes inaccurate.
- Limited space: The AI only works on part of the game. Players can’t go beyond that zone.
- Online delay: Because the demo runs in a browser, there’s a noticeable lag.
