Microsoft Copilot will watch you play Minecraft, tell you what you’re doing wrong

Enlarge / In the recent past, you’d have to rely on your kid sibling to deliver Minecraft commentary like “Oh no, it’s a zombie. Run!” (credit: Microsoft)

Longtime gamers (and/or Game Grumps fans) likely know that even single-player games can be a lot more fun with a friend hanging out nearby to offer advice, shoot the breeze, or just offer earnest reactions to whatever’s happening on screen. Now, Microsoft is promising that its GhatGPT-4o-powered Copilot system will soon offer an imitation of that pro-social experience even for Minecraft players who don’t have any human friends available to watch them play.

In a pair of social media posts Monday, Microsoft highlighted how “real-time conversations with your AI companion copilot” can enhance an otherwise solitary Minecraft experience. In the first demo, the disembodied copilot voice tells the player how to craft a sword, walking him through the process of gathering some wood or stone to go with the sticks sitting in his inventory. In another, the AI identifies a zombie in front of the player and gives the (seemingly obvious) advice to run away from the threat and “make sure it can’t reach you” by digging underground or building a tower of blocks.

Real time conversations with your AI companion Copilot, powered by OpenAI’s GPT-4o. pic.twitter.com/Ug7EWv2sah

— Microsoft Copilot (@MSFTCopilot) May 20, 2024

These kinds of in-game pointers aren’t the most revolutionary use of conversational AI—even a basic in-game tutorial/reference system or online walkthrough could deliver the same basic information, after all. Still, the demonstration stands out for just how that information is delivered to the player through a natural language conversation that doesn’t require pausing the gameplay even briefly.