Xbox Patents System for AI and Remote Friend Gameplay Assistance

Innovation in the gaming industry often moves in parallel, especially among the sector’s heavyweights. Following reports earlier this year regarding Sony’s patent for AI-driven “ghost” players, Xbox parent company Microsoft has surfaced with a strikingly similar patent application of its own.

Originally identified by Tech4Gamers and Eurogamer, the 2024 filing is titled “State management for video game help sessions.” The technology is designed to bridge the gap for players who find themselves frustrated by difficult progression milestones. According to the abstract, the system facilitates “inputs received from a client device of a video game helper” during a dedicated assistance session. This could allow a friend to remotely navigate a punishing boss battle or a pixel-perfect platforming segment on your behalf. Once the “helper” finishes, the player can choose to accept the progress and continue or reject the help and revert to their previous state to attempt the challenge themselves.

This “helper” role isn’t restricted to human interaction. The patent explores the use of “generative models”—sophisticated machine learning frameworks—to provide automated assistance. These multi-modal AI models would be capable of interpreting text, video, and game code to generate the necessary inputs to move a player forward.

Microsoft’s motivation behind the patent stems from a desire to modernize the troubleshooting experience. The company views traditional methods, such as scouring internet forums or watching YouTube walkthroughs, as “rather rudimentary” disruptions that pull players away from the game world. This concept aligns with the “Copilot for Gaming” initiative previously mentioned by Xbox editorial director Jeff Rubenstein, which envisions an AI-driven sidekick that offers real-time support.

As generative AI continues to permeate the tech landscape, industry leaders are attempting to balance utility with creative integrity. Microsoft Gaming CEO Asha Sharma has explicitly stated her commitment to avoiding “soulless AI slop” that prioritizes efficiency over quality. She maintains that video games remain human-crafted art—even if the tools helping us finish them are increasingly digital.

Source: Polygon