New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's latest patent filing, WO2025010132, titled "TIMED INPUT/ACTION RELEASE," aims to revolutionize the gaming experience by significantly reducing latency in future hardware. This innovative approach, first highlighted by Tech4gamers, focuses on streamlining the "timed release of user commands" through predictive technology.

The introduction of PlayStation Spectral Super Resolution (PSSR) with the PlayStation 5 Pro marked Sony's entry into advanced upscaling technology. While PSSR can enhance smaller resolutions to 4K, the integration of newer graphics technologies like frame generation often introduces additional latency, potentially making games feel less responsive. This issue is not unique to Sony, as GPU manufacturers AMD and Nvidia have also tackled it with their Radeon Anti-Lag and Nvidia Reflex technologies, respectively.

Sony's patent proposes a multifaceted solution to this challenge. It involves a machine-learning AI model that predicts the next user input, combined with external sensors such as a camera focused on the controller to anticipate which button the player is about to press. The patent specifically mentions, "In one particular example, the method may include providing camera input as an input to a machine learning (ML) model. The camera input may indicate the first user command."

Moreover, Sony considers the potential use of controller buttons as sensors, leveraging their experience with analog buttons in past controllers. This approach could be integrated into a next-generation controller, further enhancing the responsiveness of games.

While the exact implementation of this technology in the PlayStation 6 or other future hardware remains uncertain, the patent underscores Sony's commitment to reducing latency without compromising the responsiveness of games. This is particularly crucial in genres like twitch shooters, where high framerates and low latency are essential for competitive play.

Sony's exploration into this technology aligns with the industry's shift towards advanced rendering techniques like FSR 3 and DLSS 3, which, while enhancing visual quality, can introduce additional frame latency. By addressing these challenges, Sony aims to maintain the high standards of gaming performance that players expect, ensuring that future PlayStation consoles deliver both stunning visuals and seamless gameplay.