New Sony Patent Could Use AI and a Camera Pointed at Your Fingers to Work Out What Button You’ll Press Next

Sony's New Patent Aims to Reduce Gaming Latency with AI and Sensor Technology

A recently filed Sony patent reveals a potential solution to reduce latency in future gaming hardware. The patent, titled "TIMED INPUT/ACTION RELEASE" (WO2025010132), details a system utilizing AI and additional sensors to predict user inputs and streamline command execution. This addresses the latency often introduced by advanced graphics technologies like frame generation, which, while increasing frame rates, can negatively impact responsiveness.

Sony's existing PlayStation 5 Pro upscaler, PSSR, already tackles resolution upscaling, but this new technology aims to further minimize lag. Competitors AMD and Nvidia have already introduced similar solutions (Radeon Anti-Lag and Nvidia Reflex respectively), and this patent suggests Sony is developing its own approach.

The proposed system employs a machine learning (ML) model to anticipate user inputs. This prediction is aided by an external sensor, potentially a camera observing the controller, to identify the player's intended action. The patent also mentions the possibility of using controller buttons themselves as sensors, perhaps leveraging analog input technology.

While the exact implementation in a future PlayStation console (like the PlayStation 6) is uncertain, the patent demonstrates Sony's commitment to minimizing latency without compromising responsiveness. This is especially relevant given the increasing popularity of frame generation technologies like FSR 3 and DLSS 3, which often introduce additional latency.

The benefits of this technology would be most apparent in fast-paced games requiring both high frame rates and low latency, such as first-person shooters. However, the ultimate adoption of this technology in future hardware remains to be seen.