Looking at technology like DirectStorage which allows the GPU to access storage directly, could something similar be done with DirectInput/XInput/message loop to make the GPU handle input (HID/USB) directly without needing to wait for the CPU?
Maybe even by plugging the mouse/keyboard/headset to a USB port on the GPU? (that is if GPUs had multiple USB ports, maybe they will with USB4)