Truth to be told, frequent Driver Timeouts is usually a hardware issue; which is something that many people don't want to believe. (Just like the BSOD, which is generally a hardware issue, if it happens multiple times throughout the day.)
Since you only got your card 4 days ago, I'd RMA it and get another XTX. The reason being is because I have a similar rig and haven't had any issues with any chipset and/or graphic drivers since I built my PC, back in March 2024.
--
* PC Specs: Ryzen 9 7950X3D | Radeon RX 7900 XTX (ASRock Taichi White) | 64GB DDR5-6000 CL30 (G.Skill Trident Z5 Neo RGB White) | Crucial T500 2TB PCIe Gen4 NVMe M.2 SSD | Windows 11 Pro 24H2