I run the same card in my daughter's setup .. and when she runs her Oculus 2 via Air Link, for some reason it will disable the driver.
I'll have to press the power button so the PC turns off .. and then turn it back on and then Windows comes back up .. go into Device Manager and under "Display Adapters" .. I'll have to enable her RX 580 and then reboot and then everything is fine again.
She never has issues with just regular gaming on her PC though (850wtt EVGA GQ 80+ Gold power supply)
List the rest of your PC specs including make/model of your power supply
Check CPU/GPU temps
Make sure your chipset drivers are up to date from either Intel.com or AMD.com (depending on what you are running)
Make sure your Windows install is up to date