This problem started like a month ago. I already did so many fixes that I found on the internet and nothing worked. Sometimes it's peaceful but after hours, it will kick again. It will only stop permanently if I disable my GPU driver which is Radeon RX 580 Series.
I think I solved the problem. There's probably a connection about it since having a non-existent monitor/driver is "virtual"? I'm not sure about it but it's not installing/uninstalling the driver anymore. I think it's because of this option at AMD Software. I was turning it on back then.