The graphics .inf is separate from the control panel. You would be installing drivers only. Do you not have the option to "Custom Install" with new drivers?
I'm not sure if it has that option or not...someone else has to answer that. I use version (UI only) 19.12.1 and graphics drivers from 20.4.2