Obviously first off for dual OS boot is turn off 'Fast Startup' in both.
Now if one 1 OS is insider build, you should only use driver supplied with it.
If you choose to use RTM drivers on insider builds (don't complain here).
And yes, driver update should only apply to the OS/drive in use at the time.
Ryzen 5 5600x, B550 aorus pro ac, Hyper 212 black, 2 x 16gb F4-3600c16dgtzn kit, NM790 2TB, Nitro+RX6900XT, RM850, Win.10 Pro., LC27G55T..