My friends and i started a Minecraft server a week ago and since then its close to impossible to play. You can just fly for arround for 10 mins ( slow flying not even using fireworks to speed up) until the VRAM is full and it starts lagging as hell. So you have to close and start Minecraft every 10-30 mins depends on how much you travel. Even without mods and shader the VRAM fills up just not as fast.
Setup: rx 6600 xt / Ryzen 5 5600
What i already tried and not worked so far. Cleaning current ssd and set up from scratch. Tried different amd driver versions even some 1 1/2 old ones. Messing arround with every minecraft setting possible.