you can pull up your task manager and click on performance ... check your CPU usage. It kind of looks like you are CPU bound .. maybe
IF it shows CPU at 90+% usage and GPU at considerably less .. THEN that's what is going on
Plus .. what speed is your system RAM actually running at? (Task Manager>Performance>Memory)
Some other things that might help with performance .. might not .. but good to do regardless:
Make sure your AM4 chipset drivers are up to date from AMD.com
Make sure your RAM is installed in slots A2/B2 IF you are running a motherboard with 4 memory slots (2nd and 4th slots away from the CPU socket)
Updating your BIOS can help with a lot of things (compatibility with RAM,M.2 drives ..etc, security fixes, performance increases)
Make sure your Windows install is up to date
run the program DDU and remove all things AMD (and Nvidia if that was a past GPU on this install of Windows) .. reboot .. and THEN install latest GPU drivers from AMD.com
Make sure you have good air flow thru your case to keep CPU and GPU cool, as well as your VRM's and system RAM