Yes, the integrated graphics of the 5600G does not have dedicated graphics memory and must use the system memory. The Ryzen processor has two 64bit memory controllers, so when using two DIMMs in dual channel it's getting the full 128bit data width. With DDR4-3200 memory that translates to 25GB/s throughput. If you use a single memory module you are literally cutting that throughput in half to only 13GB/s. This hurts not only the CPU performance but also the IGP performance.
Compare that to a modern entry level graphics card like the Radeon RX 7600 that also uses a 128bit memory bus but with GDDR6 has 288GB/s memory bandwidth.
Ryzen R7 5700X | B550 Gaming X | 2x16GB G.Skill 3600 | Radeon RX 7900XT
Ryzen R7 5700G | B550 Gaming X | 2x8GB G.Skill 4000 | Radeon Vega 8 IGP
Ryzen R5 5600 | B550 Gaming Edge | 4x8GB G.Skill 3600 | Radeon RX 6800XT