AnsweredAssumed Answered

X570: NVMe RAID0 very Slow Sequential Read with 2 x Intel P45x0 NAND SSDs - but SSDs perform fast individually (also at the same time) - but 2 x Optane RAID0 as fast as expected

Question asked by abav.normie-pleb on Jun 13, 2020

Hello,

I've found a general motherboard manufacturer-independent compatibility issue with the combination of Intel DC P45x0 U.2 4TB SSDs (tested models P4500 and P4510 so far) and the AMD NVMe RAID feature with X570 chipsets.

 

A third party (Wendell from Level1Techs, cp. the full detailed forum thread there) can confirm the issue so a personal user configuration error seems unlikely at this point.

 

Issue cliff notes:

 

- 2 SSDs are connected to an X570 chipset motherboard, one directly to CPU PCIe lanes, the second one gets its PCIe lanes through the X570 chipset.

 

- In non-NVMe RAID operation the SSDs work fine with the expected full performance, even if you test them at the same time so there is no PCIe bandwith limit:

 

X570 chipset PCIe

 

CPU PCIe

 

- After enabling the AMD NVMe RAID feature in the UEFI and configuring the drives as a RAID0 array (256 kB stripe size, Read cache On) you get results like this:

 

P4510-AMD-NVMe-RAID0

As you can see the sequential read result is very weak (expected between 5500-6000 MB/s) compared to a single drive.

 

- I then verified that the CPU, the motherboard, Windows or CrystalDiskMark isn't limiting the read performance by connecting two Intel Optane 905P 480 GB SSDs to the very same PCIe interfaces and configured the drives as an AMD RAID0 array with the exact same settings:

 

Optane-AMD-NVMe-RAID0

 

Here, the sequential read result scales to pretty much exactly 2x as expected from RAID0 (single Optane SEQ1MQ8T1 read result a little above 2700 MB/s, forgot to take a screenshot). A RAID0 with P4510 drives should be even faster since they have a higher SEQ1MQ8T1 read results (about 3100 MB/s).

 

- Tested with:

ASRock X570 Taichi, latest UEFI P3.03 (early access for trouble-shooting), 3700X, 2 x 32 GB ECC UDIMM DDR4-2666

ASUS Pro WS X570-ACE, latest UEFI 1302, 3900 PRO, 4 x 32 GB ECC UDIMM DDR4-2666

Windows 10 x64 Versions 1909 and 2004

AMD chipset drivers 2.04.28.626

AMD RAID drivers 9.3.0.38

All SSDs with 0 % used space and configured after a secure erase

 

- The Intel SSDs have the latest firmware installed, unfortunately you cannot downgrade the SSDs' firmware according to Intel ("for security reasons"). Intel's tech support is also "looking into" the issue but I didn't get the impression that they cared very much about it, so I hope that maybe someone on AMD's end could help to clear this up.

- ASRock's support thinks that this is something only AMD can address on the software side.

 

Is there a way to establish contact with the software engineers that handle the AMD NVMe RAID feature to trouble-shoot this issue and hopefully resolve it with a driver or UEFI (module) update?

 

Thank you very much for the assistance!

 

Regards,

aBavarian Normie-Pleb

Outcomes