Got different performance result of 64k 256 random write on different Solidigm SSDPF2NV307TZD drive.

[jackylee]

Hi sir,

I have some new Solidigm SSDPF2NV307TZD drives on hand, when I try to ensure the performance on each drive, I found some drives are with strange random write performace, below is a table to show the test result.

Each row means different SSD drive, total 20 drives, 3rd column means random read result in IOPS, and the 4th column means random write result in IOPS, as you can see, 8 drives are with strange random write performance.

Because the 20x drive physical slots on the Server platform are with PCIe gen3 x2 but not x4, that's why the performance number did not meet the maximum performance that SSD supported, but it should at least with ~27k IOPS on this platform.

Environment

Platform: Intel 4th gen Xeon processor

OS: Windows Server 2022 Datacenter

Tool: FIO for Windows v3.35

Test Parameter(FIO, 64k 256 random read/write):

NVMe_SSD.fio
cpus_allowed_policy=split
continue_on_error=none
bs=64k
description="RandomRead" or "RandomWrite"
direct=1
disable_clat=1
disable_slat=1
iomem=mmap
do_verify=0
exitall_on_error
fallocate=turncate
time_based
group_reporting=1
io_size=500gb
iodepth=256
ioengine=windowsaio
name=”RandomRead” or "RandomWrite"
nice=-5
nrfiles=2
offset=0
overwrite=0
ramp_time=20
random_generator=lfsr
randrepeat=0
rw=randread or randwrite
runtime=60
refill_buffers=1
size=600gb
sync=0
thinktime=0
thread
unlink=1
no_completion_thread=1
clocksource=cpu
numjobs=20

Test Method:

Single SSD a time, one by one. (20pcs SSD are all installed on the system)

============================================

Update, have tried to run the test again with same FIO parameters on another Server platform which supports PCIe gen3 x4 for each SSD slot, and below is the result.

As you can see, different SSDs got different result, and seems the range is very huge, 8k, 26k, and 51k, believes that 51k should be the normal one.

I have also tried different vendor of SSD on the same platform, but did not see the same problem with same test environment and method, that means, the issue is not platform dependency, seems is related to specific SSD drives.

Please advise what is the possible root caused and how to resolve the issue?

Again, the SSDs are new.

Thanks,

Jacky

[SolidigmGleb]

Hello jackylee,

Thank you for contacting Solidigm™ Support.

We would like to ask you to clarify the current model of SSDs that you are referring to. As we understand you are experiencing low random write performance on your several Solidigm D5 Series SSDs.

Please be aware that many factors can affect performance results, including random write performance. Below, we would like to provide a few factors for you to check:

1.)Depending on the system configuration, some platforms share bandwidth across storage connectors. Confirm the drives use the optimal connection and BIOS settings for best performance options by referencing the system user manual.

2.) Make sure you have the latest SSD firmware.

3.) The Solidigm™ Storage Tool provides options to improve SSD performance.

NOTE	Drives under test should be connected to the system as a secondary (non OS) drive. How To Test Performance Of The Solidigm™

4.) Download the application. Solidigm™ Storage Tool. There is also an option to run a Diagnostic Scan. A full scan should be done to make sure the product is in a healthy state. See the SST User Guide for more details.

5.) Formatting the disk can help recover performance in some cases.

NOTE	Always backup data regularly and before proceeding as this process removes all data from the drive.

When to Run a Low-Level Format or Secure Erase on Solidigm™ (formerly Intel®) Solid State Drives and...

If you have any questions or concerns, please do not hesitate to contact us via  our Support Hub . We will be happy to assist you!

Kind regards,
Gleb
Solidigm Customer Support

[jackylee]

Hi Gleb,

Please see my comment in below inline.

1.)Depending on the system configuration, some platforms share bandwidth across storage connectors. Confirm the drives use the optimal connection and BIOS settings for best performance options by referencing the system user manual.

Jacky: Not the reason to cause it, because on the same system, the 20pcs drives(all plugged on the same system) got different result, and the test is to verify single SSD one by one, so it is not the "platforms share bandwidth across storage connectors" issue, also not the BIOS setup issue, because it happens on some drives only.

2.) Make sure you have the latest SSD firmware.

Jacky: Yes, all 20pcs drives are with latest SSD firmware.

3.) The Solidigm™ Storage Tool provides options to improve SSD performance.

NOTE	Drives under test should be connected to the system as a secondary (non OS) drive. How To Test Performance Of The Solidigm™

Jacky: Will try it on those drives.

4.) Download the application. Solidigm™ Storage Tool. There is also an option to run a Diagnostic Scan. A full scan should be done to make sure the product is in a healthy state. See the SST User Guide for more details.

Jacky: Will try it on those drives, but before that, where can I attach the event/assert log dump from SSD by SST tool to let you confirm the issue? Will it help?

5.) Formatting the disk can help recover performance in some cases.

Jacky: Will try it on those drives.

[SolidigmGleb · Accepted solution]

Hello jackylee,

Thank you for the information provided. 

Regarding your question about attaching the event/assert log dump from SSD by the SST tool to let us confirm the issue, you can add screenshots with the event/assert log dump to your posts in the community. However, in your case, we needed more information about your issue. So, if formatting the drives does not solve your issue, we would like to ask you to create a ticket via  our Support Hub . 

If you have any questions or concerns, please do not hesitate to contact us.

Kind regards,
Gleb
Solidigm Customer Support

[jackylee]

OK, will do it later.