Notifications
Clear all

Softraid 6: OWC Mercury Pro U.2 Dual with 4x ADATA SX8200 2TB very slow performance, unstable

16 Posts
3 Users
1 Likes
1,354 Views
(@thotha)
Posts: 9
Active Member
Topic starter
 

Softraid 6.2 and 6.2.1b3

OWC Mercury Pro U.2 Dual, 2x OWC U2 Shuttle (OWCU2SHUTTLE)
4x ADATA XPG SX8200 2TB (ASX8200PNP-2TT-C)
Different combinations of MacMini7.1 and MacMini9.1 with Catalina (Latest), Big Sur (Latest) or Mercury (Latest) with or without clean install and with or without additional software installed.

Problem:
On each possible combination of Mac Mini's, macOS, Software, TB3 cables, TB2 > TB3 adapters, position of installed NVME SSD, formatting (APFS or HFS+) even with ONLY one ADATA SSD the maximum possible write is ~500-700MB/s, read ~900-1100MB/s. In Raid 0+1, Raid 4 and Raid 5, also there the write speed won't go above ~1200-1500MB/s and read not above ~2000-2200MB/s, where I can accept the read of approx. 2000-2500MB/s. But the performance is very very unstable and can jump around +/- 50-90%.
AJA Speedtest Light does even show sometimes write speeds around ~5-100MB/s and then suddenly jumps up to around 1000MB/s.
And also the following commands show the very same behaviour.

sudo purge; sudo dd if=/dev/zero bs=4096k of=/Volumes/OWC\ Raid\ 4\ Video\ HFS+\ 16KB/tstfile count=4096 2>&1

sudo purge; sudo dd if=/Volumes/OWC\ Raid\ 4\ Video\ HFS+\ 16KB/tstfile bs=4096k of=/dev/zero count=4096 2>&1

According s lot of test reports from different sources, it is not as performant as Samsung but somewhere around 2500-2800MB/s.

My question is now, is the Mercury Pro U.2 D.O.A., is there an incompatibility between the ADATA XPG SSD's and the Mercury Pro U.2 or in the end a bug within macOS since Catalina?

Before I attache pictures and test files, any idea what's going on here and what support files next to the Softraid own generated one would be helpful.

 

Thank you for feedback from the Softraid team.
Thomas Thaler

This topic was modified 2 years ago by SoftRAID Support
 
Posted : 21/12/2021 10:45 am
(@softraid-support)
Posts: 8005
Member Admin
 

Lets do these tests.

On each disk, and together (3 tests), run SoftRAID and "verify disk".

Go to terminal and run this:

iostat -w 2 disk2

iostat -w 2 disk2 disk3

(plug in the correct disk numbers)

What this will tell you is what the drives are capable of reading at. Let it run for a few minutes to confirm the performance that you are getting is stable at whatever number you see. I found older SSD's for example would get hot and drop performance by 50% or more when running for a while. Newer disks should not.

 

Since you are just setting up, do the same with certify disk, in SoftRAID.

 

Both these are "raw hardware" results. If the drives are capable of 2GB, then it should show up here.

 
Posted : 21/12/2021 12:29 pm
(@thotha)
Posts: 9
Active Member
Topic starter
 

@softraid-support 
Thank you for your feedback and help.

1.) This command only run without disk access doesn't show anything.
2.) To see any data with this "iostat" command I did run the SoftRaid command "Initialize" and then "Verify".
3.) I've started with disk3, then added disk4, then disk5 and in the end disk6.
4.) As you can see in the attached file "iostats-output.txt" disk3 solo get's a max of approx. 1000MB/s, with disk4 added, it drops and so on.
5.) There is only some silly behaviour where disk4 go's up from ~850 to 1000MB/s as soon as disk5 is added but all drop to approx. 650MB/s as soon as disk6 is also added.

This Verify command takes an other 30-45 Minutes. After that I try the same with the SoftRaid command "Certify".

If you have any other suggestions, let me know, but as I have to search for a PC Owner with NVME PCI-E Slot to test ONE of those ADATA XPR XS8200 I can't give you any other comparable test data.

Regards
Thomas

REM:
As I'm NOT able to attach text files, I have to do it that way.
Therefore Im also not able to send I'm also NOT able to send you other files.

diskutil list
/dev/disk0 (internal):
   #:                       TYPE NAME						SIZE       IDENTIFIER
   0:      GUID_partition_scheme							251.0 GB   disk0
   1:             Apple_APFS_ISC							524.3 MB   disk0s1
   2:                 Apple_APFS Container disk2			250.5 GB   disk0s2

/dev/disk2 (synthesized):
   #:                       TYPE NAME                    	SIZE       IDENTIFIER
   0:      APFS Container Scheme -                      	+250.5 GB   disk2
                                 Physical Store disk0s2
   1:                APFS Volume Sandgroper					15.8 GB    disk2s1
   2:              APFS Snapshot com.apple.os.update-...	15.8 GB    disk2s1s1
   3:                APFS Volume Preboot					479.7 MB   disk2s2
   4:                APFS Volume Recovery					877.9 MB   disk2s3
   5:                APFS Volume Data						149.4 GB   disk2s5
   6:                APFS Volume VM							20.5 KB    disk2s6

/dev/disk3 (external, physical):
   #:                       TYPE NAME						SIZE       IDENTIFIER
   0:                                                   	*2.0 TB     disk3

/dev/disk4 (external, physical):
   #:                       TYPE NAME                    	SIZE       IDENTIFIER
   0:                                                   	*2.0 TB     disk4

/dev/disk5 (external, physical):
   #:                       TYPE NAME                    	SIZE       IDENTIFIER
   0:                                                   	*2.0 TB     disk5

/dev/disk6 (external, physical):
   #:                       TYPE NAME                    	SIZE       IDENTIFIER
   0:                                                   	*2.0 TB     disk6

iostat -w 1 disk3 disk4 disk5 disk6 
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  253.18  722 178.44   252.39  463 114.20   251.16  104 25.41   251.11  104 25.39   3  3 94  1.29 1.61 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.50 1.65 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.50 1.65 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   4  3 93  1.50 1.65 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   6  4 90  1.50 1.65 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.50 1.65 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.46 1.63 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  1 99  1.46 1.63 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.46 1.63 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   3  2 95  1.46 1.63 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   3  3 94  1.46 1.63 1.47
    0.50    2  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.51 1.64 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.51 1.64 1.47

Start SoftRaid command "Initialize"

  129.90 1814 230.16     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.51 1.64 1.47
  128.00 6305 788.17     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.51 1.64 1.47
  128.00 6565 820.61     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.51 1.64 1.47
  128.00 6234 779.28     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.47 1.63 1.47
  127.97 4077 509.51     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.47 1.63 1.47
  128.03 4000 500.17     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.47 1.63 1.47
  128.00 3973 496.64     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.47 1.63 1.47
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  128.00 4007 500.89     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.47 1.63 1.47
  128.00 3779 472.34     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 96  1.43 1.62 1.47
  128.00 3703 462.89     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.43 1.62 1.47
  128.21 2555 319.89     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.43 1.62 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.43 1.62 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.43 1.62 1.47
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.39 1.61 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.39 1.61 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   4  3 93  1.39 1.61 1.46
    0.00    0  0.00     0.50    2  0.00     0.00    0  0.00     0.00    0  0.00   3  3 95  1.39 1.61 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.39 1.61 1.46

Start SoftRaid command "Initialize"

    0.00    0  0.00   130.67 1292 164.91     0.00    0  0.00     0.00    0  0.00   1  2 97  1.36 1.60 1.46
    0.00    0  0.00   128.00 5577 697.18     0.00    0  0.00     0.00    0  0.00   2  3 96  1.36 1.60 1.46
    0.00    0  0.00   128.00 6540 817.49     0.00    0  0.00     0.00    0  0.00   2  2 96  1.36 1.60 1.46
    0.00    0  0.00   128.00 6350 793.71     0.00    0  0.00     0.00    0  0.00   2  3 96  1.36 1.60 1.46
    0.00    0  0.00   128.00 6542 817.75     0.00    0  0.00     0.00    0  0.00   1  2 97  1.36 1.60 1.46
    0.00    0  0.00   128.00 6547 818.32     0.00    0  0.00     0.00    0  0.00   2  2 96  1.33 1.59 1.46
    0.00    0  0.00   128.00 6352 794.03     0.00    0  0.00     0.00    0  0.00   1  2 97  1.33 1.59 1.46
    0.00    0  0.00   128.00 6532 816.54     0.00    0  0.00     0.00    0  0.00   2  3 95  1.33 1.59 1.46
    0.00    0  0.00   128.00 6336 792.04     0.00    0  0.00     0.00    0  0.00   2  3 95  1.33 1.59 1.46
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
    0.00    0  0.00   128.00 6514 814.20     0.00    0  0.00     0.00    0  0.00   2  3 95  1.33 1.59 1.46
    0.00    0  0.00   128.13 3920 490.55     0.00    0  0.00     0.00    0  0.00   2  3 96  1.31 1.58 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 95  1.31 1.58 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   3  3 94  1.31 1.58 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   4  3 93  1.31 1.58 1.46
    0.00    0  0.00     0.00    0  0.00     0.50    2  0.00     0.00    0  0.00   3  3 95  1.31 1.58 1.46
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.28 1.57 1.45

Start SoftRaid command "Initialize"

    0.00    0  0.00     0.00    0  0.00   131.15 1096 140.41     0.00    0  0.00   2  2 96  1.28 1.57 1.45
    0.00    0  0.00     0.00    0  0.00   128.00 5711 713.91     0.00    0  0.00   1  2 97  1.28 1.57 1.45
    0.00    0  0.00     0.00    0  0.00   128.00 6551 818.90     0.00    0  0.00   1  2 96  1.28 1.57 1.45
    0.00    0  0.00     0.00    0  0.00   127.98 6358 794.60     0.00    0  0.00   1  2 96  1.28 1.57 1.45
    0.00    0  0.00     0.00    0  0.00   128.02 6549 818.72     0.00    0  0.00   1  3 96  1.18 1.54 1.44
    0.00    0  0.00     0.00    0  0.00   128.00 6559 819.85     0.00    0  0.00   2  3 95  1.18 1.54 1.44
    0.00    0  0.00     0.00    0  0.00   128.00 6370 796.27     0.00    0  0.00   2  3 95  1.18 1.54 1.44
    0.00    0  0.00     0.00    0  0.00   128.00 6607 825.85     0.00    0  0.00   1  2 96  1.18 1.54 1.44
    0.00    0  0.00     0.00    0  0.00   128.00 6403 800.34     0.00    0  0.00   1  3 96  1.18 1.54 1.44
    0.00    0  0.00     0.00    0  0.00   128.00 6580 822.53     0.00    0  0.00   2  3 95  1.16 1.53 1.44
    0.00    0  0.00     0.00    0  0.00   128.12 4422 553.23     0.00    0  0.00   2  3 95  1.16 1.53 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.16 1.53 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.16 1.53 1.44
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 95  1.16 1.53 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.15 1.52 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   4  3 93  1.15 1.52 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.50    2  0.00   2  3 95  1.15 1.52 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.15 1.52 1.44

Start SoftRaid command "Initialize"

    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   133.14  671 87.19   2  2 96  1.15 1.52 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 5358 669.74   2  3 95  1.14 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6541 817.63   2  3 96  1.14 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6349 793.58   2  3 95  1.14 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6550 818.75   2  3 96  1.14 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6537 817.15   2  3 96  1.14 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6385 798.14   2  3 96  1.13 1.51 1.43
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6561 820.08   1  3 96  1.13 1.51 1.43
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6356 794.53   1  3 96  1.13 1.51 1.43
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.00 6544 817.98   2  3 96  1.13 1.51 1.43
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   128.10 5132 642.00   3  4 94  1.13 1.51 1.43
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.20 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.20 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.20 1.51 1.44
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   3  4 93  1.20 1.51 1.44
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  2 96  1.54 1.56 1.45
 
Start SoftRaid command "Verify"

 255.82 1440 359.85     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.54 1.56 1.45
  256.00 3532 882.99     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.50 1.55 1.45
  256.00 3595 898.82     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.50 1.55 1.45
  256.00 3678 919.44     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.50 1.55 1.45
  256.00 3502 875.53     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 96  1.50 1.55 1.45
  256.00 3566 891.59     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.50 1.55 1.45
  256.00 3557 889.18     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.46 1.54 1.45
  256.00 3586 896.42     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.46 1.54 1.45
  256.00 3523 880.65     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.46 1.54 1.45
  256.00 3567 891.83     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.46 1.54 1.45
  256.00 3406 851.56     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.46 1.54 1.45
  256.00 3390 847.58     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.42 1.53 1.44
  256.00 3382 845.40     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.42 1.53 1.44
  256.00 3388 846.91     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.42 1.53 1.44
  256.00 3391 847.66     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.42 1.53 1.44
  256.00 3408 852.09     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.42 1.53 1.44
  256.00 3378 844.41     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.39 1.52 1.44
  256.00 3402 850.62     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.39 1.52 1.44
  256.00 3382 845.45     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.39 1.52 1.44
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  256.00 3567 891.63     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   4  4 92  1.39 1.52 1.44
  256.00 3661 915.23     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  4 94  1.39 1.52 1.44
  256.00 3569 892.25     0.50    2  0.00     0.00    0  0.00     0.00    0  0.00   2  3 94  1.27 1.50 1.43
  256.00 3424 855.98     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.27 1.50 1.43
  256.00 3734 933.43     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  4 94  1.27 1.50 1.43
  256.00 4275 1068.73    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.27 1.50 1.43
  256.00 4173 1043.33    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  4 94  1.17 1.47 1.42
  256.00 4166 1041.50    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  4 94  1.17 1.47 1.42
  256.00 4176 1043.95    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  4 94  1.17 1.47 1.42
  256.00 4173 1043.18    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.17 1.47 1.42
  256.00 4175 1043.83    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 95  1.17 1.47 1.42
  256.00 4207 1051.70    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.16 1.47 1.42
  256.00 4174 1043.38    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.16 1.47 1.42
  256.00 4174 1043.41    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.16 1.47 1.42
  256.00 4106 1026.39    0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  4 95  1.16 1.47 1.42
  256.00 3433 858.20     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 97  1.16 1.47 1.42
  256.00 3518 879.56     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.15 1.46 1.42
  256.00 3476 869.11     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.15 1.46 1.42
  256.00 3481 870.19     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  2 96  1.15 1.46 1.42
  256.00 3560 889.96     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 96  1.15 1.46 1.42
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  256.00 3672 918.01     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   2  3 95  1.15 1.46 1.42
  256.00 3786 946.59     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   3  3 94  1.13 1.45 1.42
  256.00 3474 868.45     0.00    0  0.00     0.00    0  0.00     0.00    0  0.00   1  3 96  1.13 1.45 1.42
 
Start SoftRaid command "Verify" disk4

  256.00 3971 992.77   255.87 1954 488.17     0.00    0  0.00     0.00    0  0.00   2  4 95  1.13 1.45 1.42
  256.00 4286 1071.56   256.00 4277 1069.32     0.00    0  0.00     0.00    0  0.00   1  3 96  1.13 1.45 1.42
  256.00 4293 1073.30   256.00 4283 1070.82     0.00    0  0.00     0.00    0  0.00   1  4 95  1.13 1.45 1.42
  256.00 4297 1074.29   256.00 4285 1071.31     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.43 1.41
  256.00 4301 1075.13   256.00 4292 1072.89     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.43 1.41
  256.00 4292 1073.05   256.00 4280 1070.07     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.43 1.41
  256.00 4292 1073.07   256.00 4282 1070.58     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.43 1.41
  256.00 4296 1074.09   256.00 4286 1071.60     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.43 1.41
  256.00 4300 1075.03   256.00 4287 1071.80     0.00    0  0.00     0.00    0  0.00   2  3 95  0.96 1.40 1.40
  256.00 4297 1074.34   256.00 4283 1070.86     0.00    0  0.00     0.00    0  0.00   1  3 96  0.96 1.40 1.40
  256.00 4286 1071.59   256.00 4279 1069.85     0.00    0  0.00     0.00    0  0.00   1  3 96  0.96 1.40 1.40
  256.00 4308 1076.98   256.00 4294 1073.50     0.00    0  0.00     0.00    0  0.00   1  3 96  0.96 1.40 1.40
  256.00 4303 1075.73   256.00 4291 1072.74     0.00    0  0.00     0.00    0  0.00   1  3 96  0.96 1.40 1.40
  256.00 4277 1069.24   256.00 4267 1066.74     0.00    0  0.00     0.00    0  0.00   1  3 95  1.04 1.41 1.40
  256.00 4295 1073.73   256.00 4286 1071.49     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.41 1.40
  256.00 4297 1074.29   256.00 4281 1070.30     0.00    0  0.00     0.00    0  0.00   1  3 95  1.04 1.41 1.40
  256.00 4266 1066.62   256.00 4256 1063.88     0.00    0  0.00     0.00    0  0.00   2  4 93  1.04 1.41 1.40
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  256.00 4285 1071.18   256.00 4276 1068.93     0.00    0  0.00     0.00    0  0.00   2  4 94  1.04 1.41 1.40
  256.00 4301 1075.27   256.00 4288 1072.03     0.00    0  0.00     0.00    0  0.00   1  3 95  1.04 1.40 1.40
  256.00 4291 1072.63   256.00 4280 1069.89     0.00    0  0.00     0.00    0  0.00   2  4 94  1.04 1.40 1.40
  256.00 4291 1072.75   256.00 4283 1070.76     0.00    0  0.00     0.00    0  0.00   1  3 96  1.04 1.40 1.40
  256.00 4296 1073.92   256.00 4286 1071.43     0.00    0  0.00     0.00    0  0.00   3  4 92  1.04 1.40 1.40
 
Start SoftRaid command "Verify" disk5

  256.00 3977 994.28   256.00 4233 1058.16   255.69  807 201.59     0.00    0  0.00   2  4 94  1.04 1.40 1.40
  256.00 3062 765.59   256.00 4064 1015.90   256.00 3048 762.11     0.00    0  0.00   1  3 95  0.96 1.38 1.39
  256.00 3062 765.51   256.00 4064 1016.10   256.00 3049 762.26     0.00    0  0.00   1  3 96  0.96 1.38 1.39
  256.00 3065 766.32   256.00 4068 1017.12   256.00 3053 763.33     0.00    0  0.00   1  3 95  0.96 1.38 1.39
  256.00 3064 766.02   256.00 4065 1016.31   256.00 3051 762.79     0.00    0  0.00   1  3 95  0.96 1.38 1.39
  256.00 3065 766.31   256.00 4067 1016.86   256.00 3053 763.33     0.00    0  0.00   1  3 96  0.96 1.38 1.39
  256.00 3064 766.07   256.00 4067 1016.87   256.00 3052 763.08     0.00    0  0.00   1  4 95  1.04 1.39 1.39
  256.00 3061 765.31   256.00 4060 1015.02   256.00 3051 762.82     0.00    0  0.00   1  3 95  1.04 1.39 1.39
  256.00 3061 765.23   256.00 4069 1017.24   256.00 3053 763.24     0.00    0  0.00   1  3 96  1.04 1.39 1.39
  256.00 3063 765.73   256.00 4071 1017.82   256.00 3051 762.75     0.00    0  0.00   1  3 96  1.04 1.39 1.39
  256.00 3062 765.56   256.00 4071 1017.68   256.00 3053 763.32     0.00    0  0.00   1  4 95  1.04 1.39 1.39
  256.00 3066 766.55   256.00 4070 1017.60   256.00 3054 763.57     0.00    0  0.00   1  3 96  1.04 1.38 1.39
  256.00 3065 766.27   256.00 4068 1016.95   256.00 3051 762.77     0.00    0  0.00   1  3 96  1.04 1.38 1.39
  256.00 3061 765.18   256.00 4063 1015.83   256.00 3048 761.93     0.00    0  0.00   1  3 95  1.04 1.38 1.39
  256.00 3062 765.38   256.00 4068 1016.94   256.00 3053 763.14     0.00    0  0.00   2  3 95  1.04 1.38 1.39
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  256.00 3063 765.73   256.00 4064 1016.00   256.00 3048 762.00     0.00    0  0.00   1  3 95  1.04 1.38 1.39
  256.00 3063 765.84   256.00 4066 1016.46   256.00 3050 762.59     0.00    0  0.00   2  4 95  0.95 1.36 1.38
  256.00 3061 765.31   256.00 4066 1016.60   256.00 3049 762.33     0.00    0  0.00   1  3 95  0.95 1.36 1.38
  256.00 3066 766.41   256.00 4067 1016.82   256.00 3052 762.93     0.00    0  0.00   1  3 96  0.95 1.36 1.38
  256.00 3062 765.59   256.00 4064 1015.88   256.00 3050 762.59     0.00    0  0.00   1  4 95  0.95 1.36 1.38
  256.00 3063 765.82   256.00 4065 1016.19   256.00 3051 762.83     0.00    0  0.00   1  3 95  0.95 1.36 1.38
  256.00 3058 764.58   256.00 4062 1015.38   256.00 3047 761.85     0.00    0  0.00   1  4 95  0.88 1.34 1.38
  256.00 3058 764.48   256.00 4058 1014.56   256.00 3045 761.23     0.00    0  0.00   2  4 95  0.88 1.34 1.38
  256.00 3055 763.77   256.00 4062 1015.62   256.00 3044 761.03     0.00    0  0.00   3  4 93  0.88 1.34 1.38
  256.00 3061 765.20   256.00 4062 1015.53   256.00 3049 762.21     0.00    0  0.00   2  4 94  0.88 1.34 1.38
  256.00 3062 765.47   256.00 4074 1018.62   256.00 3055 763.72     0.50    2  0.00   1  4 95  0.88 1.34 1.38
  256.00 3062 765.49   256.00 4067 1016.76   256.00 3051 762.75     0.00    0  0.00   2  3 95  0.89 1.33 1.37
  256.00 2902 725.57   256.00 3535 883.71   256.00 2892 723.08      0.00    0  0.00   2  4 94  0.89 1.33 1.37
  256.00 2840 710.08   256.00 3336 834.11   256.00 2830 707.60      0.00    0  0.00   1  4 95  0.89 1.33 1.37
  256.00 2823 705.66   256.00 3281 820.16   256.00 2815 703.67      0.00    0  0.00   2  4 94  0.89 1.33 1.37
  256.00 2829 707.20   256.00 3284 820.96   256.00 2818 704.46      0.00    0  0.00   1  4 95  0.89 1.33 1.37
  256.00 2833 708.13   256.00 3301 825.19   256.00 2822 705.39      0.00    0  0.00   2  4 94  0.89 1.33 1.37
  256.00 2826 706.47   256.00 3287 821.63   256.00 2814 703.47      0.00    0  0.00   2  4 94  0.89 1.33 1.37
  256.00 2820 705.12   256.00 3280 819.90   256.00 2811 702.63      0.00    0  0.00   1  4 95  0.89 1.33 1.37
  256.00 2827 706.87   256.00 3302 825.42   256.00 2817 704.13      0.00    0  0.00   2  4 94  0.89 1.33 1.37
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  256.00 2827 706.84   256.00 3283 820.69   256.00 2817 704.34      0.00    0  0.00  1  4 95  0.89 1.33 1.37
  256.00 2824 705.96   256.00 3287 821.84   256.00 2814 703.47      0.00    0  0.00   2  5 93  0.98 1.34 1.37
  256.00 3061 765.25   256.00 4066 1016.60   256.00 3051 762.76     0.00    0  0.00   2  4 95  0.98 1.34 1.37
  256.00 3059 764.72   256.00 4041 1010.24   256.00 3042 760.49     0.00    0  0.00   2  5 93  0.98 1.34 1.37
  256.00 3063 765.64   256.00 4066 1016.45   256.00 3054 763.40     0.00    0  0.00   1  3 96  0.98 1.34 1.37
  256.00 3064 765.96   256.00 4077 1019.19   256.00 3056 763.96     0.00    0  0.00   1  2 97  0.98 1.34 1.37
  256.00 3059 764.71   256.00 4064 1016.03   256.00 3047 761.71     0.00    0  0.00   3  4 93  1.06 1.35 1.38
  256.00 3063 765.78   256.00 4071 1017.80   256.00 3053 763.29     0.00    0  0.00   2  4 94  1.06 1.35 1.38
 
Start SoftRaid command "Verify" disk6

  256.00 2603 650.73   256.00 2868 717.10   256.00 2599 649.74   255.86 1773 442.94   2  4 94  1.06 1.35 1.38
  256.00 2488 621.90   256.00 2486 621.40   256.00 2488 621.90   256.00 2485 621.16   1  4 95  1.06 1.35 1.38
  256.00 2478 619.39   256.00 2473 618.14   256.00 2475 618.64   256.00 2472 617.90   1  4 95  1.06 1.35 1.38
  256.00 2452 613.02   256.00 2448 612.02   256.00 2449 612.27   256.00 2446 611.52   1  4 95  1.38 1.41 1.40
  256.00 2454 613.59   256.00 2452 613.09   256.00 2455 613.83   256.00 2452 613.09   1  4 94  1.38 1.41 1.40
  256.00 2487 621.77   256.00 2484 621.02   256.00 2484 621.02   256.00 2482 620.52   1  4 94  1.38 1.41 1.40
  256.00 2496 624.03   256.00 2493 623.29   256.00 2495 623.78   256.00 2494 623.53   2  4 94  1.38 1.41 1.40
  256.00 2443 610.73   256.00 2442 610.48   256.00 2442 610.48   256.00 2442 610.48   1  3 95  1.38 1.41 1.40
  256.00 2498 624.59   256.00 2496 624.09   256.00 2494 623.59   256.00 2493 623.34   1  4 94  1.67 1.47 1.42
  256.00 2516 628.91   256.00 2511 627.67   256.00 2513 628.17   256.00 2510 627.42   2  5 94  1.67 1.47 1.42
  256.00 2497 624.18   256.00 2494 623.44   256.00 2497 624.18   256.00 2493 623.19   2  5 93  1.67 1.47 1.42
  256.00 2459 614.72   256.00 2460 614.97   256.00 2458 614.47   256.00 2458 614.47   1  4 95  1.67 1.47 1.42
              disk3               disk4               disk5               disk6       cpu    load average
    KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s     KB/t  tps  MB/s  us sy id   1m   5m   15m
  256.00 2477 619.32   256.00 2476 619.07   256.00 2475 618.83   256.00 2474 618.58   1  3 95  1.67 1.47 1.42
  256.00 2468 617.04   256.00 2462 615.54   256.00 2466 616.54   256.00 2462 615.54   1  4 94  1.85 1.51 1.43
  256.00 2437 609.16   256.00 2437 609.16   256.00 2435 608.67   256.00 2434 608.42   1  4 95  1.85 1.51 1.43
  256.00 2500 625.08   256.00 2498 624.58   256.00 2498 624.58   256.00 2497 624.33   2  4 94  1.85 1.51 1.43
  256.00 2458 614.40   256.00 2455 613.65   256.00 2456 613.90   256.00 2455 613.65   1  3 95  1.85 1.51 1.43
  256.00 2448 611.99   256.00 2446 611.49   256.00 2448 611.99   256.00 2446 611.49   1  4 95  1.85 1.51 1.43
  256.00 2473 618.33   256.00 2464 616.08   256.00 2468 617.08   256.00 2467 616.83   1  4 95  1.71 1.48 1.43
  256.00 2509 627.28   256.00 2506 626.54   256.00 2507 626.78   256.00 2504 626.04   1  4 95  1.71 1.48 1.43
  256.00 2416 604.07   256.00 2415 603.82   256.00 2418 604.57   256.00 2417 604.32   1  4 95  1.71 1.48 1.43
  256.00 2456 613.98   256.00 2450 612.48   256.00 2453 613.23   256.00 2449 612.23   1  4 95  1.71 1.48 1.43
  256.00 2441 610.17   256.00 2438 609.43   256.00 2440 609.92   256.00 2439 609.68   1  3 96  1.71 1.48 1.43
  256.00 2478 619.55   256.00 2473 618.31   256.00 2475 618.80   256.00 2474 618.56   1  4 94  1.73 1.49 1.43
  256.00 2669 667.29   256.00 2655 663.81   256.00 2662 665.55   256.00 2658 664.56   2  4 94  1.73 1.49 1.43
  256.00 2704 675.91   256.00 2689 672.18   256.00 2688 671.93   256.00 2692 672.92   1  4 95  1.73 1.49 1.43
  256.00 2703 675.66   256.00 2685 671.17   255.90 2689 671.92   256.00 2690 672.42   1  3 95  1.73 1.49 1.43
  256.00 2712 677.95   256.00 2686 671.48   256.09 2696 674.22   256.00 2691 672.73   1  2 97  1.73 1.49 1.43
  256.00 2702 675.58   256.00 2689 672.35   256.00 2696 674.09   256.00 2686 671.60   1  3 96  1.59 1.47 1.42
  256.00 2700 675.09   256.00 2696 674.10   256.00 2695 673.85   256.00 2695 673.85   1  3 96  1.59 1.47 1.42
  256.00 2698 674.50   256.00 2696 674.00   256.00 2691 672.75   255.91 2697 674.00   1  4 95  1.59 1.47 1.42
  256.00 2704 676.08   256.00 2693 673.34   256.00 2694 673.59   256.09 2690 672.85   1  3 96  1.59 1.47 1.42
^C
sadmin@ozzie ~ % 
 
Posted : 21/12/2021 4:17 pm
(@thotha)
Posts: 9
Active Member
Topic starter
 

No I've started the "Certify" test run.
The speed measured are starting with approx. 700MB/s for one disk down to approx. 250MB/s per disk if all four of them are executing the "Certify" command.

We'll see within the next ~6-8h what the outcome after this will be.

 
Posted : 21/12/2021 4:52 pm
 tal
(@tal)
Posts: 10
Active Member
 

Try using AJA SystemTest 16.1 on the M1 as it is optimized for M1. You can get it as part of the AJA Software Installer v16.1 - Mac: https://www.aja.com/products/aja-control-room#suppor t"> https://www.aja.com/products/aja-control-room#support

 

Your Mac mini 7,1 is Thunderbolt 2 and tops out at about 1500 MB/s. Each bay in the U.2 Dual is two PCIe lanes, so on that Mac mini, you should expect about half the bandwidth when testing only 1 drive (1500/2). When using four blades, make sure to put an even number for "Drive A" and "Drive B" so that the entire 4 lanes of the Thunderbolt PCIe 3 bandwidth are used.

 

You'll likely see better results when using AJA 16.1 on your Mac mini 9,1 (m1). Splitting the drives evenly on both bays should yield four PCIe lanes of bandwidth.

 
Posted : 21/12/2021 5:08 pm
(@softraid-support)
Posts: 8005
Member Admin
 

@thotha 

You can cancel the certify at any time. This was just to get some ideas.

I don't know why you cannot add .txt files, I can. Are these text edit? or BBedit? text edit may call a file text but save it as rtf or similar.

 

How are your 4 blades installed? They need to be 2 on each side, so you can maximize throughput.

 
Posted : 21/12/2021 5:37 pm
(@thotha)
Posts: 9
Active Member
Topic starter
 

@tal 
Thank you for your writing.
The blades have been installed equally split on slot C and D of both NVME tu U.2 cases in the Mercury Dual U.2 box.

Now I did swap them both to slot A and B.
There was NO difference.

Right now I do the tests again and will send a download link for the test result files so you can download them.
This will take some time and will happen later today.

I did also order this two NVME cases for test purpose.
Delock USB4™ 40 Gbps Enclosure for 1 x M.2 NVMe SSD - tool free
Delock External Enclosure for M.2 NVMe PCIe SSD with SuperSpeed USB 20 Gbps (USB 3.2 Gen 2x2) USB Type-C™ female

They should arrive hopefully by thursday so I can then compare them with the OWC Mercury.
Still, my beleve is that there is either a compatibility problem
- between the controller chip of the ADATA NVME Blades and the OWC Mercury
- between the controller chip of the OWC Mercury with MacMini 7.1 and 9.1
- with macOS Catalina/macOS Monterey
- some mixture of all above combinations....

 

 
Posted : 22/12/2021 8:07 am
(@thotha)
Posts: 9
Active Member
Topic starter
 

@softraid-support 
Thank you to for your feedback.

See my response to @tal
https://forums.softraid.com/postid/13521/

 
Posted : 22/12/2021 8:08 am
(@thotha)
Posts: 9
Active Member
Topic starter
 

@softraid-support, @tal

Here is a URL download link for the several test files and videos.
In the videos it gets very very interesting after about 45-60 seconds.

 
Posted : 22/12/2021 10:58 am
 tal
(@tal)
Posts: 10
Active Member
 

Hey Thomas- heads up that the DeLock enclosure is PCIe 3x2 (2 lanes). This is a limitation of Thunderbolt as Intel will only certify empty enclosures with 2 lanes instead of 4 for power draw limitations. Not that it makes a big difference here- you should see similar results as having 1 blade tested between the Mercury enclosure and DeLock.

 

Could also be limitation of the ADATA ssd and MacOS in general. The ADATA ssd uses SMI2262EN, which is not as consistent of an SSD as a Phison E12/E12s-based drive. So your speeds jumping around could be a result of the ADATA ssd...

Your videos show good peak speeds but inconsistent sustained, which makes me think the SSD is the culprit. If the speeds remain with the DeLock enclosure, you'll want to maybe test out a different SSD. Not all M.2's are created equal.

 
Posted : 22/12/2021 12:15 pm
(@thotha)
Posts: 9
Active Member
Topic starter
 

@tal 
Thank you for feedback about the ADATA SSD and the controller chips used.
We'll see the tests and I'll give feedback.

 
Posted : 22/12/2021 2:56 pm
(@thotha)
Posts: 9
Active Member
Topic starter
 

@tal 

What NVME SSD's would you suggest?
As I can understand I should go for Phison E12 controller, right?

 
Posted : 23/12/2021 2:27 am
(@softraid-support)
Posts: 8005
Member Admin
 

@thotha 

I agree with getting the phison.

 
Posted : 23/12/2021 2:54 am
(@thotha)
Posts: 9
Active Member
Topic starter
 

@softraid-support, @tal

Hello all
Hope you did have time for relaxing and happy x-mas time with family and friends.

@softraid-suppor:
I guess I found the problem of the low speeds.
According to the System Profiler, the OWC Mercury Dual U.2 does ONLY use x2 lanes on NVME BUS with ONE NVME Blade installed, where as the DeLock 42012 with Intel Chip Controller does use x4 lanes on NVME BUS also with ONLY ONE blade installed.

If I would have known this earlier, I could have saved about 500.- bucks for the two Silicon Power P34A80 2TB with the Phison PS5012-E12 chip I bought because I thought the ADATA Drives are NOT compatible with macOS and/or OWC Mercury.

So I'm wondering how to go on with this or did I oversee some important technology rules?
What are the next steps?

And as I'm still not able to upload any PNG or JPG pictures, here is the download link for the pictures.

Regards
Thomas

This post was modified 2 years ago by Thomas Th.
 
Posted : 27/12/2021 4:47 pm
(@softraid-support)
Posts: 8005
Member Admin
 

@thotha 

You can upload .txt or .jpg files, they both work. (RTF or other text extensions do not upload.)

Forums are blasted by spammers/hackers, so we are careful on allowed extension types, sorry for that.

 

Maybe Tal can comment on whether you missed anything in technology, I have some ideas, but he is a better hardware expert. ;-)

 
Posted : 27/12/2021 6:30 pm
Page 1 / 2
Share:
close
open