Copy performance be...
 
Notifications
Clear all

Copy performance between volumes RAID 5

(@markcalexander)
Active Member Customer

I am attempting to copy a variety of files from one volume to another totaling 2.18TB. The MacOS time estimate for this task is saying 2 days which seems much longer than the original creation of the files. Is this slow or normal?

I checked a few posts that had responses to check if "Enable write cache" is checked - and mine is.

I also see that some post what Blackmagic speed test to the target volume and it comes back with 294.0 MB/s

Is this as expected with my set up or something I need to address?

SoftRAID v5.8.4
Thunderbay 6 with 6 10TB drives
MacBook Pro late 2016
macOS Mojave 10.14.6

Kind regards,
Mark 

Quote
Topic starter Posted : 28/09/2020 11:37 am
(@softraid-support)
Member Admin

It should take 5 hours with your setup. Much slower means perhaps the volume directory is damaged. Do you have Disk Warrior? Might be worth a run if you have it.

I am pretty sure this is a file system issue, not a hardware issue.

ReplyQuote
Posted : 28/09/2020 12:48 pm
(@markcalexander)
Active Member Customer

I do have Disk Warrior and used it when setting up volumes. I will stop the copy and run DW on the volumes and report back.

Thank you for the suggestion.

Kind regards,

Mark

ReplyQuote
Topic starter Posted : 28/09/2020 1:17 pm
(@markcalexander)
Active Member Customer

Problem remains.

I have now used Disk Warrior and yes the volumes did need to be rebuilt as the Directory Optimization Index was 3, in Red zone and now is updated and fully optimized.

I next launched the same copy from one volume to the other and yet again it shows as needing 2 days to copy.

Any other suggestions - this is slower than expected. Not sure what else could be causing the problem as my MBP was maxed out for what it was at the time and Thunderbay 6 volumes are within the same unit and RAID 5 with plenty of capacity in both the target and source volumes. I believe I have high quality hard drives from 2019, all are Toshiba 10TB 3.5 SATA 7200 6Gb/s.

Any thoughts would be greatly appreciated.

Kind regards,

Mark

 

SoftRAID v5.8.4
Thunderbay 6 with 6 Toshiba 10TB drives 3.5 SATA 7200 6Gb/s
MacBook Pro late 2016 (2.9 GHz Intel Core i7 / 16GB Memory)
macOS Mojave 10.14.6

ReplyQuote
Topic starter Posted : 28/09/2020 4:38 pm
(@softraid-support)
Member Admin

Cancel the copy. Copy one large file. See what you get. Also, open Activity montior when you do this and see what the copy speed is (its approximate).

 

Its possible there are lots of small files, so it is starting with slow estimate.

Another idea (be very careful) is use Carbon Copy Cloner to copy the files. You need to be sure you do not erase files on destination, but it is much faster at copying than Finder.

ReplyQuote
Posted : 28/09/2020 5:55 pm
(@markcalexander)
Active Member Customer

Interesting. I will give it a try. I have one file that is 1.5GB so that would be a good test for your scenario above.

It is my photography image files so 200,000 files of various sizes from 5MB to 50MB or so. I should have thought of CCC that would have been quicker.

Thanks,

Mark

ReplyQuote
Topic starter Posted : 28/09/2020 6:07 pm
(@markcalexander)
Active Member Customer

As suggested, I tried doing the copy with Carbon Copy Cloner. In the end it also took a long time, although not 2 days.
Here are the results:

Files copied: 586,750 (4.37TB)

Time elapsed: 1906

I accomplished my task but took more time than it should.

What else can I try to improve performance on my next large task?

Kind regards,

Mark

 

SoftRAID v5.8.4
Thunderbay 6 with 6 Toshiba 10TB drives 3.5 SATA 7200 6Gb/s
MacBook Pro late 2016 (2.9 GHz Intel Core i7 / 16GB Memory)
macOS Mojave 10.14.6

ReplyQuote
Topic starter Posted : 29/09/2020 6:00 pm
(@softraid-support)
Member Admin

Attach a SoftRAID tech support file and let me make sure you are not missing something obvious.

ReplyQuote
Posted : 29/09/2020 6:16 pm
(@markcalexander)
Active Member Customer

Sure - here you go - SoftRAID tech support file.

Appreciate the assistance.

Kind regards,

Mark

 

ReplyQuote
Topic starter Posted : 29/09/2020 7:19 pm
(@softraid-support)
Member Admin

You have tons of volumes. This makes your results less predictable. Plus I wonder if you are copying from one volume to another on the same disks? To get good results, you need to copy from separate disks. Are you doing that?

ReplyQuote
Posted : 29/09/2020 8:30 pm
(@markcalexander)
Active Member Customer

Interesting. Never thought number of volumes would matter but good to know. Have RAID5 setup with 9 volumes sized for their use on the Thunderbay 6.

When you say I need to copy from separate disks not sure I know what you mean as with RAID5 are not the volumes spread between the disks for safety?

I was copying between volumes in this case, with both residing on the Thunderbay 6.

When I copy files directly from MBP to a Thunderbay volume I do get better performance.

Thoughts?

ReplyQuote
Topic starter Posted : 30/09/2020 1:07 pm
(@softraid-support)
Member Admin

That explains it. What you are doing is essentially the same a "duplicating" a large folder. The drive heads thrash back and forth, greatly slowing performance. Not much you can do about it.

ReplyQuote
Posted : 30/09/2020 5:35 pm
(@markcalexander)
Active Member Customer

Thanks - better to know and allow time should I have to do again sometime. Just now in transition and testing of my photo files from old Aperture no longer supported by Apple to Lightroom and it is painful. Simply trying to keep duplicates while this is in process just in case something goes wrong.

Would it have been better copying to an external drive outside the RAID5?

Appreciate your help.

ReplyQuote
Topic starter Posted : 01/10/2020 8:22 am
(@softraid-support)
Member Admin

You need to copy to the RAID at some point, so you are OK, it just takes longer.

ReplyQuote
Posted : 01/10/2020 1:27 pm
Share:
close
open