[Sticky] Monterey Crash/kernel panics

Hope this is what you were looking for...

Attachment : Reni Barlow 2021-11-25 16.23.35.sr_supt

@rabarlow

Normally I want the support file, but here I want the crash report.

When the system crashes at restart, you can "report to Apple". then click "more details". In that pop up, copy all, paste into a text file and you can attach that (save as plain text txt).

thanks

In your RAID volume, is it in an 8 drive Thunderbay?

@softraid-support Oh, OK. I'll have to put all the drives back in and then get it to panic.

My RAID 5 is on 8 drives spread over two ThunderBay 4 (Thunderbolt 2) units.

@rabarlow

Appreciate the assistance. We have a partial fix so far, but not complete yet.  the 6.2.1 beta was promising, but there is more to this crash.

Here you go...

FYI, plugging in one ThunderBay unit worked fine this time - even through multiple restarts and shutdowns. After plugging in the second unit with all 4 drives installed, the panic/reboot behaviour returned.

Hope this is helpful.

Attachment : SoftRAID Panic Report.txt

@rabarlow

So one causes panics, the other does not?

Interesting. Next week I may want more information, if we cannot make progress on our own. thanks!

Attachment : Crash Report - MacOS 12.01-MB16"M1max.rtf

Running the Softraid Beta version, did uninstall previous version before installing this one.

 

@craignos

Thanks, it may be next week before we find anything new out.

This should work with 1 drive removed, btw.  Not idea, but we are working hard on this issue

@softraid-support you know the interesting part: I plugged in an old LaCie Blu-ray Disc burner with USB 2.0 to my OWC thunderbolt 4 hub, and same thing, it flashed pink and crashed when it tried to read the data on the disc. I switched after that to FireWire 400 and a bunch of dongles to thunderbolt 3, and it worked.

In short, it’s not just you guys, but I’m a video editor and 8 need my Thunderbay 4 to work solid.

@craignos

thanks for the info on the DVD.

We are working on this, the system that replicated the problem is a big help. We still do not know if the fix is going to require a macOS update or not.

FWIW, I see the same "pink flash" just before the system reboots that Craignos reported.

Also, I tried adding the second ThunderBay 4 unit with one drive pulled and it panicked. Panic report attached. It's probably the same as the one sent previously, but just in case...

Attachment : SoftRAID Panic Report2.txt

 

@rabarlow

Yes it is the same panic and 6.2.1 b3 is indeed loading. Hang in there until we can work more on this.

For years I have had two ThunderBay 4 (Thunderbolt 2) RAID units connected to my mid-2011 Mac mini (5,1) running SoftRAID v5 and MacOS 10.12.6. The OS on this Mac mini can no longer be upgraded so I purchased a new M1 Mac mini (9,1), installed SoftRAID 6.2 (app and driver), connected the two ThunderBay 4 RAID units (daisy chain) to one of the TB3 ports on the mini using Apple TB3-to-TB2 adapter. Initially everything appeared OK: SoftRAID PRO 6.2 launched and displayed the disks and volumes and the volumes mounted. BTW: I run both Mac minis headless in a Sonnet Rack Mini and use them primarily as file servers. Because the M1 Mac mini is brand-new, I have very few, if any, third-party programs installed besides SoftRAID.

I was able to mount the RAID volumes hosted by the M1 mini from other Macs and PCs and accessed the new Mac mini via Apple Remote Desktop. The new machine crashed repeatedly and presented a report detailing a kernel panic. The mini would restart and perhaps run for a few hours but never run as long as a day before crashing and rebooting again. Sometimes multiple, repeated crashes/reboots. Turned off all sleep and power saving modes, including on the advanced Ethernet settings. When the ThunderBay units are disconnected, the computer boots normally and runs fine (no crashes or reboots for days now). Contacted Apple Tech Support and they referred me to the reports on this forum. My experience sounds very similar to those described above. I have appended kernel panic report and hope that it will be useful in tracking down this issue. Until this is resolved, I will not be able to use this new Mac mini as a file server.

panic(cpu 3 caller 0xfffffe001bb9dcec): "dart-apciec0 (0xfffffe150e504000): DART(DART) error: SID 2 read protect exception on read with DVA 0x7a000 (TTBR 0 SEG 0 PTE 0x1e) ERROR_STATUS 0x82000090 TIME 0x9bee42f6af1 TTE 0x81f0981388001 AXI_ID 0)" @AppleT8020DART.cpp:1411

Debugger message: panic

Memory ID: 0x6

OS release type: User

OS version: 21A559

Kernel version: Darwin Kernel Version 21.1.0: Wed Oct 13 17:33:24 PDT 2021; root:xnu-8019.41.5~1/RELEASE_ARM64_T8101

Fileset Kernelcache UUID: 39AE122AC7508C4798C8CF27369575F7

Kernel UUID: 65055A0F-950D-365E-BE19-6B3D6230C622

iBoot version: iBoot-7429.41.5

secure boot?: YES

Paniclog version: 13

KernelCache slide: 0x0000000012c5c000

KernelCache base:  0xfffffe0019c60000

Kernel slide:      0x0000000013480000

Kernel text base:  0xfffffe001a484000

Kernel text exec slide: 0x0000000013564000

Kernel text exec base:  0xfffffe001a568000

mach_absolute_time: 0x3be0a6d4f9

Epoch Time:        sec       usec

  Boot    : 0x619cfc80 0x000aabeb

  Sleep   : 0x00000000 0x00000000

  Wake    : 0x00000000 0x00000000

  Calendar: 0x619d2655 0x00082240

 

Zone info:

Foreign   : 0xfffffe0020854000 - 0xfffffe0020868000

Native    : 0xfffffe1000634000 - 0xfffffe3000634000

Readonly  : 0 - 0

Metadata  : 0xfffffe639cef0000 - 0xfffffe63a8e70000

Bitmaps   : 0xfffffe63a8e70000 - 0xfffffe63ae964000

CORE 0 recently retired instr at 0xfffffe001a6f0640

CORE 1 recently retired instr at 0xfffffe001a6f0640

CORE 2 recently retired instr at 0xfffffe001a6f0640

CORE 3 recently retired instr at 0xfffffe001a6eef90

CORE 4 recently retired instr at 0xfffffe001a6f0644

CORE 5 recently retired instr at 0xfffffe001a6f0644

CORE 6 recently retired instr at 0xfffffe001a6f0644

CORE 7 recently retired instr at 0xfffffe001a6f0644

CORE 0 PVH locks held: None

CORE 1 PVH locks held: None

CORE 2 PVH locks held: None

CORE 3 PVH locks held: None

CORE 4 PVH locks held: None

CORE 5 PVH locks held: None

CORE 6 PVH locks held: None

CORE 7 PVH locks held: None

CORE 0: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe609559bef0

CORE 1: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe60936b3ef0

CORE 2: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe60936d3ef0

CORE 3 is the one that panicked. Check the full backtrace for details.

CORE 4: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe609387bef0

CORE 5: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe6030cfbef0

CORE 6: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe60935a3ef0

CORE 7: PC=0xfffffe001a5eeb5c, LR=0xfffffe001a5eeb5c, FP=0xfffffe6030b4bef0

Panicked task 0xfffffe1512c50938: 31280 pages, 8 threads: pid 400: mds_stores

Panicked thread: 0xfffffe15299a2f08, backtrace: 0xfffffe605706f490, tid: 79343

                                  lr: 0xfffffe001a5ba464  fp: 0xfffffe605706f500

                                  lr: 0xfffffe001a5ba134  fp: 0xfffffe605706f570

                                  lr: 0xfffffe001a6f5c30  fp: 0xfffffe605706f590

                                  lr: 0xfffffe001a6e8e84  fp: 0xfffffe605706f610

                                  lr: 0xfffffe001a6e684c  fp: 0xfffffe605706f6d0

                                  lr: 0xfffffe001a56f7f8  fp: 0xfffffe605706f6e0

                                  lr: 0xfffffe001a5b9dac  fp: 0xfffffe605706fa80

                                  lr: 0xfffffe001a5b9dac  fp: 0xfffffe605706faf0

                                  lr: 0xfffffe001adb7c5c  fp: 0xfffffe605706fb10

                                  lr: 0xfffffe001bb9dcec  fp: 0xfffffe605706fd80

                                  lr: 0xfffffe001bb9d794  fp: 0xfffffe605706fe20

                                  lr: 0xfffffe001bb9cec0  fp: 0xfffffe605706fed0

                                  lr: 0xfffffe001acdca34  fp: 0xfffffe605706ff10

                                  lr: 0xfffffe001b754de0  fp: 0xfffffe605706ffb0

                                  lr: 0xfffffe001ad03c8c  fp: 0xfffffe605706ffc0

                                  lr: 0xfffffe001a6e99a8  fp: 0xfffffe605706ffe0

                                  lr: 0xfffffe001a56f86c  fp: 0xfffffe605706fff0

      Kernel Extensions in backtrace:

         com.apple.driver.AppleT8020DART(1.0)[9FF1D94E-2019-3D8F-841B-0EB5A42591FE]@0xfffffe001bb98540->0xfffffe001bb9fff3

            dependency: com.apple.driver.AppleARMPlatform(1.0.2)[478C7C28-E159-3083-A01D-1BBB61C10D35]@0xfffffe001af22260->0xfffffe001af6a9fb

            dependency: com.apple.driver.IODARTFamily(1)[4918C962-3E77-37B9-BAF3-09A3AA7F82D9]@0xfffffe001c5142d0->0xfffffe001c5269af

         com.apple.driver.AppleInterruptController(1.0d1)[18EE90CF-4C28-3A06-AB27-9CA5CA30D6BA]@0xfffffe001b7526b0->0xfffffe001b755df3

            dependency: com.apple.driver.AppleARMPlatform(1.0.2)[478C7C28-E159-3083-A01D-1BBB61C10D35]@0xfffffe001af22260->0xfffffe001af6a9fb

 

last started kext at 251191534215: com.softraid.driver.SoftRAID 6.2 (addr 0xfffffe0019b14000, size 7197)

loaded kexts:

com.softraid.driver.SoftRAID       6.2

com.apple.driver.AppleAHCIPort               351

com.apple.filesystems.smbfs       4.0

com.apple.filesystems.autofs      3.0

com.apple.fileutil             20.036.15

com.apple.driver.AppleBiometricServices              1

com.apple.driver.CoreKDL            1

com.apple.driver.AppleAOPVoiceTrigger                100.1

com.apple.driver.BCMWLANFirmware4378.Hashstore     1

com.apple.driver.SEPHibernation              1

com.apple.driver.DiskImages.ReadWriteDiskImage           493.0.0

com.apple.driver.DiskImages.UDIFDiskImage       493.0.0

com.apple.driver.DiskImages.RAMBackingStore  493.0.0

com.apple.driver.DiskImages.FileBackingStore    493.0.0

com.apple.iokit.AppleBCM5701Ethernet                11.0.0

com.apple.filesystems.apfs          1933.41.2

com.apple.driver.AppleSmartBatteryManager     161.0.0

com.apple.driver.AppleUSBDeviceNCM  5.0.0

com.apple.driver.AppleThunderboltIP     4.0.3

com.apple.driver.AppleFileSystemDriver                3.0.1

com.apple.nke.l2tp          1.9

com.apple.filesystems.tmpfs       1

com.apple.filesystems.lifs             1

com.apple.IOTextEncryptionFamily          1.0.0

com.apple.filesystems.hfs.kext   582.40.4

com.apple.security.BootPolicy    1

com.apple.BootCache    40

com.apple.driver.ApplePMP        1

com.apple.AppleFSCompression.AppleFSCompressionTypeZlib    1.0.0

com.apple.AppleFSCompression.AppleFSCompressionTypeDataless          1.0.0d1

com.apple.driver.AppleSmartIO2               1

com.apple.driver.ApplePMPFirmware     1

com.apple.AppleEmbeddedSimpleSPINORFlasher              1

com.apple.driver.AppleSPMIPMU             1.0.1

com.apple.driver.AppleCS42L83Audio     502.6

com.apple.driver.AppleTAS5770LAmp     502.6

com.apple.driver.AudioDMAController-T8103     100.51

com.apple.driver.usb.AppleSynopsysUSB40XHCI 1

com.apple.driver.AppleAVE2       501.6.9

com.apple.driver.AppleJPEGDriver            4.7.8

com.apple.driver.AppleSPIMC     1

com.apple.driver.AppleSerialShim            1

com.apple.driver.AppleT8020SOCTuner 1

com.apple.driver.AppleT8103CLPCv3      1

com.apple.AGXG13G      187.57

com.apple.driver.AppleAVD         415

com.apple.driver.AppleMobileDispH13G-DCP      140.0

com.apple.driver.AppleEventLogHandler               1

com.apple.driver.AppleS5L8960XNCO     1

com.apple.driver.AppleT8103PMGR         1

com.apple.driver.AppleS8000AES              1

com.apple.driver.AppleS5L8920XPWM   1.0.0d1

com.apple.driver.AppleS8000DWI             1.0.0d1

com.apple.driver.AppleInterruptController           1.0.0d1

com.apple.driver.AppleM68Buttons         1.0.0d1

com.apple.driver.AppleBluetoothModule              1

com.apple.driver.AppleSamsungSerial    1.0.0d1

com.apple.driver.AppleBCMWLANBusInterfacePCIe          1

com.apple.driver.AppleMCDP29XXUpdateSupport            1

com.apple.driver.AppleT8020DART          1

com.apple.driver.AppleS5L8940XI2C        1.0.0d2

com.apple.driver.AppleT8101     1

com.apple.iokit.IOUserEthernet 1.0.1

com.apple.driver.usb.AppleUSBUserHCI 1

com.apple.iokit.IOKitRegistryCompatibility            1

com.apple.iokit.EndpointSecurity              1

com.apple.driver.AppleDiskImages2        126.40.1

com.apple.AppleSystemPolicy    2.0.0

com.apple.nke.applicationfirewall            402

com.apple.kec.InvalidateHmac   1

com.apple.kec.AppleEncryptedArchive   1

com.apple.iokit.IOAHCIBlockStorage        333

com.apple.iokit.IOAHCIFamily     295

com.apple.driver.AppleThunderboltDPOutAdapter           8.5.0

com.apple.driver.AppleThunderboltPCIUpAdapter            4.1.1

com.apple.plugin.IOAVBDiscoveryPlugin 1010.2

com.apple.driver.driverkit.serial 6.0.0

com.apple.iokit.IOAVBFamily      1010.2

com.apple.plugin.IOgPTPPlugin  1000.11

com.apple.iokit.IOEthernetAVBController              1.1.0

com.apple.kext.triggers 1.0

com.apple.driver.AppleMesaSEPDriver   100.99

com.apple.iokit.IOBiometricFamily           1

com.apple.driver.AppleAOPAudio             102.2

com.apple.driver.AppleSEPHDCPManager             1.0.1

com.apple.driver.AppleTrustedAccessory              1

com.apple.iokit.AppleSEPGenericTransfer             1

com.apple.driver.DiskImages.KernelBacked          493.0.0

com.apple.driver.usb.AppleEmbeddedUSBXHCIPCI            1

com.apple.driver.usb.AppleUSBXHCIPCI 1.2

com.apple.driver.AppleEmbeddedUSB    1

com.apple.driver.AppleConvergedIPCOLYBTControl          1

com.apple.driver.AppleConvergedPCI      1

com.apple.driver.AppleBluetoothDebug 1

com.apple.driver.AppleXsanScheme        3

com.apple.driver.AppleBTM        1.0.1

com.apple.driver.usb.networking              5.0.0

com.apple.driver.AppleThunderboltPCIDownAdapter      4.1.1

com.apple.driver.AppleThunderboltUSBDownAdapter     1.0.4

com.apple.driver.AppleThunderboltDPInAdapter               8.5.0

com.apple.driver.AppleThunderboltDPAdapterFamily      8.5.0

com.apple.driver.AppleDCPDPTXProxy    1.0.0

com.apple.driver.DCPDPFamilyProxy       1

com.apple.nke.ppp          1.9

com.apple.driver.AppleBSDKextStarter   3

com.apple.filesystems.hfs.encodings.kext             1

com.apple.driver.AppleSPU         1

com.apple.iokit.IONVMeFamily  2.1.0

com.apple.driver.AppleDialogPMU           1.0.1

com.apple.driver.AppleStockholmControl              1.0.0

com.apple.driver.AppleDiagnosticDataAccessReadOnly   1.0.0

com.apple.driver.AppleNANDConfigAccess           1.0.0

com.apple.AGXFirmwareKextG13GRTBuddy         187.57

com.apple.AGXFirmwareKextRTBuddy64               187.57

com.apple.driver.AppleHPM        3.4.4

com.apple.driver.AppleCSEmbeddedAudio           502.6

com.apple.driver.AppleEmbeddedAudio 502.6

com.apple.iokit.AppleARMIISAudio          100.1

com.apple.driver.DCPAVFamilyProxy       1

com.apple.driver.AppleUSBXDCIARM      1.0

com.apple.driver.AppleUSBXDCI                1.0

com.apple.iokit.IOUSBDeviceFamily         2.0.0

com.apple.driver.usb.AppleSynopsysUSBXHCI     1

com.apple.driver.usb.AppleUSBXHCI        1.2

com.apple.driver.AppleEmbeddedUSBHost           1

com.apple.driver.usb.AppleUSBHub         1.2

com.apple.driver.usb.AppleUSBHostCompositeDevice     1.2

com.apple.driver.ApplePassthroughPPM               3.0

com.apple.driver.AppleH11ANEInterface               5.33.0

com.apple.iokit.IOGPUFamily      35.11

com.apple.driver.AppleT8103TypeCPhy 1

com.apple.driver.AppleMCA2-T8103       600.95

com.apple.driver.AppleEmbeddedAudioLibs        100.9.1

com.apple.driver.AppleSPMI       1.0.1

com.apple.iokit.IOMobileGraphicsFamily-DCP     343.0.0

com.apple.driver.AppleDCP         1

com.apple.driver.AppleFirmwareKit         1

com.apple.driver.AppleFirmwareUpdateKext       1

com.apple.iokit.IOMobileGraphicsFamily               343.0.0

com.apple.driver.AppleSART       1

com.apple.driver.ApplePMGR     1

com.apple.driver.AppleARMWatchdogTimer        1

com.apple.driver.usb.AppleUSBHostPacketFilter 1.0

com.apple.driver.AppleDisplayCrossbar  1.0.0

com.apple.driver.AppleTypeCPhy              1

com.apple.driver.AppleThunderboltNHI 7.2.8

com.apple.driver.AppleT8103PCIeC          1

com.apple.iokit.IOThunderboltFamily      9.3.2

com.apple.driver.ApplePIODMA 1

com.apple.driver.AppleT8103PCIe            1

com.apple.driver.AppleMultiFunctionManager   1

com.apple.driver.AppleBluetoothDebugService  1

com.apple.driver.AppleBCMWLANCore  1.0.0

com.apple.iokit.IO80211Family  1200.12.2b1

com.apple.driver.IOImageLoader              1.0.0

com.apple.driver.AppleOLYHAL  1

com.apple.driver.corecapture     1.0.4

com.apple.driver.AppleEmbeddedPCIE   1

com.apple.iokit.IODisplayPortFamily        1.0.0

com.apple.driver.AppleGPIOICController               1.0.2

com.apple.driver.AppleFireStormErrorHandler    1

com.apple.driver.AppleMobileApNonce 1

com.apple.iokit.IOTimeSyncFamily            1000.11

com.apple.driver.DiskImages      493.0.0

com.apple.iokit.IOGraphicsFamily             593

com.apple.iokit.IOBluetoothSerialManager           9.0.0

com.apple.iokit.IOBluetoothHostControllerUSBTransport               9.0.0

com.apple.iokit.IOBluetoothHostControllerUARTTransport            9.0.0

com.apple.iokit.IOBluetoothHostControllerTransport       9.0.0

com.apple.driver.IOBluetoothHostControllerPCIeTransport           9.0.0

com.apple.iokit.IOBluetoothFamily           9.0.0

com.apple.driver.FairPlayIOKit   68.13.0

com.apple.iokit.CoreAnalyticsFamily        1

com.apple.iokit.CSRBluetoothHostControllerUSBTransport            9.0.0

com.apple.iokit.BroadcomBluetoothHostControllerUSBTransport               9.0.0

com.apple.driver.AppleSSE          1.0

com.apple.driver.AppleSEPKeyStore        2

com.apple.driver.AppleUSBTDM                532.40.7

com.apple.iokit.IOUSBMassStorageDriver              209.40.6

com.apple.iokit.IOPCIFamily        2.9

com.apple.iokit.IOSCSIBlockCommandsDevice     452.30.4

com.apple.iokit.IOSCSIArchitectureModelFamily 452.30.4

com.apple.driver.AppleIPAppender          1.0

com.apple.driver.AppleFDEKeyStore        28.30

com.apple.driver.AppleEffaceableStorage             1.0

com.apple.driver.AppleCredentialManager           1.0

com.apple.driver.KernelRelayHost            1

com.apple.iokit.IOUSBHostFamily             1.2

com.apple.driver.AppleUSBHostMergeProperties              1.2

com.apple.driver.usb.AppleUSBCommon               1.0

com.apple.driver.AppleSMC        3.1.9

com.apple.driver.RTBuddy           1.0.0

com.apple.driver.AppleEmbeddedTempSensor   1.0.0

com.apple.driver.AppleARMPMU              1.0

com.apple.iokit.IOAccessoryManager      1.0.0

com.apple.driver.AppleOnboardSerial     1.0

com.apple.iokit.IOSkywalkFamily               1.0

com.apple.driver.mDNSOffloadUserClient             1.0.1b8

com.apple.iokit.IONetworkingFamily       3.4

com.apple.iokit.IOSerialFamily   11

com.apple.driver.AppleSEPManager        1.0.1

com.apple.driver.AppleA7IOP     1.0.2

com.apple.driver.IOSlaveProcessor           1

com.apple.driver.AppleBiometricSensor 2

com.apple.iokit.IOHIDFamily       2.0.0

com.apple.AUC 1.0

com.apple.iokit.IOAVFamily         1.0.0

com.apple.iokit.IOHDCPFamily   1.0.0

com.apple.iokit.IOCECFamily       1

com.apple.iokit.IOAudio2Family 1.0

com.apple.driver.AppleIISController         100.1

com.apple.driver.AppleAudioClockLibs   100.9.1

com.apple.driver.AppleM2ScalerCSCDriver           265.0.0

com.apple.iokit.IOSurface             302.9

com.apple.driver.IODARTFamily 1

com.apple.security.quarantine   4

com.apple.security.sandbox        300.0

com.apple.kext.AppleMatch        1.0.0d1

com.apple.driver.AppleMobileFileIntegrity           1.0.5

com.apple.security.AppleImage4               4.1.0

com.apple.kext.CoreTrust             1

com.apple.iokit.IOCryptoAcceleratorFamily          1.0.1

com.apple.driver.AppleARMPlatform      1.0.2

com.apple.iokit.IOStorageFamily               2.1

com.apple.iokit.IOSlowAdaptiveClockingFamily   1.0.0

com.apple.iokit.IOReportFamily 47

com.apple.kec.pthread  1

com.apple.kec.Libm        1

com.apple.kec.corecrypto            12.0

 

@kazanjia

As an FYI: when you see dart-apciec0 in the beginning of the panic log, this indicates the Thunderbolt bus is crashing.

There are two short term things you can try, your crash is somewhat different that others we have seen, which are more or less instant, not delayed by hours. So something else may be triggering this issue.

(We are working with Apple engineering on these crashes and also have a beta which partially addresses this issue)

Can you try these:

remove one drive from each enclosure. Does it still crash?

If you run the current beta SoftRAID version, does it still crash?

http://www.softraid.com/sr_beta

(best is uninstall SoftRAID driver, then install the beta)

Third, if you can, change the RAID levels to RAID 4. Does it still crash?

 

thanks

I have kernel panic attaching a Raid5 array(4M2) to a M1 MacBook Pro which works OK with a i9 iMac and 6.3.1 beta3.

Raid 0 array previously worked OK.