Problems with PCIe Gen4 on the x8 slot!

angel · April 7, 2025, 1:21am

Hi, I’m having trouble trying to use my pcie4.0 graphics cards on the x8 slot. I’ve had success with multiple gen3.0 GPUs, namely my GTX1070 and 1660super work great with nouveau and nvidia proprietary/open drivers. But trying my RTX 4070 and 4060 (which would be perfect for 4.0x8), they don’t get detected by either driver, and don’t even show up in lspci?

Monitoring the UART2 during POST, you can see Root Port 0 Link up fail logged between E2C1 PcieInitDxeStart and E300 PcieInitDxeEnd. I’ve attached the UART2 logs for different devices below, but that’s really the only difference in the logs between the two GTX cards and the RTX cards.

Granted this might not be specifically a Gen3.0 vs 4.0 thing, since my 4.0 m.2 nvme’s work completely fine.

Has anyone tried using pcie4.0 devices on the large x16 slot? e.g. RX 5000+ series, RTX 3000+ series, gen4 M.2 to PCIe adapter, etc.
Is there any way to force the PCIe generation to 3.0 in the BIOS?
How can I further debug the board’s PCIe init? Should I be looking at a different UART? Can I flash a debug firmware or something?

Seriously, I’d love to hear any ideas or suggestions anyone has. This week I have plenty of free time to experiment with this.

cc @RadxaYuntian @RadxaNaoki @jack @Stephen does radxa have any suggestions?

angel · April 7, 2025, 1:26am

Here are the four UART2 logs: uart2logs.zip (9.6 KB)

PS: I just recalled @Bryan_F’s post using a RX 7600, so it would seem that some Gen4 cards are detected properly?

RadxaYuntian · April 7, 2025, 3:11am

I remember people having issues with PCIe 4.0 GPUs. You can try using setpci to force lower PCIe generations.

arolath · April 7, 2025, 9:49pm

tried a 7600xt and got nothing but a black screen. on an older gen3 rx480 works fine though. i only have one other gen4 card but it won’t fit in the case my orion is in so probably won’t test it.

willy · April 8, 2025, 3:30am

I’ve got an intel 100Gbps NIC to work fine on PCIe 4.0 x8, so it could be an issue specific to GPUs only. I don’t see why a GPU would need anything special though.

ShivanSpS · April 8, 2025, 11:05am

That is why i suggested to bridge the presence pin on the slot.

Thats a x1 slot but it is on the same place on the x16 one

ShivanSpS · April 12, 2025, 12:58am

Everyone who had problems should try the new bios, my RTX3060 now shows up in lspci.

angel · April 13, 2025, 1:03pm

Unfortunately, not for me, even on new bios I still get Root Port 0: Link Up Fail during PcieInitDxeStart with my 4060.

UART2 log

NOTICE:  BL2: v2.7(debug):Beta_2.0.3_release
NOTICE:  BL2: Built : 21:22:18, Mar 11 2025
CRYPTO_LITE  TOP_STAT_CFG0_STAT:0x70018c63
CRYPTO_LITE  Wait SW initialization done!
CRYPTO_LITE  Software initialization done!
CRYPTO_LITE  Current host ID: 1
CRYPTO_LITE      RN_POOL is: Secure
CRYPTO_LITE      ACA is: Secure
CRYPTO_LITE      HASH is: Secure
CRYPTO_LITE      SCA is: Secure
CRYPTO_LITE      ACA SRAM size:          8192 Bytes
CRYPTO_LITE      ACA CQ depth:           8
CRYPTO_LITE      HASH CQ depth:          8
CRYPTO_LITE      SCA CQ depth:           8
CRYPTO_LITE      HASH long ctx number:   4
CRYPTO_LITE      HASH short ctx number:  4
CRYPTO_LITE      SCA long ctx number:   4
CRYPTO_LITE      SCA short ctx number:  4
CRYPTO_LITE      OTP device initial value:  1
CRYPTO_LITE      OTP shadow registers save to AO
CRYPTO_LITE      OTP device: NOT exist
CRYPTO_LITE      TRNG internal source: Exist
CRYPTO_LITE  CE Version: EAC REL r3p1
INFO:    Using crypto library 'CIX SEC'
INFO:    BL2: Doing platform setup
INFO:    Configuring TrustZone Controller
INFO:    Total 2 regions set.
INFO:    Configuring TrustZone Controller
INFO:    Total 2 regions set.
INFO:    Configuring TrustZone Controller
INFO:    Total 2 regions set.
INFO:    Configuring TrustZone Controller
INFO:    Total 2 regions set.
INFO:    BL2: Loading image id 3
INFO:    Loading image id=7 at address 0x80200000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=7 loaded: 0x80200000 - 0x80200650
INFO:    SE lc: 7, sec: 1, img_id: 7
INFO:    copy ROTPK from DDR
INFO:    copy done
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    md_alg: 6
INFO:    hash_len: 32
INFO:    Loading image id=9 at address 0x80200000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=9 loaded: 0x80200000 - 0x8020065a
INFO:    SE lc: 7, sec: 1, img_id: 9
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    Loading image id=13 at address 0x80200000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=13 loaded: 0x80200000 - 0x80200530
INFO:    SE lc: 7, sec: 1, img_id: 13
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    Loading image id=3 at address 0x80200000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=3 loaded: 0x80200000 - 0x8021963d
INFO:    SE lc: 7, sec: 1, img_id: 3
INFO:    BL2: Loading image id 4
INFO:    Loading image id=10 at address 0x80500000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=10 loaded: 0x80500000 - 0x80500668
INFO:    SE lc: 7, sec: 1, img_id: 10
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    Loading image id=14 at address 0x80500000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=14 loaded: 0x80500000 - 0x805005ce
INFO:    SE lc: 7, sec: 1, img_id: 14
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    Loading image id=4 at address 0x80500000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=4 loaded: 0x80500000 - 0x80676aa8
INFO:    SE lc: 7, sec: 1, img_id: 4
INFO:    BL2: Loading image id 5
INFO:    Loading image id=36 at address 0x84400000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=36 loaded: 0x84400000 - 0x8440063a
INFO:    SE lc: 7, sec: 1, img_id: 36
INFO:    copy ROTPK from DDR
INFO:    copy done
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    md_alg: 6
INFO:    hash_len: 32
INFO:    Loading image id=11 at address 0x84400000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=11 loaded: 0x84400000 - 0x8440066b
INFO:    SE lc: 7, sec: 1, img_id: 11
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    Loading image id=15 at address 0x84400000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=15 loaded: 0x84400000 - 0x84400541
INFO:    SE lc: 7, sec: 1, img_id: 15
INFO:    rsa len: 384
padding_type:3
rsa bits:5
CRYPTO_LITE  RSA verify pass, pkcs2v1
INFO:    Loading image id=5 at address 0x84400000
INFO:    pb.tfabde:0
INFO:    Flash load BL3X!
INFO:    Image id=5 loaded: 0x84400000 - 0x84600000
INFO:    SE lc: 7, sec: 1, img_id: 5
NOTICE:  BL2: Booting BL31
INFO:    Entry point address = 0x80200000
INFO:    SPSR = 0x3cd
INFO:    Start sky1 scmi server!
NOTICE:  BL31: v2.7(debug):Beta_2.0.7_release
NOTICE:  BL31: Built : 14:01:29, Mar 19 2025
INFO:    boot_core_index 10 
INFO:    cpu mask 0xa000
INFO:    GICv4 without legacy support detected.
INFO:    ARM GICv4 driver initialized in EL3
INFO:    Maximum SPI INTID supported: 543
INFO:    drv_mbox_init
INFO:    Send CMD: ECHO Request
NOTICE:  Send CMD: 0x82000001
INFO:    Got Echo RSP, Mbox channel is ready...
INFO:    plat_cix_scmi_setup
INFO:    SCMI driver initialized
INFO:    ###########ni700-qos setting###########################
INFO:    [MMHUB_CSI_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_CSI_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_CSI_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_CSI_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU0_AFBC_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU0_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU0_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU1_AFBC_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU1_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU1_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU2_AFBC_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU2_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU2_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU3_AFBC_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU3_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU3_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU4_AFBC_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU4_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_DPU4_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_ISP_AFBC_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_ISP_SLV0]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_ISP_SLV1]:override--1 read_qos--0f write_qos--0f 
INFO:    [MMHUB_NPU_SLV0]:override--1 read_qos--0d write_qos--0d 
INFO:    [MMHUB_NPU_SLV1]:override--1 read_qos--0d write_qos--0d 
INFO:    [MMHUB_VPU_SLV0]:override--1 read_qos--0d write_qos--0d 
INFO:    [MMHUB_VPU_SLV1]:override--1 read_qos--0d write_qos--0d 
INFO:    [SYSHUB_AUIDO_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [SYSHUB_USB2_0_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USB2_1_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USB2_2_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USB2_3_SLV]:override--1 read_qos--0f write_qos--0f 
INFO:    [SYSHUB_USB3_0_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USB3_1_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USBC_0_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USBC_1_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USBC_2_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    [SYSHUB_USBC_DRD_SLV]:override--1 read_qos--08 write_qos--08 
INFO:    ######################################################
INFO:    ###########ci700-qos setting###########################
INFO:    [CI700_RNF0]:override--1 read_qos--0d write_qos--0d 
INFO:    [CI700_RNF1]:override--1 read_qos--0d write_qos--0d 
INFO:    [CI700_RNF2]:override--1 read_qos--0d write_qos--0d 
INFO:    [CI700_RNF3]:override--1 read_qos--0d write_qos--0d 
INFO:    [CI700_GPU_RNI64_S0]:override[r-w]--[1-1] read_qos--0b write_qos--0b 
INFO:    [CI700_GPU_RNI64_S1]:override[r-w]--[1-1] read_qos--0b write_qos--0b 
INFO:    [CI700_GPU_RNI72_S0]:override[r-w]--[1-1] read_qos--0b write_qos--0b 
INFO:    [CI700_GPU_RNI72_S1]:override[r-w]--[1-1] read_qos--0b write_qos--0b 
INFO:    [CI700_PCIE]:override[r-w]--[1-1] read_qos--08 write_qos--08 
INFO:    [CI700_SYSHUB_SMMU]:override[r-w]--[1-1] read_qos--0f write_qos--0f 
INFO:    [CI700_DFD_TMC]:override[r-w]--[1-1] read_qos--0f write_qos--0f 
INFO:    [CI700_MMHUB_SMMU]:override[r-w]--[1-1] read_qos--0f write_qos--0f 
INFO:    [CI700_PCIEHUB_SMMU]:override[r-w]--[1-1] read_qos--0f write_qos--0f 
INFO:    ######################################################
INFO:    cold boot not backup laststack
INFO:    cix_qspi_init start...
INFO:    cix_qspi_init end...
INFO:    BL31: Initialising Exception Handling Framework
INFO:    BL31: Initializing runtime services
INFO:    last reboot reason:0x0 
INFO:    BL31: cortex_hunter: CPU workaround for cve_2022_23960 was applied
INFO:    SDEI platform setup
INFO:    BL31: Initializing BL32
E/TC:10    console_init:110 Cix uart register successful
E/TC:10    console_init:110 Cix uart register successful
I/TC: 
I/TC: OP-TEE version: Beta_2.0.7_release #1 Wed, 19 Mar 2025 14:01:27 +0800 aarch64
I/TC: OP-TEE cix version: Beta_2.0.7_release-3.17-4cfe2cd3de07
I/TC: WARNING: This OP-TEE configuration might be insecure!
I/TC: WARNING: Please check https://optee.readthedocs.io/en/latest/architecture/porting_guidelines.html
I/TC: Primary CPU initializing
MBEDTLS_CORE  host[1] waits sw_init_done...MBEDTLS_CORE  [DONE]
MBEDTLS_CORE   HASH driver init success!
MBEDTLS_CORE   SCA driver init success!
MBEDTLS_CORE  SRAM Pool Base: 0x80000000, size: 0x2000, alignment: 0x10
MBEDTLS_CORE   ACA driver init success!
E/TC:10 00 cix_get_key_info:121 Get device key:
I/TC: Primary CPU switching to normal world boot
INFO:    BL31: Preparing for EL3 exit to normal world
INFO:    Entry point address = 0x84400000
INFO:    SPSR = 0x3c9
[01.401] [UEFI] E006 PrePiStart
Cix UEFI firmware (version 9.0.0 built at 17:16:49 on Apr  7 2025)
[01.532] [UEFI] E007 PrePiEnd
[01.772] [UEFI] E3C1 XspiInitDxeStart
[01.773] [UEFI] E400 XspiInitDxeEnd
[01.777] [UEFI] E119 PlatformConfigParamsManageDxeStart
[01.787] [UEFI] E11A PlatformConfigParamsManageDxeEnd
[01.789] [UEFI] E117 ConfigParamsManageDxeStart
[01.793] [UEFI] E118 ConfigParamsManageDxeEnd
[01.798] [UEFI] E115 PlatformDxeStart
Farm Function Disable.
[FarmFunctionControl] [641]Get Farm Enable Flag Variable StatusNot Found.
[01.856] [UEFI] E116 PlatformDxeEnd
[01.862] [UEFI] E2C1 PcieInitDxeStart
Root Port 0: Enable
Root Port 0: Link Up Fail
Root Port 1: Enable
Root Port 1: Link Up Success
Root Port 2: Enable
Root Port 2: Link Up Success
Root Port 3: Enable
Root Port 3: Link Up Success
Root Port 4: Enable
Root Port 4: Link Up Success
[02.096] [UEFI] E300 PcieInitDxeEnd
[02.101] [UEFI] E201 I2cInitDxeStart
[02.104] [UEFI] E240 I2cInitDxeEnd
[02.105] [UEFI] E241 SpiInitDxeStart
[02.109] [UEFI] E280 SpiInitDxeEnd
[02.120] [UEFI] E6C1 PdDxeStart
Update Pd Device 0 state, Mode: TYPEC_STATE_DISCONNECT, Orientation: TYPEC_ORIENTATION_NONE
Update Pd Device 1 state, Mode: TYPEC_DP_STATE_E, Orientation: TYPEC_ORIENTATION_NORMAL
Update Pd Device 2 state, Mode: TYPEC_STATE_DISCONNECT, Orientation: TYPEC_ORIENTATION_NONE
Update Pd Device 3 state, Mode: TYPEC_DP_STATE_E, Orientation: TYPEC_ORIENTATION_NORMAL
[02.151] [UEFI] E700 PdDxeEnd
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
NOTICE:  Send CMD: 0x82000002
------Begin firmware version dump------
 SE:beta2.0-958a7bfced44
 PM:00.10.002-ab61f5573749
 PBL:v2.7-39211b3b31af
 ATF:v2.7-a12404c66371
 TEE:Beta_2.0.7_release-3.17-4cfe2cd3de07
 UEFI:9.0.0
 EC:V1.07-f4c3ada6e90d
 Board Id:4(PHECDA-Rev A)
 PD:0.0 1.0
 PMIC: 0x00 0x00 0x00 
------End firmware version dump------
E/TC:?? 00 cix_get_key_info:121 Get device key:
One display device is found on typec port1!
Update Platform Config Param GopDisplayPort=0x1
total 4 modes (current pixel clock 14850, width 1920, height 1080)
[02.699] [UEFI] E1FF DxeMainEnd

angel · April 13, 2025, 1:09pm

Did manage to find out that the DT debian image does seem to report “Link Up” in dmesg and detect the card in lspci, but it’s in some weird limbo state where trying to activate the driver gives a NVRM: objClInitPcieChipset: *** Chipset Setup Function Error!, NVRM: clCheckUpstreamLtrSupport_IMPL: PCIE config space is inaccessible!, NVRM: GPU 0002:c1:00.0: RmInitAdapter failed! (0x62:0x0:1929), *ERROR* [nvidia-drm] [GPU ID 0x0001c100] Failed to allocate NvKmsKapiDevice among other errors. Note that NVreg_OpenRmEnableUnsupportedGpus=1 in kernel cmdline. Trying a hot reset (link retrain) was very weird:

Uhh wtf

<this is just me removing the device and rescanning the bus etc>
[ 1171.287222] [2025:04:08 18:11:52][pid:32007,cpu8,tee]pci 0001:c1:00.0: [10de:2882] type 00 class 0x030000
[ 1171.287256] [pid:32007,cpu8,tee]pci 0001:c1:00.0: reg 0x10: [mem 0x61000000-0x61ffffff]
[ 1171.287276] [pid:32007,cpu8,tee]pci 0001:c1:00.0: reg 0x14: [mem 0x1800000000-0x180fffffff 64bit pref]
[ 1171.287296] [pid:32007,cpu8,tee]pci 0001:c1:00.0: reg 0x1c: [mem 0x1810000000-0x1811ffffff 64bit pref]
[ 1171.287309] [pid:32007,cpu8,tee]pci 0001:c1:00.0: reg 0x24: [io  0x100000-0x10007f]
[ 1171.287323] [pid:32007,cpu8,tee]pci 0001:c1:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[ 1171.287454] [pid:32007,cpu8,tee]pci 0001:c1:00.0: PME# supported from D0 D3hot
[ 1171.287562] [pid:32007,cpu8,tee]pci 0001:c1:00.0: 16.000 Gb/s available PCIe bandwidth, limited by 2.5 GT/s PCIe x8 link at 0001:c0:00.0 (capable of 126.024 Gb/s with 16.0 GT/s PCIe x8 link)
[ 1171.287763] [pid:32007,cpu8,tee]pci 0001:c1:00.0: vgaarb: setting as boot VGA device
[ 1171.287766] [pid:32007,cpu8,tee]pci 0001:c1:00.0: vgaarb: bridge control possible
[ 1171.287768] [pid:32007,cpu8,tee]pci 0001:c1:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[ 1171.287848] [pid:32007,cpu8,tee]pci 0001:c1:00.1: [10de:22be] type 00 class 0x040300
[ 1171.287866] [pid:32007,cpu8,tee]pci 0001:c1:00.1: reg 0x10: [mem 0x60880000-0x60883fff]
[ 1171.300979] [pid:32007,cpu8,tee]pci 0001:c1:00.0: BAR 1: assigned [mem 0x1800000000-0x180fffffff 64bit pref]
[ 1171.300991] [pid:32007,cpu8,tee]pci 0001:c1:00.0: BAR 3: assigned [mem 0x1810000000-0x1811ffffff 64bit pref]
[ 1171.300997] [pid:32007,cpu8,tee]pci 0001:c1:00.0: BAR 0: assigned [mem 0x61000000-0x61ffffff]
[ 1171.301001] [pid:32007,cpu8,tee]pci 0001:c1:00.0: BAR 6: assigned [mem 0x60800000-0x6087ffff pref]
[ 1171.301004] [pid:32007,cpu8,tee]pci 0001:c1:00.1: BAR 0: assigned [mem 0x60880000-0x60883fff]
[ 1171.301008] [pid:32007,cpu8,tee]pci 0001:c1:00.0: BAR 5: assigned [io  0x100000-0x10007f]
[ 1171.301088] [pid:32007,cpu8,tee]pci 0001:c1:00.1: extending delay after power-on from D3hot to 20 msec
[ 1171.301151] [pid:32007,cpu8,tee]pci 0001:c1:00.1: D0 power state depends on 0001:c1:00.0
[ 1171.335209] [pid:32012,cpu9,modprobe]nvidia-nvlink: Nvlink Core is being initialized, major device number 506
[ 1171.335229] [pid:32012,cpu9,modprobe]NVRM: CPUID: unknown implementer/part 0x41/0xd81.
[ 1171.335601] [pid:32012,cpu9,modprobe]The NVIDIA GPU driver for AArch64 has not been qualified on this CPU
               and therefore it is not recommended or intended for use in any production
               environment.
[ 1171.337222] [pid:32012,cpu7,modprobe]nvidia 0001:c1:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
[ 1171.380528] [pid:32012,cpu7,modprobe]NVRM: loading NVIDIA UNIX Open Kernel Module for aarch64  535.216.01  Release Build  (buildd@debian)  Wed Nov 20 09:22:33 UTC 2024
[ 1238.452866] [2025:04:08 18:13:00][pid:33816,cpu8,modprobe]nvidia-modeset: Loading NVIDIA UNIX Open Kernel Mode Setting Driver for aarch64  535.216.01  Release Build  (buildd@debian)  Wed Nov 20 09:22:33 UTC 2024
[ 1238.473584] [pid:33814,cpu11,modprobe][drm] [nvidia-drm] [GPU ID 0x0001c100] Loading driver
[ 1238.495638] [pid:33814,cpu11,modprobe]NVRM: objClInitPcieChipset: *** Chipset Setup Function Error!
[ 1238.495652] [pid:33814,cpu11,modprobe]NVRM: Chipset not recognized (vendor ID 0x1f6c, device ID 0x0001)
[ 1238.495656] [pid:33814,cpu11,modprobe]The NVIDIA GPU driver for AArch64 has not been qualified on this platform
               and therefore it is not recommended or intended for use in any production
               environment.
[ 1238.495673] [pid:33814,cpu11,modprobe]NVRM: clCheckUpstreamLtrSupport_IMPL: PCIE config space is inaccessible!
[ 1239.491965] [2025:04:08 18:13:01][pid:33814,cpu11,modprobe]NVRM: clCheckUpstreamLtrSupport_IMPL: PCIE config space is inaccessible!
[ 1239.607068] [pid:33814,cpu11,modprobe]NVRM: Open nvidia.ko is only ready for use on Data Center GPUs.
[ 1239.607077] [pid:33814,cpu11,modprobe]NVRM: To force use of Open nvidia.ko on other GPUs, see the
[ 1239.607079] [pid:33814,cpu11,modprobe]NVRM: 'OpenRmEnableUnsupportedGpus' kernel module parameter described
[ 1239.607081] [pid:33814,cpu11,modprobe]NVRM: in the README.
[ 1239.773132] [pid:33814,cpu11,modprobe]NVRM: GPU 0001:c1:00.0: RmInitAdapter failed! (0x62:0x0:1929)
[ 1239.773936] [pid:33814,cpu11,modprobe]NVRM: GPU 0001:c1:00.0: rm_init_adapter failed, device minor number 0
[ 1239.774415] [pid:33814,cpu11,modprobe][drm:nv_drm_load [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x0001c100] Failed to allocate NvKmsKapiDevice
[ 1239.774702] [pid:33814,cpu11,modprobe][drm:nv_drm_probe_devices [nvidia_drm]] *ERROR* [nvidia-drm] [GPU ID 0x0001c100] Failed to register device
[ 1239.774728] [pid:33814,cpu11,modprobe]do_boottime_initcall, initcall nv_linux_drm_init+0x0/0x1000 [nvidia_drm] returned 0 after 1301523 usecs
<runs sudo ./pcie_hot_reset.sh 0001:c1:00.0, chaos ensues>
[ 1940.538725] [2025:04:08 18:24:42][pid:0,cpu0,in irq]sky1-pcie a010000.pcie: line = 438 sta = 0x80000000 
[ 1940.538738] [pid:0,cpu0,in irq]sky1-pcie a010000.pcie: local err0 int: LTSSTTRAN happend
[ 1940.538741] [pid:0,cpu0,in irq]sky1-pcie a010000.pcie: AXI_SLAVE_CTRL = 0x00000001
[ 1940.538743] [pid:0,cpu0,in irq]sky1-pcie a010000.pcie: AXI_SLAVE_CTRL = 0x00000000
[ 1940.538745] [pid:0,cpu0,in irq]sky1-pcie a010000.pcie: LTSSM_TRANS_DEBUG_CTRL_STATUS = 0xff000040
[ 1940.538747] [pid:0,cpu0,in irq]sky1-pcie a010000.pcie: ltssttran changed: HOT_RESET -> HOT_RESET_1
[ 1940.538749] [pid:0,cpu0,in irq]sky1-pcie a010000.pcie: line = 452 sta = 0x00000000 
[ 1962.062955] [2025:04:08 18:25:03][pid:0,cpu5,in irq]rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 1962.062966] [pid:0,cpu5,in irq]rcu: 	6-...!: (0 ticks this GP) idle=485c/1/0x4000000000000000 softirq=47969/47969 fqs=338
[ 1962.062971] [pid:0,cpu5,in irq]	(detected by 5, t=5255 jiffies, g=148585, q=78 ncpus=12)
[ 1962.062975] [pid:0,cpu5,in irq]Sending NMI from CPU 5 to CPUs 6:
[ 1972.064180] [pid:0,cpu5,in irq]rcu: rcu_preempt kthread starved for 4579 jiffies! g148585 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x0 ->cpu=10
[ 1972.064184] [pid:0,cpu5,in irq]rcu: 	Unless rcu_preempt kthread gets sufficient CPU time, OOM is now expected behavior.
[ 1972.064186] [pid:0,cpu5,in irq]rcu: RCU grace-period kthread stack dump:
[ 1972.064188] [pid:0,cpu5,in irq]task:rcu_preempt     state:R  running task     stack:0     pid:14    ppid:2      flags:0x00000008
[ 1972.064193] [pid:0,cpu5,in irq]Call trace:
[ 1972.064195] [pid:0,cpu5,in irq] __switch_to+0xdc/0x150
[ 1972.064214] [pid:0,cpu5,in irq] __schedule+0x2dc/0x7d0
[ 1972.064217] [pid:0,cpu5,in irq] schedule+0x5c/0x100
[ 1972.064220] [pid:0,cpu5,in irq] schedule_timeout+0x8c/0x100
[ 1972.064227] [pid:0,cpu5,in irq] rcu_gp_fqs_loop+0x140/0x420
[ 1972.064243] [pid:0,cpu5,in irq] rcu_gp_kthread+0x134/0x164
[ 1972.064250] [pid:0,cpu5,in irq] kthread+0x108/0x10c
[ 1972.064255] [pid:0,cpu5,in irq] ret_from_fork+0x10/0x20
[ 1972.064262] [pid:0,cpu5,in irq]rcu: Stack dump where RCU GP kthread last ran:
[ 1972.064263] [pid:0,cpu5,in irq]Sending NMI from CPU 5 to CPUs 10:
[ 2004.066554] [2025:04:08 18:25:45][pid:325,cpu11,in irq]watchdog: BUG: soft lockup - CPU#11 stuck for 21s! [systemd-journal:325]
[ 2004.066561] [pid:325,cpu11,in irq]Modules linked in: nvidia_drm(O) nvidia_modeset(O) nvidia(O) qrtr xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 uhid 8021q garp mrp stp llc rtk_btusb snd_soc_hdmi_codec btusb btrtl btintel r8126 mali_kbase(O) protected_memory_allocator(O) snd_hda_codec_realtek clk_sky1_audss crct10dif_ce sm3_ce amvx(O) snd_soc_hda sm3 snd_hda_ext_core sha3_ce reset_sky1_audss cros_ec_chardev goodix_ts arm_dma350 aipu(O) sha3_generic rtc_hym8563 cix_dsp_rproc snd_soc_cdns_i2s_mc memory_group_manager(O) trilin_dpsub snd_hda_core sha512_ce sha512_arm64 linlon_dp rfkill_bt pwm_bl armcb_isp snd_soc_sky1_sound_card drm_display_helper binfmt_misc video nf_tables libcrc32c nfnetlink fuse dm_mod ip_tables x_tables ipv6 [last unloaded: nvidia(O)]
[ 2004.066623] [pid:325,cpu11,in irq]CPU: 11 PID: 325 Comm: systemd-journal Tainted: G S         O       6.1.44-cix-build-generic #2
[ 2004.066626] [pid:325,cpu11,in irq]Hardware name: Radxa Computer (Shenzhen) Co., Ltd. Radxa Orion O6/Radxa Orion O6, BIOS 1.0 Jan  1 1980
[ 2004.066627] [pid:325,cpu11,in irq]pstate: 02400009 (nzcv daif +PAN -UAO +TCO -DIT -SSBS BTYPE=--)
[ 2004.066630] [pid:325,cpu11,in irq]pc : queued_spin_lock_slowpath+0x54/0x370
[ 2004.066641] [pid:325,cpu11,in irq]lr : _raw_spin_lock+0x70/0x80
[ 2004.066643] [pid:325,cpu11,in irq]sp : ffff80000ad93c10
[ 2004.066644] [pid:325,cpu11,in irq]x29: ffff80000ad93c10 x28: fffffc00025026c0 x27: ffff000091d1fd80
[ 2004.066647] [pid:325,cpu11,in irq]x26: ffff00008fc602a0 x25: 0000000000000000 x24: 0000000000000000
[ 2004.066650] [pid:325,cpu11,in irq]x23: 0800000102183003 x22: 0000ffff915f0000 x21: ffff80000ad93d28
[ 2004.066653] [pid:325,cpu11,in irq]x20: 00000000000005ff x19: 00000000000005f0 x18: 0000000000000000
[ 2004.066656] [pid:325,cpu11,in irq]x17: 0000000000000000 x16: ffff800009486770 x15: 0000ffff923fffff
[ 2004.066659] [pid:325,cpu11,in irq]x14: 0000000000000000 x13: 1fffe00012ad82e1 x12: ffff80000ad93d38
[ 2004.066661] [pid:325,cpu11,in irq]x11: ffff0000956c1700 x10: ffff0000956c170c x9 : 00000000000005f0
[ 2004.066664] [pid:325,cpu11,in irq]x8 : 00000000000005ff x7 : ffff80000ad93c90 x6 : ffff00008f891ff0
[ 2004.066667] [pid:325,cpu11,in irq]x5 : ffff80000ad93c90 x4 : 0000000000000001 x3 : fffffc00020860e8
[ 2004.066670] [pid:325,cpu11,in irq]x2 : 0000000000000001 x1 : 0000000000000000 x0 : 0000000000000101
[ 2004.066672] [pid:325,cpu11,in irq]
               PC: 0xffff800009258914:
[ 2004.066674] [pid:325,cpu11,in irq]8894  d5184600 d5184600 d5384613 521b0a61 d5184601 d5384613 521b0a60 d5184600
[ 2004.066680] [pid:325,cpu11,in irq]88b4  00000000 00000000 00000000 aa0003e3 7104003f 540008e0 7103fc3f 54000408
[ 2004.066686] [pid:325,cpu11,in irq]88d4  d503201f 52802000 b8a03060 7103fc1f 54000308 35000160 52800020 79000060
[ 2004.066692] [pid:325,cpu11,in irq]88f4  d65f03c0 93407c00 d50320bf d503205f 885f7c61 4a000021 35000041 d503205f
[ 2004.066698] [pid:325,cpu11,in irq]8914  88dffc60 72001c1f 54fffee1 52800020 79000060 d65f03c0 f9800071 885ffc60
[ 2004.066703] [pid:325,cpu11,in irq]8934  32180001 88027c61 35ffffa2 17ffffe8 72181c1f 54001100 d503201f b0003d64
[ 2004.066709] [pid:325,cpu11,in irq]8954  912a0084 910003e1 aa0403e5 d53cd040 8b0000a5 d503233f f0003d00 91002000
[ 2004.066715] [pid:325,cpu11,in irq]8974  b9400ca6 110004c2 b9000ca2 d53cd041 b8616809 71000cdf 540006ac 937c7cc8
[ 2004.066721] [pid:325,cpu11,in irq]
               LR: 0xffff800009258100:
[ 2004.066722] [pid:325,cpu11,in irq]8080  d50323bf d65f03c0 d503201f d503201f d5384102 b9400841 aa0003e3 11000421
[ 2004.066727] [pid:325,cpu11,in irq]80a0  b9000841 d503201f 52800001 52800022 2a0103e4 88e47c02 2a0403e0 35000160
[ 2004.066733] [pid:325,cpu11,in irq]80c0  d65f03c0 d2800001 52800022 f9800071 885ffc60 4a010004 35000064 88047c62
[ 2004.066739] [pid:325,cpu11,in irq]80e0  35ffff84 34fffee0 d503233f a9bf7bfd 2a0003e1 910003fd aa0303e0 940001f1
[ 2004.066745] [pid:325,cpu11,in irq]8100  a8c17bfd d50323bf d65f03c0 d503201f d5384102 b9400841 aa0003e3 11080421
[ 2004.066751] [pid:325,cpu11,in irq]8120  b9000841 d503201f 52800001 52801fe2 2a0103e4 88e47c02 2a0403e0 35000160
[ 2004.066756] [pid:325,cpu11,in irq]8140  d65f03c0 d2800001 52801fe2 f9800071 885ffc60 4a010004 35000064 88047c62
[ 2004.066762] [pid:325,cpu11,in irq]8160  35ffff84 34fffee0 d503233f a9bf7bfd aa0303e0 910003fd 9400030a a8c17bfd
[ 2004.066768] [pid:325,cpu11,in irq]
               SP: 0xffff80000ad93c10:
[ 2004.066769] [pid:325,cpu11,in irq]3b90  8fc602a0 ffff0000 91d1fd80 ffff0000 025026c0 fffffc00 0ad93c10 ffff8000
[ 2004.066775] [pid:325,cpu11,in irq]3bb0  09258100 ffff8000 0ad93c10 ffff8000 09258914 ffff8000 02400009 00000000
[ 2004.066781] [pid:325,cpu11,in irq]3bd0  0ad93c20 ffff8000 083eacfc 3fbd8000 000005f0 00000000 000005ff 00000000
[ 2004.066787] [pid:325,cpu11,in irq]3bf0  0ad93c10 ffff8000 09258914 ffff8000 86379ff0 ffff0000 00000000 00000000
[ 2004.066793] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2004.066799] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2004.066805] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2004.066811] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2004.066817] [pid:325,cpu11,in irq]
               X3: 0xfffffc00020860e8:
[ 2004.066818] [pid:325,cpu11,in irq]6068  00000000 00000000 ffffffff 00000000 00000000 00000000 00000000 0bfffc00
[ 2004.066825] [pid:325,cpu11,in irq]6088  00000000 00000000 00000122 dead0000 00000000 00000000 00000000 00000000
[ 2004.066830] [pid:325,cpu11,in irq]60a8  00000000 00000000 ffffffff 00000001 00000000 00000000 00000000 0bfffc00
[ 2004.066836] [pid:325,cpu11,in irq]60c8  00000000 00000000 00000122 dead0000 00000000 00000000 00000000 00000000
[ 2004.066842] [pid:325,cpu11,in irq]60e8  00000101 00000000 fffffdff 00000001 86c24602 ffff0000 00002030 0bfffc00
[ 2004.066848] [pid:325,cpu11,in irq]6108  021a04c8 fffffc00 020e77c8 fffffc00 83c08b60 ffff0000 0000159e 00000000
[ 2004.066854] [pid:325,cpu11,in irq]6128  8fe62548 ffff0000 ffffffff 00000002 82917000 ffff0000 00000000 0bfffc00
[ 2004.066859] [pid:325,cpu11,in irq]6148  00000000 00000000 00000122 dead0000 00000000 00000000 00000000 00000000
[ 2004.066865] [pid:325,cpu11,in irq]
               X5: 0xffff80000ad93c90:
[ 2004.066866] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2004.066872] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2004.066878] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2004.066884] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2004.066889] [pid:325,cpu11,in irq]3c90  8fc602a8 ffff0000 000005f0 00000000 00300000 00000000 8f891ff0 ffff0000
[ 2004.066895] [pid:325,cpu11,in irq]3cb0  00000000 00000000 00000000 00000000 00000000 00000000 dcbb2e00 bc72e43a
[ 2004.066901] [pid:325,cpu11,in irq]3cd0  0ad93da0 ffff8000 0842792c 078c8000 00000254 00000000 91d1fd80 ffff0000
[ 2004.066907] [pid:325,cpu11,in irq]3cf0  915f4da8 0000ffff 0ad93eb0 ffff8000 00000040 00000000 92000007 00000000
[ 2004.066913] [pid:325,cpu11,in irq]
               X6: 0xffff00008f891ff0:
[ 2004.066914] [pid:325,cpu11,in irq]1f70  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.066920] [pid:325,cpu11,in irq]1f90  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.066926] [pid:325,cpu11,in irq]1fb0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.066931] [pid:325,cpu11,in irq]1fd0  00000000 00000000 00000000 00000000 00000000 00000000 8f893230 ffff0000
[ 2004.066937] [pid:325,cpu11,in irq]1ff0  00381700 00000000 8f8d8ff8 ffff0000 8fc602a8 ffff0000 8f892008 ffff0000
[ 2004.066943] [pid:325,cpu11,in irq]2010  8f892008 ffff0000 02a8e4c0 fffffc00 02b3f3c0 fffffc00 028ec580 fffffc00
[ 2004.066949] [pid:325,cpu11,in irq]2030  02ad9140 fffffc00 028788c0 fffffc00 02b3f6c0 fffffc00 028abf00 fffffc00
[ 2004.066954] [pid:325,cpu11,in irq]2050  024c9c00 fffffc00 02b49e80 fffffc00 02a83100 fffffc00 024c2440 fffffc00
[ 2004.066960] [pid:325,cpu11,in irq]
               X7: 0xffff80000ad93c90:
[ 2004.066961] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2004.066967] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2004.066973] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2004.066979] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2004.066984] [pid:325,cpu11,in irq]3c90  8fc602a8 ffff0000 000005f0 00000000 00300000 00000000 8f891ff0 ffff0000
[ 2004.066990] [pid:325,cpu11,in irq]3cb0  00000000 00000000 00000000 00000000 00000000 00000000 dcbb2e00 bc72e43a
[ 2004.066996] [pid:325,cpu11,in irq]3cd0  0ad93da0 ffff8000 0842792c 078c8000 00000254 00000000 91d1fd80 ffff0000
[ 2004.067002] [pid:325,cpu11,in irq]3cf0  915f4da8 0000ffff 0ad93eb0 ffff8000 00000040 00000000 92000007 00000000
[ 2004.067008] [pid:325,cpu11,in irq]
               X10: 0xffff0000956c170c:
[ 2004.067009] [pid:325,cpu11,in irq]168c  ffff0000 88b72e10 ffff0000 90d5dbd0 ffff0000 90d5dab0 ffff0000 90d5db40
[ 2004.067015] [pid:325,cpu11,in irq]16ac  ffff0000 90d5da20 ffff0000 88b726c0 ffff0000 00000000 00000000 88760cf0
[ 2004.067020] [pid:325,cpu11,in irq]16cc  ffff0000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.067026] [pid:325,cpu11,in irq]16ec  00000000 00000000 00000000 0000000a 00000000 956c1d06 ffff0000 de94ffff
[ 2004.067032] [pid:325,cpu11,in irq]170c  0000aaaa de974fff 0000aaaa de98dfff 0000aaaa de98ffff 0000aaaa de990fff
[ 2004.067038] [pid:325,cpu11,in irq]172c  0000aaaa 0b7a0fff 0000aaab 0b818fff 0000aaab 907effff 0000ffff 907fffff
[ 2004.067044] [pid:325,cpu11,in irq]174c  0000ffff 90ffffff 0000ffff 917fffff 0000ffff 91bfffff 0000ffff 923fffff
[ 2004.067050] [pid:325,cpu11,in irq]176c  0000ffff 00000000 00000000 00000000 00000000 00000000 00000000 8355bb40
[ 2004.067056] [pid:325,cpu11,in irq]
               X11: 0xffff0000956c1700:
[ 2004.067056] [pid:325,cpu11,in irq]1680  83bf5c60 ffff0000 86e757e0 ffff0000 88b72e10 ffff0000 90d5dbd0 ffff0000
[ 2004.067062] [pid:325,cpu11,in irq]16a0  90d5dab0 ffff0000 90d5db40 ffff0000 90d5da20 ffff0000 88b726c0 ffff0000
[ 2004.067068] [pid:325,cpu11,in irq]16c0  00000000 00000000 88760cf0 ffff0000 00000000 00000000 00000000 00000000
[ 2004.067074] [pid:325,cpu11,in irq]16e0  00000000 00000000 00000000 00000000 00000000 00000000 0000000a 00000000
[ 2004.067080] [pid:325,cpu11,in irq]1700  956c1d06 ffff0000 de94ffff 0000aaaa de974fff 0000aaaa de98dfff 0000aaaa
[ 2004.067086] [pid:325,cpu11,in irq]1720  de98ffff 0000aaaa de990fff 0000aaaa 0b7a0fff 0000aaab 0b818fff 0000aaab
[ 2004.067091] [pid:325,cpu11,in irq]1740  907effff 0000ffff 907fffff 0000ffff 90ffffff 0000ffff 917fffff 0000ffff
[ 2004.067097] [pid:325,cpu11,in irq]1760  91bfffff 0000ffff 923fffff 0000ffff 00000000 00000000 00000000 00000000
[ 2004.067103] [pid:325,cpu11,in irq]
               X12: 0xffff80000ad93d38:
[ 2004.067104] [pid:325,cpu11,in irq]3cb8  00000000 00000000 00000000 00000000 dcbb2e00 bc72e43a 0ad93da0 ffff8000
[ 2004.067110] [pid:325,cpu11,in irq]3cd8  0842792c 078c8000 00000254 00000000 91d1fd80 ffff0000 915f4da8 0000ffff
[ 2004.067115] [pid:325,cpu11,in irq]3cf8  0ad93eb0 ffff8000 00000040 00000000 92000007 00000000 84b28780 ffff0000
[ 2004.067121] [pid:325,cpu11,in irq]3d18  0ad93eb0 ffff8000 00000001 00000000 91d1fd80 ffff0000 00100cca 00000000
[ 2004.067127] [pid:325,cpu11,in irq]3d38  000005f4 00000000 915f4000 0000ffff 915f4da8 0000ffff 00000a54 00000000
[ 2004.067133] [pid:325,cpu11,in irq]3d58  85377450 ffff0000 86379ff0 ffff0000 00000000 00000000 00000000 00000000
[ 2004.067139] [pid:325,cpu11,in irq]3d78  00000000 00000000 00000000 00000000 020860e8 fffffc00 00000000 00000000
[ 2004.067145] [pid:325,cpu11,in irq]3d98  dcbb2e00 bc72e43a 0ad93de0 ffff8000 082245a4 b5ca8000 0ad93eb0 ffff8000
[ 2004.067151] [pid:325,cpu11,in irq]
               X16: 0xffff800009486770:
[ 2004.067152] [pid:325,cpu11,in irq]66f0  65766575 6d20746e 61737365 74206567 62206f6f 00006769 096ed610 ffff8000
[ 2004.067158] [pid:325,cpu11,in irq]6710  0977ac10 ffff8000 09834bf0 ffff8000 0973e010 ffff8000 0980fae8 ffff8000
[ 2004.067164] [pid:325,cpu11,in irq]6730  096dbcb8 ffff8000 096fc210 ffff8000 0977b508 ffff8000 6a626f6b 5f746365
[ 2004.067170] [pid:325,cpu11,in irq]6750  65766575 655f746e 0000766e 00000000 41444f4d 5341494c 0000003d 00000000
[ 2004.067175] [pid:325,cpu11,in irq]6770  090f0f00 00000000 0a10101f 00000000 0406060f 00000000 5f696d6e 6b636162
[ 2004.067181] [pid:325,cpu11,in irq]6790  63617274 61622e65 72746b63 5f656361 656c6469 00000000 00000049 00000000
[ 2004.067187] [pid:325,cpu11,in irq]67b0  00000000 00000000 00000000 00000000 008d0000 00880002 006e0074 00680000
[ 2004.067193] [pid:325,cpu11,in irq]67d0  000e0000 00bf0000 00080000 00c400a8 00000000 00020014 00570000 0000005d
[ 2004.067199] [pid:325,cpu11,in irq]
               X21: 0xffff80000ad93d28:
[ 2004.067200] [pid:325,cpu11,in irq]3ca8  8f891ff0 ffff0000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.067206] [pid:325,cpu11,in irq]3cc8  dcbb2e00 bc72e43a 0ad93da0 ffff8000 0842792c 078c8000 00000254 00000000
[ 2004.067212] [pid:325,cpu11,in irq]3ce8  91d1fd80 ffff0000 915f4da8 0000ffff 0ad93eb0 ffff8000 00000040 00000000
[ 2004.067218] [pid:325,cpu11,in irq]3d08  92000007 00000000 84b28780 ffff0000 0ad93eb0 ffff8000 00000001 00000000
[ 2004.067223] [pid:325,cpu11,in irq]3d28  91d1fd80 ffff0000 00100cca 00000000 000005f4 00000000 915f4000 0000ffff
[ 2004.067229] [pid:325,cpu11,in irq]3d48  915f4da8 0000ffff 00000a54 00000000 85377450 ffff0000 86379ff0 ffff0000
[ 2004.067235] [pid:325,cpu11,in irq]3d68  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.067241] [pid:325,cpu11,in irq]3d88  020860e8 fffffc00 00000000 00000000 dcbb2e00 bc72e43a 0ad93de0 ffff8000
[ 2004.067247] [pid:325,cpu11,in irq]
               X26: 0xffff00008fc602a0:
[ 2004.067248] [pid:325,cpu11,in irq]0220  861cbc00 ffff0000 00000016 0000ffff 8fc60230 ffff0000 8fc60230 ffff0000
[ 2004.067254] [pid:325,cpu11,in irq]0240  8fe1d4f0 ffff0000 8fc606d8 ffff0000 8fc60250 ffff0000 8fc60250 ffff0000
[ 2004.067259] [pid:325,cpu11,in irq]0260  8f8fc9b0 ffff0000 00000000 00000000 00000006 00000000 00000000 00000000
[ 2004.067265] [pid:325,cpu11,in irq]0280  00000001 00000000 00000001 00000000 092b3500 ffff8000 00000000 00000000
[ 2004.067271] [pid:325,cpu11,in irq]02a0  8fc60128 ffff0000 00000000 28000021 8f8d8ffa ffff0000 00000000 00000000
[ 2004.067277] [pid:325,cpu11,in irq]02c0  00000000 00000000 00000000 00000000 8fc602d0 ffff0000 8fc602d0 ffff0000
[ 2004.067283] [pid:325,cpu11,in irq]02e0  00100cca 00000002 91d1fe38 ffff0000 91d1fe38 ffff0000 00000200 00000000
[ 2004.067289] [pid:325,cpu11,in irq]0300  83620ec1 ffff0000 00000000 00000000 8fc60310 ffff0000 8fc60310 ffff0000
[ 2004.067295] [pid:325,cpu11,in irq]
               X27: 0xffff000091d1fd80:
[ 2004.067296] [pid:325,cpu11,in irq]fd00  8362f440 ffff0000 00000fc3 00600000 00100073 00000000 881944a9 ffff0000
[ 2004.067301] [pid:325,cpu11,in irq]fd20  00000000 00000000 00000000 00000000 00000090 00000000 8313ad90 ffff0000
[ 2004.067307] [pid:325,cpu11,in irq]fd40  8313a710 ffff0000 91d83680 ffff0000 092b3340 ffff8000 00000090 00000000
[ 2004.067313] [pid:325,cpu11,in irq]fd60  86fbab00 ffff0000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2004.067319] [pid:325,cpu11,in irq]fd80  91000000 0000ffff 91800000 0000ffff 84b28780 ffff0000 00000fc3 00600000
[ 2004.067325] [pid:325,cpu11,in irq]fda0  000000fb 00000000 91d1fe38 ffff0000 00000000 00000000 00000000 00000000
[ 2004.067331] [pid:325,cpu11,in irq]fdc0  000007ff 00000000 91d1fdc8 ffff0000 91d1fdc8 ffff0000 00000000 00000000
[ 2004.067336] [pid:325,cpu11,in irq]fde0  092b3340 ffff8000 00000000 00000000 86fc7500 ffff0000 00000000 00000000

angel · April 13, 2025, 1:10pm

Uhh wtf (cont'd)

[ 2004.067342] [pid:325,cpu11,in irq]
               X28: 0xfffffc00025026c0:
[ 2004.067343] [pid:325,cpu11,in irq]2640  00020814 0bfffc00 02502608 fffffc00 02502688 fffffc00 8c89c788 ffff0000
[ 2004.067350] [pid:325,cpu11,in irq]2660  00000077 00000000 00000000 00000000 0000000b 0000000d 842a5000 ffff0000
[ 2004.067356] [pid:325,cpu11,in irq]2680  00020814 0bfffc00 02502648 fffffc00 0250ed48 fffffc00 8c89c788 ffff0000
[ 2004.067362] [pid:325,cpu11,in irq]26a0  00000078 00000000 00000000 00000000 0000000b 0000000d 842a5000 ffff0000
[ 2004.067367] [pid:325,cpu11,in irq]26c0  0000201d 0bfffc00 02b5fd88 fffffc00 02931988 fffffc00 8fc602a0 ffff0000
[ 2004.067373] [pid:325,cpu11,in irq]26e0  000005f0 00000000 8fb27f08 ffff0000 00000000 00000004 8518e000 ffff0000
[ 2004.067379] [pid:325,cpu11,in irq]2700  0008003e 0bfffc00 0264ea08 fffffc00 02632088 fffffc00 86f8b508 ffff0000
[ 2004.067385] [pid:325,cpu11,in irq]2720  00000000 00000000 00000000 00000000 ffffffff 00000001 90c44000 ffff0000
[ 2004.067391] [pid:325,cpu11,in irq]
               X29: 0xffff80000ad93c10:
[ 2004.067392] [pid:325,cpu11,in irq]3b90  8fc602a0 ffff0000 91d1fd80 ffff0000 025026c0 fffffc00 0ad93c10 ffff8000
[ 2004.067398] [pid:325,cpu11,in irq]3bb0  09258100 ffff8000 0ad93c10 ffff8000 09258914 ffff8000 02400009 00000000
[ 2004.067404] [pid:325,cpu11,in irq]3bd0  0ad93c20 ffff8000 083eacfc 3fbd8000 000005f0 00000000 000005ff 00000000
[ 2004.067409] [pid:325,cpu11,in irq]3bf0  0ad93c10 ffff8000 09258914 ffff8000 86379ff0 ffff0000 00000000 00000000
[ 2004.067415] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2004.067421] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2004.067427] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2004.067433] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2004.067439] [pid:325,cpu11,in irq]Call trace:
[ 2004.067440] [pid:325,cpu11,in irq] queued_spin_lock_slowpath+0x54/0x370
[ 2004.067443] [pid:325,cpu11,in irq] filemap_map_pages+0x1f8/0x590
[ 2004.067454] [pid:325,cpu11,in irq] __handle_mm_fault+0xd04/0xf9c
[ 2004.067462] [pid:325,cpu11,in irq] handle_mm_fault+0xec/0x270
[ 2004.067464] [pid:325,cpu11,in irq] do_page_fault+0x134/0x360
[ 2004.067478] [pid:325,cpu11,in irq] do_translation_fault+0x9c/0xb0
[ 2004.067482] [pid:325,cpu11,in irq] do_mem_abort+0x44/0x94
[ 2004.067485] [pid:325,cpu11,in irq] el0_da+0x24/0x60
[ 2004.067490] [pid:325,cpu11,in irq] el0t_64_sync_handler+0xac/0x120
[ 2004.067495] [pid:325,cpu11,in irq] el0t_64_sync+0x170/0x174
[ 2025.082383] [2025:04:08 18:26:06][pid:0,cpu2,in irq]rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 2025.082407] [pid:0,cpu2,in irq]rcu: 	6-...!: (0 ticks this GP) idle=485c/1/0x4000000000000000 softirq=47969/47969 fqs=338
[ 2025.082428] [pid:0,cpu2,in irq]	(detected by 2, t=21010 jiffies, g=148585, q=78 ncpus=12)
[ 2025.082442] [pid:0,cpu2,in irq]Sending NMI from CPU 2 to CPUs 6:
[ 2028.066350] [2025:04:08 18:26:09][pid:325,cpu11,in irq]watchdog: BUG: soft lockup - CPU#11 stuck for 43s! [systemd-journal:325]
[ 2028.066353] [pid:325,cpu11,in irq]Modules linked in: nvidia_drm(O) nvidia_modeset(O) nvidia(O) qrtr xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 uhid 8021q garp mrp stp llc rtk_btusb snd_soc_hdmi_codec btusb btrtl btintel r8126 mali_kbase(O) protected_memory_allocator(O) snd_hda_codec_realtek clk_sky1_audss crct10dif_ce sm3_ce amvx(O) snd_soc_hda sm3 snd_hda_ext_core sha3_ce reset_sky1_audss cros_ec_chardev goodix_ts arm_dma350 aipu(O) sha3_generic rtc_hym8563 cix_dsp_rproc snd_soc_cdns_i2s_mc memory_group_manager(O) trilin_dpsub snd_hda_core sha512_ce sha512_arm64 linlon_dp rfkill_bt pwm_bl armcb_isp snd_soc_sky1_sound_card drm_display_helper binfmt_misc video nf_tables libcrc32c nfnetlink fuse dm_mod ip_tables x_tables ipv6 [last unloaded: nvidia(O)]
[ 2028.066395] [pid:325,cpu11,in irq]CPU: 11 PID: 325 Comm: systemd-journal Tainted: G S         O L     6.1.44-cix-build-generic #2
[ 2028.066397] [pid:325,cpu11,in irq]Hardware name: Radxa Computer (Shenzhen) Co., Ltd. Radxa Orion O6/Radxa Orion O6, BIOS 1.0 Jan  1 1980
[ 2028.066398] [pid:325,cpu11,in irq]pstate: 02400009 (nzcv daif +PAN -UAO +TCO -DIT -SSBS BTYPE=--)
[ 2028.066399] [pid:325,cpu11,in irq]pc : queued_spin_lock_slowpath+0x54/0x370
[ 2028.066401] [pid:325,cpu11,in irq]lr : _raw_spin_lock+0x70/0x80
[ 2028.066403] [pid:325,cpu11,in irq]sp : ffff80000ad93c10
[ 2028.066404] [pid:325,cpu11,in irq]x29: ffff80000ad93c10 x28: fffffc00025026c0 x27: ffff000091d1fd80
[ 2028.066407] [pid:325,cpu11,in irq]x26: ffff00008fc602a0 x25: 0000000000000000 x24: 0000000000000000
[ 2028.066410] [pid:325,cpu11,in irq]x23: 0800000102183003 x22: 0000ffff915f0000 x21: ffff80000ad93d28
[ 2028.066413] [pid:325,cpu11,in irq]x20: 00000000000005ff x19: 00000000000005f0 x18: 0000000000000000
[ 2028.066415] [pid:325,cpu11,in irq]x17: 0000000000000000 x16: ffff800009486770 x15: 0000ffff923fffff
[ 2028.066418] [pid:325,cpu11,in irq]x14: 0000000000000000 x13: 1fffe00012ad82e1 x12: ffff80000ad93d38
[ 2028.066421] [pid:325,cpu11,in irq]x11: ffff0000956c1700 x10: ffff0000956c170c x9 : 00000000000005f0
[ 2028.066424] [pid:325,cpu11,in irq]x8 : 00000000000005ff x7 : ffff80000ad93c90 x6 : ffff00008f891ff0
[ 2028.066426] [pid:325,cpu11,in irq]x5 : ffff80000ad93c90 x4 : 0000000000000001 x3 : fffffc00020860e8
[ 2028.066429] [pid:325,cpu11,in irq]x2 : 0000000000000001 x1 : 0000000000000000 x0 : 0000000000000101
[ 2028.066432] [pid:325,cpu11,in irq]
               PC: 0xffff800009258914:
[ 2028.066432] [pid:325,cpu11,in irq]8894  d5184600 d5184600 d5384613 521b0a61 d5184601 d5384613 521b0a60 d5184600
[ 2028.066438] [pid:325,cpu11,in irq]88b4  00000000 00000000 00000000 aa0003e3 7104003f 540008e0 7103fc3f 54000408
[ 2028.066444] [pid:325,cpu11,in irq]88d4  d503201f 52802000 b8a03060 7103fc1f 54000308 35000160 52800020 79000060
[ 2028.066450] [pid:325,cpu11,in irq]88f4  d65f03c0 93407c00 d50320bf d503205f 885f7c61 4a000021 35000041 d503205f
[ 2028.066456] [pid:325,cpu11,in irq]8914  88dffc60 72001c1f 54fffee1 52800020 79000060 d65f03c0 f9800071 885ffc60
[ 2028.066462] [pid:325,cpu11,in irq]8934  32180001 88027c61 35ffffa2 17ffffe8 72181c1f 54001100 d503201f b0003d64
[ 2028.066467] [pid:325,cpu11,in irq]8954  912a0084 910003e1 aa0403e5 d53cd040 8b0000a5 d503233f f0003d00 91002000
[ 2028.066473] [pid:325,cpu11,in irq]8974  b9400ca6 110004c2 b9000ca2 d53cd041 b8616809 71000cdf 540006ac 937c7cc8
[ 2028.066479] [pid:325,cpu11,in irq]
               LR: 0xffff800009258100:
[ 2028.066480] [pid:325,cpu11,in irq]8080  d50323bf d65f03c0 d503201f d503201f d5384102 b9400841 aa0003e3 11000421
[ 2028.066486] [pid:325,cpu11,in irq]80a0  b9000841 d503201f 52800001 52800022 2a0103e4 88e47c02 2a0403e0 35000160
[ 2028.066491] [pid:325,cpu11,in irq]80c0  d65f03c0 d2800001 52800022 f9800071 885ffc60 4a010004 35000064 88047c62
[ 2028.066497] [pid:325,cpu11,in irq]80e0  35ffff84 34fffee0 d503233f a9bf7bfd 2a0003e1 910003fd aa0303e0 940001f1
[ 2028.066503] [pid:325,cpu11,in irq]8100  a8c17bfd d50323bf d65f03c0 d503201f d5384102 b9400841 aa0003e3 11080421
[ 2028.066509] [pid:325,cpu11,in irq]8120  b9000841 d503201f 52800001 52801fe2 2a0103e4 88e47c02 2a0403e0 35000160
[ 2028.066514] [pid:325,cpu11,in irq]8140  d65f03c0 d2800001 52801fe2 f9800071 885ffc60 4a010004 35000064 88047c62
[ 2028.066520] [pid:325,cpu11,in irq]8160  35ffff84 34fffee0 d503233f a9bf7bfd aa0303e0 910003fd 9400030a a8c17bfd
[ 2028.066526] [pid:325,cpu11,in irq]
               SP: 0xffff80000ad93c10:
[ 2028.066527] [pid:325,cpu11,in irq]3b90  8fc602a0 ffff0000 91d1fd80 ffff0000 025026c0 fffffc00 0ad93c10 ffff8000
[ 2028.066533] [pid:325,cpu11,in irq]3bb0  09258100 ffff8000 0ad93c10 ffff8000 09258914 ffff8000 02400009 00000000
[ 2028.066538] [pid:325,cpu11,in irq]3bd0  0ad93c20 ffff8000 083eacfc 3fbd8000 000005f0 00000000 000005ff 00000000
[ 2028.066544] [pid:325,cpu11,in irq]3bf0  0ad93c10 ffff8000 09258914 ffff8000 86379ff0 ffff0000 00000000 00000000
[ 2028.066550] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2028.066556] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2028.066562] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2028.066568] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2028.066574] [pid:325,cpu11,in irq]
               X3: 0xfffffc00020860e8:
[ 2028.066575] [pid:325,cpu11,in irq]6068  00000000 00000000 ffffffff 00000000 00000000 00000000 00000000 0bfffc00
[ 2028.066580] [pid:325,cpu11,in irq]6088  00000000 00000000 00000122 dead0000 00000000 00000000 00000000 00000000
[ 2028.066586] [pid:325,cpu11,in irq]60a8  00000000 00000000 ffffffff 00000001 00000000 00000000 00000000 0bfffc00
[ 2028.066592] [pid:325,cpu11,in irq]60c8  00000000 00000000 00000122 dead0000 00000000 00000000 00000000 00000000
[ 2028.066598] [pid:325,cpu11,in irq]60e8  00000101 00000000 fffffdff 00000001 86c24602 ffff0000 00002030 0bfffc00
[ 2028.066604] [pid:325,cpu11,in irq]6108  021a04c8 fffffc00 020e77c8 fffffc00 83c08b60 ffff0000 0000159e 00000000
[ 2028.066609] [pid:325,cpu11,in irq]6128  8fe62548 ffff0000 ffffffff 00000002 82917000 ffff0000 00000000 0bfffc00
[ 2028.066615] [pid:325,cpu11,in irq]6148  00000000 00000000 00000122 dead0000 00000000 00000000 00000000 00000000
[ 2028.066621] [pid:325,cpu11,in irq]
               X5: 0xffff80000ad93c90:
[ 2028.066622] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2028.066628] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2028.066634] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2028.066639] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2028.066645] [pid:325,cpu11,in irq]3c90  8fc602a8 ffff0000 000005f0 00000000 00300000 00000000 8f891ff0 ffff0000
[ 2028.066651] [pid:325,cpu11,in irq]3cb0  00000000 00000000 00000000 00000000 00000000 00000000 dcbb2e00 bc72e43a
[ 2028.066657] [pid:325,cpu11,in irq]3cd0  0ad93da0 ffff8000 0842792c 078c8000 00000254 00000000 91d1fd80 ffff0000
[ 2028.066663] [pid:325,cpu11,in irq]3cf0  915f4da8 0000ffff 0ad93eb0 ffff8000 00000040 00000000 92000007 00000000
[ 2028.066669] [pid:325,cpu11,in irq]
               X6: 0xffff00008f891ff0:
[ 2028.066669] [pid:325,cpu11,in irq]1f70  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2028.066675] [pid:325,cpu11,in irq]1f90  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2028.066681] [pid:325,cpu11,in irq]1fb0  00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2028.066687] [pid:325,cpu11,in irq]1fd0  00000000 00000000 00000000 00000000 00000000 00000000 8f893230 ffff0000
[ 2028.066692] [pid:325,cpu11,in irq]1ff0  00381700 00000000 8f8d8ff8 ffff0000 8fc602a8 ffff0000 8f892008 ffff0000
[ 2028.066698] [pid:325,cpu11,in irq]2010  8f892008 ffff0000 02a8e4c0 fffffc00 02b3f3c0 fffffc00 028ec580 fffffc00
[ 2028.066704] [pid:325,cpu11,in irq]2030  02ad9140 fffffc00 028788c0 fffffc00 02b3f6c0 fffffc00 028abf00 fffffc00
[ 2028.066710] [pid:325,cpu11,in irq]2050  024c9c00 fffffc00 02b49e80 fffffc00 02a83100 fffffc00 024c2440 fffffc00
[ 2028.066716] [pid:325,cpu11,in irq]
               X7: 0xffff80000ad93c90:
[ 2028.066717] [pid:325,cpu11,in irq]3c10  0ad93c20 ffff8000 083eae68 5db48000 0ad93cd0 ffff8000 084275a8 29db8000
[ 2028.066722] [pid:325,cpu11,in irq]3c30  000005ff 00000000 91d1fd80 ffff0000 0ad93d28 ffff8000 000005f0 00000000
[ 2028.066728] [pid:325,cpu11,in irq]3c50  86379ff0 ffff0000 000000fb 00000000 84b28780 ffff0000 00000003 00000000
[ 2028.066734] [pid:325,cpu11,in irq]3c70  00000000 00000000 85195880 ffff0000 86fc7500 ffff0000 80000000 00000000
[ 2028.066740] [pid:325,cpu11,in irq]3c90  8fc602a8 ffff0000 000005f0 00000000 00300000 00000000 8f891ff0 ffff0000
[ 2028.066746] [pid:325,cpu11,in irq]3cb0  00000000 00000000 00000000 00000000 00000000 00000000 dcbb2e00 bc72e43a
[ 2028.066752] [pid:325,cpu11,in irq]3cd0  0ad93da0 ffff8000 0842792c 078c8000 00000254 00000000 91d1fd80 ffff0000
[ 2028.066757] [pid:325,cpu11,in irq]3cf0  915f4da8 0000ffff 0ad93eb0 ffff8000 00000040 00000000 92000007 00000000
[ 2028.066763] [pid:325,cpu11,in irq]
               X10: 0xffff0000956c170c:
[ 2028.066764] [pid:325,cpu11,in irq]168c  ffff0000 88b72e10 ffff0000 90d5dbd0 ffff0000 90d5dab0 ffff0000 90d5db40
[ 2028.066770] [pid:325,cpu11,in irq]16ac  ffff0000 90d5da20 ffff0000 88b726c0 ffff0000 00000000 00000000 88760cf0
[ 2028.066776] [pid:325,cpu11,in irq]16cc  ffff0000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
[ 2028.066782] [pid:325,cpu11,in irq]16ec  00000000 00000000 00000000 0000000a 00000000 956c1d06 ffff0000 de94ffff
[ 2028.066787] [pid:325,cpu11,in irq]170c  0000aaaa de974fff 0000aaaa de98dfff 0000aaaa de98ffff 0000aaaa de990fff
[ 2028.066793] [pid:325,cpu11,in irq]172c  0000aaaa 0b7a0fff 0000aaab 0b818fff 0000aaab 907effff 0000ffff 907fffff
[ 2028.066799] [pid:325,cpu11,in irq]174c  0000ffff 90ffffff 0000ffff 917fffff 0000ffff 91bfffff 0000ffff 923fffff
[ 2028.066805] [pid:325,cpu11,in irq]176c  0000ffff 00000000 00000000 00000000 00000000 00000000 00000000 8355bb40
[ 2028.066811] [pid:325,cpu11,in irq]
               X11: 0xffff0000956c1700:
[ 2028.066812] [pid:325,cpu11,in irq]1680  83bf5c60 ffff0000 86e757e0 ffff0000 88b72e10 ffff0000 90d5dbd0 ffff0000
[ 2028.066818] [pid:325,cpu11,in irq]16a0  90d5dab0 ffff0000 90d5db40 ffff0000 90d5da20 ffff0000 88b726c0 ffff0000
[ 2028.066823] [pid:325,cpu11,in irq]16c0  00000000 00000000 88760cf0 ffff0000 00000000 00000000 00000000 00000000
[ 2028.066829] [pid:325,cpu11,in irq]16e0  00000000 00000000 00000000 00000000 00000000 00000000 0000000a 00000000
[ 2028.066835] [pid:325,cpu11,in irq]1700  956c1d06 ffff0000 de94ffff 0000aaaa de974fff 0000aaaa de98dfff 0000aaaa
[ 2028.066841] [pid:325,cpu11,in irq]1720  de98ffff 0000aaaa de990fff 0000aaaa 0b7a0fff 0000aaab 0b818fff 0000aaab
[ 2028.066847] [pid:325,cpu11,in irq]1740  907effff 0000ffff 907fffff 0000ffff 90ffffff 0000ffff 917fffff 0000ffff
[ 2028.066853] [pid:325,cpu11,in irq]1760  91bfffff 0000ffff 923fffff 0000ffff 00000000 00000000 00000000 00000000
[ 2028.066858] [pid:325,cpu11,in irq]
               X12: 0xffff80000ad93d38:
[ 2028.066859] [pid:325,cpu11,in irq]3cb8  00000000 00000000 00000000 00000000 dcbb2e00 bc72e43a 0ad93da0 ffff8000
[ 2028.066865] [pid:325,cpu11,in irq]3cd8  0842792c 078c8000 00000254 00000000 91d <at this point it dies>

Don’t even know where to begin with that. Here’s a full log from boot to hot reset lock-up, though I couldn’t get it to spew all over the place again scrollback.txt.zip (42.3 KB)

meco · April 13, 2025, 3:03pm

I think 40xx series GPU’s are more demanding regarding PCIe. I saw something about bar issues in one post (for now the only devices that were affected on Orion were Nvidia 40xx or newer). Up to 30xx series seems to work even with Gen 4 as demonstrated by @ShivanSpS’s 3060 or my 3090.

angel · April 14, 2025, 2:23am

Sure, I just wish it was possible to at least figure out what exactly the 40 series cards want that the Orion isn’t capable of. Especially when these cards work just fine even on old motherboards with PCIe Gen 2. Sucks that everything on this board is so buggy and opaque : (

Salvador · April 14, 2025, 4:55pm

Keep in mind this is the first consumer ARM board where you can even plug in a dgpu and use it at all. We are just on the 2nd public bios, and we are not even sure we were suppoused to have access to it.

hrw · April 14, 2025, 8:10pm

I promised myself to be reader only. But level of bull shit went too high ;D

this is the first consumer ARM board where you can even plug in a dgpu and use it at all.

The first one was in 2014. And was named Mustang. Made by Applied Micro company.

We used it to make several kernel subsystems work on AArch64. PCIe, USB etc. I used graphic cards from several chip vendors in it. Matrox, ATI/AMD, NVidia.

Most of Linux distributions used them to build packages.

And there were several other systems since then with one or more PCIe slots to allow use of graphic cards and other extensions. Consumer systems. In wide range of prices.

spikerguy · April 14, 2025, 10:02pm

You have knowledge of most of the Arm boards so you so know majority of the devices. While all the new comers have no idea about the times companies have tried to make consumer grade boards based on RISC architecture.

I am excited to see Arm or Risc-V succeed but not at the expense of open source developers getting burned out by vendors

I am on read only mode since more than 6 months now. Happy to see CIX doing a good job so far with UEFI, waiting for them to convince upstream Linux maintainer to make acpi for Arm

As you already know dtb is not the way forward.

Lets hope for the best. RISC to consumer grade in how many years? Idk

ShivanSpS · April 14, 2025, 10:09pm

Thats not a consumer grade board. specially at $5000… At that point we could argue even Altera did it.

But if you want to go that road, we could say some Risc-V boards did it first, Visionfive and the K1 has a good enoght pcie implementation to run gpus, at least some of them.

Even the RPI5 may qualify, maybe.

spikerguy · April 14, 2025, 10:04pm

Now that depends on whats you’re definition of consumer grade versus what is the English definition of consumer grade.

Anyways good luck.

Ok bye

angel · April 14, 2025, 10:52pm

Keep in mind this is the first consumer ARM board where you can even plug in a dgpu and use it at all. We are just on the 2nd public bios, and we are not even sure we were suppoused to have access to it.

Wow, excellent insight, thank you so much for sharing. What pisses me off isn’t even that the fact it’s hilariously wrong, so much as that even if it were correct your comment would still be just as unhelpful. Plus you’ve brought the bickering to this thread. Great job.

Now on a more productive note, does any of you with experience from other boards know anything about debugging PCIe bringup? I have zero experience with modifying EDKII or flashing this board’s firmware with customized bios, but willing to get my hands dirty. Unfortunate that Radxa doesn’t seem to be very interested in helping users with PCIe compatibility, but would be welcome to see that change…

ShivanSpS · April 15, 2025, 12:34am

You are certanly not helping by calling me wrong and giving no reason as to why im wrong. I already able to do more with the O6 with the 2nd bios that showed up than in 4 years with the useless RK3588. and in 10 years of $10 to $200 SBCs.

Yes there are problems and i tried to help you, i dont have the tecnical knowledge to go deeper.

If you all rich people that can buy $5000 server boards and call it a consumer board want to call me wrong go right ahead.

hrw · April 15, 2025, 6:13am

Mustang came to the market with price of 825 USD.

Which at that time was good price for what it gave.