Test EVGA Nvidia RTX 3080 Ti on Raspberry Pi 5

[geerlingguy]

I have tested the 3080 Ti on my Raspberry Pi 5 using Raspberry Pi's prototype PCIe adapter. It required an external power supply to feed that adapter and the card itself, and I had to install Nvidia's latest arm64 driver for the 3080 Ti, but after all that, I got the dreaded RmInitAdapter failed! message.

[geerlingguy]

Testing with nouveau now...

pi@pi5:~ $ dmesg | grep nouveau
[    2.938104] nouveau 0000:01:00.0: enabling device (0000 -> 0002)
[    2.938329] nouveau 0000:01:00.0: NVIDIA GA102 (b72000a1)
[    3.404851] nouveau 0000:01:00.0: bios: version 94.02.71.80.74
[    3.426761] nouveau 0000:01:00.0: bios: M0203E type 0a
[    3.426780] nouveau 0000:01:00.0: fb: 12288 MiB of unknown memory type
[    3.461589] nouveau 0000:01:00.0: DRM: VRAM: 12288 MiB
[    3.461602] nouveau 0000:01:00.0: DRM: GART: 536870912 MiB
[    3.461609] nouveau 0000:01:00.0: DRM: BIT table 'A' not found
[    3.461613] nouveau 0000:01:00.0: DRM: BIT table 'L' not found
[    3.461617] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
[    3.461621] nouveau 0000:01:00.0: DRM: DCB version 4.1
[    3.461625] nouveau 0000:01:00.0: DRM: DCB outp 00: 04800f86 04600020
[    3.461630] nouveau 0000:01:00.0: DRM: DCB outp 01: 04000f82 00020020
[    3.461634] nouveau 0000:01:00.0: DRM: DCB outp 02: 04811f76 04600010
[    3.461637] nouveau 0000:01:00.0: DRM: DCB outp 03: 04011f72 00020010
[    3.461641] nouveau 0000:01:00.0: DRM: DCB outp 04: 02822f66 04600020
[    3.461645] nouveau 0000:01:00.0: DRM: DCB outp 05: 02022f62 00020020
[    3.461650] nouveau 0000:01:00.0: DRM: DCB outp 07: 02033f52 00020010
[    3.461655] nouveau 0000:01:00.0: DRM: DCB conn 00: 02000046
[    3.461658] nouveau 0000:01:00.0: DRM: DCB conn 01: 01000146
[    3.461661] nouveau 0000:01:00.0: DRM: DCB conn 02: 00020246
[    3.461665] nouveau 0000:01:00.0: DRM: DCB conn 03: 00010361
[    3.461748] nouveau 0000:01:00.0: DRM: failed to initialise sync subsystem, -22
[    3.495783] nouveau: probe of 0000:01:00.0 failed with error -22

[geerlingguy]

Trying proprietary driver again. First disabling nouveau by creating a file /etc/modprobe.d/blacklist-nouveau.conf with the content:

blacklist nouveau
options nouveau modeset=0

Then after a reboot, it was not loading the nouveau module.

May I interject debugging is SO much more fun when the whole system doesn't freeze every time requiring me to reset power?

[geerlingguy]

Downloading the Nvidia driver from https://www.nvidia.com/en-us/geforce/drivers/results/214101/

wget https://us.download.nvidia.com/XFree86/aarch64/545.29.02/NVIDIA-Linux-aarch64-545.29.02.run
chmod +x NVIDIA-Linux-aarch64-545.29.02.run
sudo ./NVIDIA-Linux-aarch64-545.29.02.run

After installation was complete, I rebooted, and dmesg shows:

[    3.756735] nvidia: loading out-of-tree module taints kernel.
[    3.756757] nvidia: module license 'NVIDIA' taints kernel.
[    3.756760] Disabling lock debugging due to kernel taint
[    3.840532] nvidia-nvlink: Nvlink Core is being initialized, major device number 509

[    3.845903] nvidia 0000:01:00.0: enabling device (0000 -> 0002)
[    3.845947] nvidia 0000:01:00.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=none
[    3.890053] NVRM: loading NVIDIA UNIX aarch64 Kernel Module  545.29.02  Thu Oct 26 21:50:44 UTC 2023
[    3.918561] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  545.29.02  Thu Oct 26 20:50:54 UTC 2023
[    3.925431] [drm] [nvidia-drm] [GPU ID 0x00000100] Loading driver
[    3.925439] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:01:00.0 on minor 2
[    6.148023] NVRM: Chipset not recognized (vendor ID 0x14e4, device ID 0x2712)
[    6.148030] The NVIDIA GPU driver for AArch64 has not been qualified on this platform
               and therefore it is not recommended or intended for use in any production
               environment.
[   10.688237] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1470)
[   10.688306] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   14.949123] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1470)
[   14.949180] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

That fun, and dreaded RmInitAdapter failed!.

[geerlingguy]

See possibly related issues: NVIDIA/open-gpu-kernel-modules#514 and NVIDIA/open-gpu-kernel-modules#475

I need to test with the open-gpu-kernel-modules bits.

(The quickest way to uninstall Nvidia's proprietary driver is sudo nvidia-uninstall.)

(Also, the 3080 Ti gets HOT.)

[Radiicall]

Have you tested with the new nouveau vulkan driver? It might have more luck initializing than the normal nouveau gl driver (I dont really know but its just an idea)

[SpudGunMan]

Did this ever become reality or only amd driver?

[geerlingguy]

@SpudGunMan - Only AMD for now. Going to hopefully do another round of testing with Nvidia cards soon.

[geerlingguy]

Trying again today with the 550.127.05 version of Nvidia's aarch64 driver...

wget https://us.download.nvidia.com/XFree86/aarch64/550.127.05/NVIDIA-Linux-aarch64-550.127.05.run
chmod +x NVIDIA-Linux-aarch64-550.127.05.run
sudo ./NVIDIA-Linux-aarch64-550.127.05.run

Same as always...

[    6.409188] NVRM: Chipset not recognized (vendor ID 0x14e4, device ID 0x2712)
[    6.409194] The NVIDIA GPU driver for AArch64 has not been qualified on this platform
               and therefore it is not recommended or intended for use in any production
               environment.
[   10.826813] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   10.826858] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   14.978850] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   14.978891] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[   19.130882] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   19.130925] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

However, adding:

dtoverlay=pcie-32bit-dma-pi5

Results in:

[    6.782312] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 425984 bytes), total 32768 (slots), used 72 (slots)
[    6.782322] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    6.782345] NVRM: GPU 0000:01:00.0: Failed to copy vbios to system memory.
[    6.782631] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x30:0xffff:1098)
[    6.782672] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[    6.974523] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 442368 bytes), total 32768 (slots), used 368 (slots)
[    6.974535] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    6.975553] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x24:0x59:1568)
[    6.975612] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[    7.021339] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 327680 bytes), total 32768 (slots), used 488 (slots)
[    7.021348] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    7.022215] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x24:0x59:1568)
[    7.022272] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0
[    7.067861] nvidia 0000:01:00.0: swiotlb buffer is full (sz: 1163264 bytes), total 32768 (slots), used 480 (slots)
[    7.067873] NVRM: 0000:01:00.0: Failed to create a DMA mapping!
[    7.068948] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x24:0x59:1568)
[    7.069012] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

So I've taken that back out, and set pcie_aspm=off in cmdline.txt, but still getting:

[   10.874741] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x25:0x65:1601)
[   10.874793] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

[geerlingguy]

Attempting to uninstall and reinstall the 'open' version of the driver after reading this issue — worth a shot:

sudo nvidia-uninstall
sudo ./NVIDIA-Linux-aarch64-550.127.05.run -m=kernel-open

After a reboot, some different output:

[    6.496707] NVRM: clCheckUpstreamLtrSupport_IMPL: PCIE config space is inaccessible!
[    6.595440] NVRM: kgspExecuteFwsec_TU102: failed to execute FWSEC for FRTS: no initialized WPR2 found
[    6.595447] NVRM: kgspExecuteFwsec_TU102: (note: VBIOS version 94.02.71.80.74)
[    6.595451] NVRM: nvAssertOkFailedNoLog: Assertion failed: Failure: Generic Error [NV_ERR_GENERIC] (0x0000FFFF) returned from status @ kernel_gsp_tu102.c:445
[    6.595463] NVRM: RmInitAdapter: Cannot initialize GSP firmware RM
[    6.596427] NVRM: GPU 0000:01:00.0: RmInitAdapter failed! (0x62:0xffff:1792)
[    6.596676] NVRM: GPU 0000:01:00.0: rm_init_adapter failed, device minor number 0

Code where it throws the config space inaccessible warning: https://github.com/NVIDIA/open-gpu-kernel-modules/blob/main/src/nvidia/src/kernel/platform/chipset/chipset_pcie.c#L529-L605

(Also found this related issue from 2021.)

[geerlingguy]

@Coreforge - Just a shot in the dark, but could this also be related to the BAR assignments like maybe the RX 6700 XT? At least with the open kernel driver, I get something more than the dratted "RmInitAdapter" lol

[Edit: I also added a Discussion under the Nvidia open driver repo: NVIDIA/open-gpu-kernel-modules - Raspberry Pi support (arm64)?.

[geerlingguy]

I've uninstalled the driver, and am rebuilding the kernel with nouveau enabled, to see how that fares.

1-2:1.3/0003:046D:C548.0004/input/input10
[    4.264334] ------------[ cut here ]------------
[    4.264342] nouveau 0000:01:00.0: swiotlb addr 0x00000010fcffc000+16384 overflow (mask ffffffff, bus limit 1fffffffff).
[    4.265363] WARNING: CPU: 3 PID: 308 at kernel/dma/swiotlb.c:1511 swiotlb_map+0x2a4/0x2c0
[    4.265381] Modules linked in: sha256_arm64(+) sha1_ce brcmfmac_wcc raspberrypi_hwmon hci_uart hid_apple(+) btbcm bluetooth hid_multitouch(+) brcmfmac joydev ecdh_generic ecc libaes vc4(+) brcmutil binfmt_misc cfg80211 snd_soc_hdmi_codec cec drm_dma_helper snd_soc_core nouveau(+) rfkill i2c_brcmstb v3d snd_compress spi_bcm2835 rpivid_hevc(C) pisp_be v4l2_mem2mem videobuf2_dma_contig gpio_keys snd_pcm_dmaengine snd_pcm videobuf2_memops snd_timer drm_exec gpu_sched snd videobuf2_v4l2 i2c_algo_bit drm_display_helper drm_shmem_helper videodev drm_ttm_helper pwm_fan videobuf2_common mc ttm drm_kms_helper raspberrypi_gpiomem rp1_adc nvmem_rmem uio_pdrv_genirq uio drm i2c_dev fuse dm_mod drm_panel_orientation_quirks backlight ip_tables x_tables ipv6
[    4.265468] CPU: 3 PID: 308 Comm: (udev-worker) Tainted: G         C         6.6.58-v8-16k+ #12
[    4.265473] Hardware name: Raspberry Pi 5 Model B Rev 1.0 (DT)
[    4.265475] pstate: 60400009 (nZCv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    4.265479] pc : swiotlb_map+0x2a4/0x2c0
[    4.265483] lr : swiotlb_map+0x2a4/0x2c0
[    4.265487] sp : ffffc0008073b5f0
[    4.265489] x29: ffffc0008073b5f0 x28: 0000000000000001 x27: 0000000000000001
[    4.265494] x26: ffff80010a0d7800 x25: 00000011055f4000 x24: 00000000ffffffff
[    4.265499] x23: ffff8001011398c0 x22: 0000000000000000 x21: 0000000000000000
[    4.265504] x20: 0000000000004000 x19: 00000001055f4000 x18: 0000000000000000
[    4.265508] x17: 0000000000000000 x16: 0000000000000000 x15: 0000000000000000
[    4.265513] x14: 026d8c4a8e7ab198 x13: ffffd00084d62c38 x12: 00000000fa83b2da
[    4.265518] x11: 00000000000002fc x10: 0000000000001a50 x9 : ffffd000840d4268
[    4.265523] x8 : ffff800107c4b470 x7 : 0000000000000001 x6 : 0000000000000001
[    4.265527] x5 : 00000000410fd0b0 x4 : 0000000000f0000f x3 : 0000000000400001
[    4.265532] x2 : 0000000000000000 x1 : 0000000000000000 x0 : ffff800107c499c0
[    4.265536] Call trace:
[    4.265538]  swiotlb_map+0x2a4/0x2c0
[    4.265543]  dma_map_page_attrs+0xb4/0x248
[    4.265547]  nvkm_fb_ctor+0xc4/0x100 [nouveau]
[    4.265756]  gf100_fb_new_+0x68/0x98 [nouveau]
[    4.265933]  ga102_fb_new+0x38/0x50 [nouveau]
[    4.266107]  nvkm_device_ctor+0x1a2c/0x3da0 [nouveau]
[    4.266283]  nvkm_device_pci_new+0xf8/0x298 [nouveau]
[    4.266456]  nouveau_drm_probe+0xd0/0x230 [nouveau]
[    4.266632]  local_pci_probe+0x48/0xb8
[    4.266638]  pci_device_probe+0xac/0x1c8
[    4.266641]  really_probe+0x150/0x2c0
[    4.266645]  __driver_probe_device+0x80/0x140
[    4.266649]  driver_probe_device+0x44/0x170
[    4.266652]  __driver_attach+0x9c/0x1b0
[    4.266655]  bus_for_each_dev+0x80/0xe8
[    4.266661]  driver_attach+0x2c/0x40
[    4.266664]  bus_add_driver+0xec/0x218
[    4.266666]  driver_register+0x68/0x138
[    4.266670]  __pci_register_driver+0x54/0x68
[    4.266673]  nouveau_drm_init+0x214/0x3ff8 [nouveau]
[    4.266849]  do_one_initcall+0x60/0x2c0
[    4.266854]  do_init_module+0x60/0x218
[    4.266859]  load_module+0x1de0/0x2090
[    4.266864]  __do_sys_init_module+0x19c/0x1e0
[    4.266867]  __arm64_sys_init_module+0x24/0x38
[    4.266870]  invoke_syscall+0x50/0x128
[    4.266876]  el0_svc_common.constprop.0+0xc8/0xf0
[    4.266881]  do_el0_svc+0x24/0x38
[    4.266885]  el0_svc+0x40/0xe8
[    4.266889]  el0t_64_sync_handler+0x100/0x130
[    4.266892]  el0t_64_sync+0x190/0x198
[    4.266895] ---[ end trace 0000000000000000 ]---
[    4.319673] nouveau 0000:01:00.0: acr: firmware unavailable
[    4.349183] nouveau 0000:01:00.0: bios: M0203E type 0a
[    4.349194] nouveau 0000:01:00.0: fb: 12288 MiB of unknown memory type
[    4.394434] nouveau 0000:01:00.0: DRM: VRAM: 12288 MiB
[    4.394442] nouveau 0000:01:00.0: DRM: GART: 536870912 MiB
[    4.394448] nouveau 0000:01:00.0: DRM: BIT table 'A' not found
[    4.394451] nouveau 0000:01:00.0: DRM: BIT table 'L' not found
[    4.394453] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
[    4.394456] nouveau 0000:01:00.0: DRM: DCB version 4.1
[    4.394459] nouveau 0000:01:00.0: DRM: DCB outp 00: 04800f86 04600020
[    4.394463] nouveau 0000:01:00.0: DRM: DCB outp 01: 04000f82 00020020
[    4.394466] nouveau 0000:01:00.0: DRM: DCB outp 02: 04811f76 04600010
[    4.394469] nouveau 0000:01:00.0: DRM: DCB outp 03: 04011f72 00020010
[    4.394471] nouveau 0000:01:00.0: DRM: DCB outp 04: 02822f66 04600020
[    4.394474] nouveau 0000:01:00.0: DRM: DCB outp 05: 02022f62 00020020
[    4.394476] nouveau 0000:01:00.0: DRM: DCB outp 07: 02033f52 00020010
[    4.394480] nouveau 0000:01:00.0: DRM: DCB conn 00: 02000046
[    4.394482] nouveau 0000:01:00.0: DRM: DCB conn 01: 01000146
[    4.394484] nouveau 0000:01:00.0: DRM: DCB conn 02: 00020246
[    4.394487] nouveau 0000:01:00.0: DRM: DCB conn 03: 00010361
[    4.395086] nouveau 0000:01:00.0: DRM: failed to create kernel channel, -22
[    4.395139] nouveau 0000:01:00.0: DRM: failed to create ce channel, -22
[    4.395142] nouveau 0000:01:00.0: DRM: MM: using CPU for buffer copies
[    4.432417] Unable to handle kernel NULL pointer dereference at virtual address 0000000000003fc0
[    4.441283] Mem abort info:
[    4.441286]   ESR = 0x0000000096000145
[    4.441287]   EC = 0x25: DABT (current EL), IL = 32 bits
[    4.441289]   SET = 0, FnV = 0
[    4.441291]   EA = 0, S1PTW = 0
[    4.441292]   FSC = 0x05: level 1 translation fault
[    4.441294] Data abort info:
[    4.441294]   ISV = 0, ISS = 0x00000145, ISS2 = 0x00000000
[    4.441296]   CM = 1, WnR = 1, TnD = 0, TagAccess = 0
[    4.441297]   GCS = 0, Overlay = 0, DirtyBit = 0, Xs = 0
[    4.441299] user pgtable: 16k pages, 47-bit VAs, pgdp=0000000107e48000
[    4.441302] [0000000000003fc0] pgd=0000000000000000, p4d=0000000000000000, pud=0000000000000000
[    4.441308] Internal error: Oops: 0000000096000145 [#1] PREEMPT SMP
[    4.441312] Modules linked in: ghash_ce gf128mul sha2_ce sha256_arm64 sha1_ce brcmfmac_wcc raspberrypi_hwmon hci_uart hid_apple(+) btbcm bluetooth hid_multitouch(+) brcmfmac joydev ecdh_generic ecc libaes vc4(+) brcmutil binfmt_misc cfg80211 snd_soc_hdmi_codec cec drm_dma_helper snd_soc_core nouveau(+) rfkill i2c_brcmstb v3d snd_compress spi_bcm2835 rpivid_hevc(C) pisp_be v4l2_mem2mem videobuf2_dma_contig gpio_keys snd_pcm_dmaengine snd_pcm videobuf2_memops snd_timer drm_exec gpu_sched snd videobuf2_v4l2 i2c_algo_bit drm_display_helper drm_shmem_helper videodev drm_ttm_helper pwm_fan videobuf2_common mc ttm drm_kms_helper raspberrypi_gpiomem rp1_adc nvmem_rmem uio_pdrv_genirq uio drm i2c_dev fuse dm_mod drm_panel_orientation_quirks backlight ip_tables x_tables ipv6
[    4.441383] CPU: 2 PID: 308 Comm: (udev-worker) Tainted: G        WC         6.6.58-v8-16k+ #12
[    4.441387] Hardware name: Raspberry Pi 5 Model B Rev 1.0 (DT)
[    4.441389] pstate: 00400009 (nzcv daif +PAN -UAO -TCO -DIT -SSBS BTYPE=--)
[    4.441392] pc : dcache_inval_poc+0x28/0x58
[    4.441407] lr : arch_sync_dma_for_cpu+0x34/0x50
[    4.441411] sp : ffffc0008073b720
[    4.441413] x29: ffffc0008073b720 x28: ffffd0005a3bda78 x27: 0000000000000001
[    4.441417] x26: ffffc0008073bce0 x25: ffffc0008073bc90 x24: ffffffffffffffff
[    4.441421] x23: 0000000000000000 x22: ffff8001011398c0 x21: 0000000000004000
[    4.441424] x20: 0000000000000000 x19: ffffffffffffffff x18: 0000000000000000
[    4.441427] x17: ffffb0017a814000 x16: ffffd0008413de98 x15: 0000000000000000
[    4.441431] x14: 0000000000000000 x13: 0000000000000000 x12: 0000000000000001
[    4.441434] x11: ffffd0005a429148 x10: 0000000000000004 x9 : ffffd0008413e04c
[    4.441438] x8 : 0000000000000000 x7 : ffff8001048a7a60 x6 : ffffffefffffffff
[    4.441441] x5 : ffff8001048a7a60 x4 : 0000000000000000 x3 : 000000000000003f
[    4.441444] x2 : 0000000000000040 x1 : 0000000000003fc0 x0 : ffffffffffffffff
[    4.441448] Call trace:
[    4.441450]  dcache_inval_poc+0x28/0x58
[    4.441455]  dma_unmap_page_attrs+0x1b4/0x1d0
[    4.441460]  nvkm_fb_dtor+0xc0/0x108 [nouveau]
[    4.441692]  nvkm_subdev_del+0x78/0x128 [nouveau]
[    4.441881]  nvkm_device_del+0x80/0x130 [nouveau]
[    4.442066]  nouveau_drm_probe+0x154/0x230 [nouveau]
[    4.442249]  local_pci_probe+0x48/0xb8
[    4.442259]  pci_device_probe+0xac/0x1c8
[    4.442262]  really_probe+0x150/0x2c0
[    4.442268]  __driver_probe_device+0x80/0x140
[    4.442270]  driver_probe_device+0x44/0x170
[    4.442273]  __driver_attach+0x9c/0x1b0
[    4.442275]  bus_for_each_dev+0x80/0xe8
[    4.442280]  driver_attach+0x2c/0x40
[    4.442282]  bus_add_driver+0xec/0x218
[    4.442284]  driver_register+0x68/0x138
[    4.442287]  __pci_register_driver+0x54/0x68
[    4.442290]  nouveau_drm_init+0x214/0x3ff8 [nouveau]
[    4.442477]  do_one_initcall+0x60/0x2c0
[    4.442482]  do_init_module+0x60/0x218
[    4.442488]  load_module+0x1de0/0x2090
[    4.442494]  __do_sys_init_module+0x19c/0x1e0
[    4.442496]  __arm64_sys_init_module+0x24/0x38
[    4.442499]  invoke_syscall+0x50/0x128
[    4.442507]  el0_svc_common.constprop.0+0xc8/0xf0
[    4.442511]  do_el0_svc+0x24/0x38
[    4.442515]  el0_svc+0x40/0xe8
[    4.442519]  el0t_64_sync_handler+0x100/0x130
[    4.442521]  el0t_64_sync+0x190/0x198
[    4.442525] Code: d1000443 ea03003f 8a230021 54000040 (d50b7e21) 
[    4.442528] ---[ end trace 0000000000000000 ]---

[geerlingguy]

If I set dtoverlay=pcie-32bit-dma-pi5 in config.txt and reboot, I get:

[    3.980643] nouveau 0000:01:00.0: enabling device (0000 -> 0002)
[    3.980867] nouveau 0000:01:00.0: NVIDIA GA102 (b72000a1)
[    4.328955] nouveau 0000:01:00.0: bios: version 94.02.71.80.74
[    4.449813] nouveau 0000:01:00.0: bios: M0203E type 0a
[    4.449823] nouveau 0000:01:00.0: fb: 12288 MiB of unknown memory type
[    4.686936] nouveau 0000:01:00.0: sec2(acr): mbox 00000007 00000000
[    4.686946] nouveau 0000:01:00.0: sec2(acr):AHESASC: boot failed: -5
[    4.686951] nouveau 0000:01:00.0: acr: init failed, -5
[    4.687108] nouveau 0000:01:00.0: init failed with -5
[    4.687112] nouveau: DRM-master:00000000:00000080: init failed with -5
[    4.687121] nouveau 0000:01:00.0: DRM-master: Device allocation failed: -5
[    4.933155] nouveau: probe of 0000:01:00.0 failed with error -5

In my searching around, I found raspberrypi/linux#5661, but trying dtoverlay=dwc2-pi5 resulted in the same error as earlier.