Test GPU (XFX AMD Radeon RX 460 4GB GDDR5)

[geerlingguy]

The RX 460 is a Polaris era AMD GPU. @Coreforge did a good amount of work getting one running, documented in #6.

We broke out this separate issue since the original RX 550 issue is already a bit long, and we are both testing on a Raspberry Pi 5 now, where this card may have more opportunity to shine.

Note: See later in this issue for more updated instructions, for full accelerated 4K rendering and display output.

Using Coreforge's 6.1.x kernel fork, if you recompile the kernel, you'll end up with a working HDMI output, with working console output:

pi@pi5:~ $ neofetch
       _,met$$$$$gg.          pi@pi5 
    ,g$$$$$$$$$$$$$$$P.       ------ 
  ,g$$P"     """Y$$.".        OS: Debian GNU/Linux 12 (bookworm) aarch64 
 ,$$P'              `$$$.     Host: Raspberry Pi 5 Model B Rev 1.0 
',$$P       ,ggs.     `$$b:   Kernel: 6.1.62-v8_16k+ 
`d$$'     ,$P"'   .    $$$    Uptime: 8 mins 
 $$P      d$'     ,    $$P    Packages: 1604 (dpkg) 
 $$:      $$.   -    ,d$$'    Shell: bash 5.2.15 
 $$;      Y$b._   _,d$P'      Resolution: 1920x1080 
 Y$$.    `.`"Y$$$$P"'         Terminal: /dev/pts/0 
 `$$b      "-.__              CPU: (4) @ 2.400GHz 
  `Y$$                        GPU: AMD ATI Radeon RX 460/560D / Pro 450/455/460/555/555X/560/560X 
   `Y$$.                      Memory: 207MiB / 8053MiB 
     `$$b.
       `Y$$b.                                         
          `"Y$b._                                     
              `"""

I have not been able to get wayfire/lightdm working (it sits there on a blinking cursor screen, and the wireplumber process seems to get stuck on something under the lightdm user. Coreforge was running with X11 and seemed to be able to run glmark2, Minecraft, Portal 1 and 2, and some other games, but currently is running with a PCIe x1 Gen 1 connection.

[geerlingguy]

To use radeontop:

sudo apt install -y libdrm-dev libncurses-dev libxcb-dri2-0-dev
git clone https://github.com/clbr/radeontop.git
cd radeontop
make
./radeontop

Since I'm having trouble getting into lightdm / wayfire, it's slightly less useful to me right now though :D

[geerlingguy]

If I use raspi-config to boot to CLI instead of desktop, I try running:

$ wayfire-pi
II 23-11-23 12:51:00.366 - [src/main.cpp:280] Starting wayfire version 0.7.5
II 23-11-23 12:51:00.366 - [libseat] [libseat/backend/seatd.c:64] Could not connect to socket /run/seatd.sock: No such file or directory
II 23-11-23 12:51:00.366 - [libseat] [libseat/libseat.c:76] Backend 'seatd' failed to open seat, skipping
Bus error

And:

$ startx
... get logged errors ...

$ cat /home/pi/.local/share/xorg/Xorg.0.log 
...
[  1476.387] (II) Applying OutputClass "AMDgpu" options to /dev/dri/card2
[  1476.387] (==) modeset(G0): RGB weight 888
[  1476.387] (==) modeset(G0): Default visual is TrueColor
[  1476.387] (II) Loading sub module "glamoregl"
[  1476.387] (II) LoadModule: "glamoregl"
[  1476.387] (II) Loading /usr/lib/xorg/modules/libglamoregl.so
[  1476.387] (II) Module glamoregl: vendor="X.Org Foundation"
[  1476.387] 	compiled for 1.21.1.7, module version = 1.0.1
[  1476.387] 	ABI class: X.Org ANSI C Emulation, version 0.4
[  1476.394] (EE) 
[  1476.395] (EE) Backtrace:
[  1476.397] (EE) 0: /usr/lib/xorg/Xorg (OsLookupColor+0x188) [0x5555b82fc668]
[  1476.397] (EE) unw_get_proc_info failed: no unwind info found [-10]
[  1476.397] (EE) 
[  1476.398] (EE) Bus error at address 0x7ffec3a78080
[  1476.398] (EE) 
Fatal server error:
[  1476.398] (EE) Caught signal 7 (Bus error). Server aborting
[  1476.398] (EE) 
[  1476.398] (EE)

[geerlingguy]

I grabbed Coreforge's memcpy library:

wget https://gist.githubusercontent.com/Coreforge/91da3d410ec7eb0ef5bc8dee24b91359/raw/b4848d1da9fff0cfcf7b601713efac1909e408e8/memcpy_unaligned.c

gcc -shared -fPIC -o memcpy.so memcpy_unaligned.c
sudo mv memcpy.so /usr/local/lib/memcpy.so
sudo nano /etc/ld.so.preload

# Put the following line inside ld.so.preload:
/usr/local/lib/memcpy.so

That got much further with wayfire...

II 23-11-23 12:57:46.203 - [backend/drm/drm.c:1553] Found connector 'DVI-D-1'
II 23-11-23 12:57:46.203 - [backend/drm/drm.c:1614] connector HDMI-A-3: Requesting modeset
II 23-11-23 12:57:46.203 - [src/core/output-layout.cpp:1098] new output: HDMI-A-3
II 23-11-23 12:57:46.203 - [src/core/output-layout.cpp:537] loaded mode auto
II 23-11-23 12:57:46.231 - [backend/drm/drm.c:734] connector HDMI-A-3: Modesetting with 1920x1080 @ 60.000 Hz
(type equals variant: [type: string, value: toplevel] | (type equals variant: [type: string, value: x-or] & focusable equals variant: [type: bool, value: 1]))
type equals variant: [type: string, value: overlay]
false
false
false
app_id equals variant: [type: string, value: Kodi]
(type equals variant: [type: string, value: toplevel] & floating equals variant: [type: bool, value: 1])
II 23-11-23 12:57:46.288 - [backend/drm/drm.c:1502] Scanning DRM connectors on /dev/dri/card1
II 23-11-23 12:57:46.290 - [backend/drm/drm.c:1553] Found connector 'HDMI-A-1'
II 23-11-23 12:57:46.294 - [backend/drm/drm.c:1553] Found connector 'HDMI-A-2'
EE 23-11-23 12:57:46.294 - [types/wlr_cursor.c:875] Cannot map device "smart-kvm Multifunction USB Device" to output (not found in this cursor)
EE 23-11-23 12:57:46.294 - [types/wlr_cursor.c:875] Cannot map device "pwr_button" to output (not found in this cursor)
EE 23-11-23 12:57:46.294 - [types/wlr_cursor.c:875] Cannot map device "vc4-hdmi-0" to output (not found in this cursor)
EE 23-11-23 12:57:46.294 - [types/wlr_cursor.c:875] Cannot map device "vc4-hdmi-1" to output (not found in this cursor)
EE 23-11-23 12:57:46.296 - [render/allocator/gbm.c:147] gbm_bo_create failed
EE 23-11-23 12:57:46.296 - [render/swapchain.c:109] Failed to allocate buffer

startx also got further... but I'm not sure what's up, it just ends up not rendering a display through the RX 460 at the point I run it (the system is not locked up however).

To fix that, make sure you enable "Fix up misaligned multi-word loads and stores in user space" when recompiling the kernel:

Kernel Features
  -> Kernel support for 32bit EL0
    -> Fix up misaligned multi-word loads and stores in user space

[geerlingguy]

On the site now: https://pipci.jeffgeerling.com/cards_gpu/xfx-radeon-rx460-4gb.html

[Coreforge]

Was there anything in dmesg when running wayfire or x11?
I saw you had some issues compiling in #6. compat_alignment.c might only get compiled if Kernel Features -> Kernel support for 32bit EL0 -> Fix up misaligned multi-word loads and stores in user space is enabled (I should probably move the code into a separate file, as that option is disabled by default).
There might be something in newer mesa versions that doesn't get entirely fixed by the memcpy library that's now causing issues with startx as well, as I could get that running before without additional alignment in the kernel. Wayfire was triggering the alignment trap a few times though, so that currently won't work without it. If it's still getting stuck somewhere (with the alignment trap), dmesg will likely get spammed full of essentially the same error over and over again. I'd need at least the Faulting instruction: and ideally the Load/Store: op0.... line if it's there as well to add the relevant instruction(s). I'm currently just adding them as I encounter issues, as there are quite a lot of load/store instructions on arm64.
My card has 4gb of vram as well, so that's not an issue.

[geerlingguy]

@Coreforge - indeed, after enabling that flag, I can compile (with a number of warnings), rebooting now...

Running wayfire-pi, while the environment initializes, I see:

[   40.300504] Alignment fixup
[   40.300510] Faulting instruction: 0xa9001444
[   40.300513] Load/Store
[   40.300515] Load/Store: op0 0xa op1 0x0 op2 0x2 op3 0x0 op4 0x1
[   40.300517] Storing 8 bytes (pair: 1) to 0x7fff5056016c
[   40.309090] Alignment fixup
[   40.309098] Faulting instruction: 0xa9000c22
[   40.309101] Load/Store
[   40.309102] Load/Store: op0 0xa op1 0x0 op2 0x2 op3 0x0 op4 0x3
[   40.309105] Storing 8 bytes (pair: 1) to 0x7fff50568e7c
[   41.159727] Alignment fixup
[   41.159732] Faulting instruction: 0xa9001444
[   41.159735] Load/Store
[   41.159737] Load/Store: op0 0xa op1 0x0 op2 0x2 op3 0x0 op4 0x1
[   41.159739] Storing 8 bytes (pair: 1) to 0x7fff5056056c
[   41.289474] Alignment fixup
[   41.289486] Faulting instruction: 0xa9001444
[   41.289490] Load/Store
[   41.289491] Load/Store: op0 0xa op1 0x0 op2 0x2 op3 0x0 op4 0x1

When I clicked on the Pi menu, I saw:

[   41.289494] Storing 8 bytes (pair: 1) to 0x7fff5056096c
[  132.284968] Alignment fixup
[  132.284976] Faulting instruction: 0xa9001444
[  132.284980] Load/Store
[  132.284983] Load/Store: op0 0xa op1 0x0 op2 0x2 op3 0x0 op4 0x1

When I opened up Chromium there were maybe 30 or so fixups.

I ran glmark2 and it was spitting out hundreds (?) of fixups per second—certainly a huge number was running through. It seemed to fail during [ideas], but it got through a bit before doing so... getting over 2,000 fps during a number of tests.

It did give the GPU some work, though!

Not enough to kick in the internal fans it seems... I think they work :P (the fun of testing used hardware...).

The last time I installed Minecraft on a Pi I just used Pi-Apps — is there a preferred place where you grab it?

[Coreforge]

Were there a bunch of fixup messages in dmesg without theStoring %d bytes message when glmark failed? (they might get mixed up a bit, but if it's getting stuck on an instruction, there should be a lot of other messages without that one)
The fans were occasionally spinning up on my card, but not very much, so depending on the fan curve, cooler, and power profile on your card it might just not get warm enough with these loads.
I'm just running minecraft from a technic install where I replaced the native libraries with arm versions and echoed out the actual launch command (since the launcher would otherwise overwrite the libraries again with x86 versions). I think some launchers directly support arm now, but I haven't tried any in a while.

[qwertychouskie]

SuperTuxKart ox max settings would probably be a good benchmark for these cards, as it's arm64 native, OpenGL/GLES based, and in the Raspbian repos.

[geerlingguy]

A few notes:

• Fans spin up (slowly then fast briefly) at boot, so at least I know they work :)
• Haven't tried games yet, but SuperTuxKart on high would be good to see, for sure (cc @qwertychouskie)
• For some reason the mouse cursor disappears once I move the mouse at all. Makes using the GUI a bit fun :D (Does this happen to you too @Coreforge? ah... I see it did)
• I've pasted below the last few dozen messages from my last failed glmark2 run:

[  564.557038] Faulting instruction: 0xf8226865
[  564.557039] systemd-journald[2049]: /dev/kmsg buffer overrun, some messages lost.
[  564.557039] Load/Store
[  564.557041] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557043] Alignment fixup
[  564.557044] Faulting instruction: 0xf8226865
[  564.557046] Load/Store
[  564.557047] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557049] Alignment fixup
[  564.557051] Faulting instruction: 0xf8226865
[  564.557052] Load/Store
[  564.557053] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557055] Alignment fixup
[  564.557057] Faulting instruction: 0xf8226865
[  564.557058] Load/Store
[  564.557059] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557062] Alignment fixup
[  564.557063] Faulting instruction: 0xf8226865
[  564.557064] Load/Store
[  564.557065] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557068] Alignment fixup
[  564.557069] Faulting instruction: 0xf8226865
[  564.557071] Load/Store
[  564.557072] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557074] Alignment fixup
[  564.557075] Faulting instruction: 0xf8226865
[  564.557077] systemd-journald[2049]: /dev/kmsg buffer overrun, some messages lost.
[  564.557078] Load/Store
[  564.557146] Load/Store: op0 0xf op1 0x0 op2 0x0 op3 0x22 op4 0x2
[  564.557254] systemd-journald[2049]: /dev/kmsg buffer overrun, some messages lost.
[  564.560311] Alignment fixup
[  564.560317] Faulting instruction: 0xa9001444
[  564.560320] Load/Store
[  564.560321] Load/Store: op0 0xa op1 0x0 op2 0x2 op3 0x0 op4 0x1
[  564.560324] Storing 8 bytes (pair: 1) to 0x7fff3831296c
[  564.760582] systemd[1]: Started systemd-journald.service - Journal Service.

It was stuck on [ideas] both times I think. (The blue wireframey wavey one)

[geerlingguy]

This thread may get a little more activity, I just posted a video: You can use external GPUs on the Raspberry Pi 5.