LineNrAbove/Below Not Applying LineNr

[alex-courtis]

Discussed in #2640

^{Originally posted by TroySigX January 23, 2024}
Before this commit e9c5abe, my column for relative number (left-most column) will look like this:

But after, it look like this:

How can I change the color of the this column to be like before?

P.S: I'm using tokyonight.nvim colorscheme