STYLE: Add code check to avoid returning Exceptions instead of raising

[phofl]

We want to check that we don't return Exceptions instead of raising them.

see #48833

@mroeschke @jbrockmendel