So spree_auth_devise already patches Spree::Admin::BaseController#unauthorized such that unauthorized actions go to the backend login form.
However, when the authorization failures come from exceptions from CanCan's authorize! method, spree calls a method named redirect_unauthorized_access. So if you access certain backend features, you might be redirected to the frontend login instead.
Maybe a alias_method :redirect_unauthorized_access, :unauthorized in the admin_controller_decorator would already fix this.