the "spark.redis.auth" parameter always authenticates against the default user. There should be a parameter to authenticate against other users.