Hotfix: Set float32 as default dtype for testing tiny models#4770

albertvillanova merged 2 commits into

huggingface:mainhuggingface/trl:mainfrom

albertvillanova:fix-4748albertvillanova/trl:fix-4748Copy head branch name to clipboard