Hello, I want to load the training_arg.bin of zephyr-7b-beta and pass it to DPOTrainer of trl to compute the implicit rewards and logps conveniently, but it seems lack some private modules.
import torch
training_args = torch.load("training_args.bin")
ModuleNotFoundError: No module named 'h4'
Hello, I want to load the
training_arg.binof zephyr-7b-beta and pass it toDPOTraineroftrlto compute the implicit rewards and logps conveniently, but it seems lack some private modules.ModuleNotFoundError: No module named 'h4'