[fsdp] feat: support fsdp2 training and inference in fsdp_workers#1026

Merged

PeterSH6 merged 11 commits into

verl-project:mainfrom

lxg2015:main_fsdp2_meta_tensor_1

May 2, 2025

Commits on May 1, 2025

support fsdp2

lxg2015
authored and
lixiaoguang12
committed
fsdp2 load full state dict only on rank 0

lxg2015
authored and
lixiaoguang12
committed
fix indentation
lixiaoguang12
committed
inspect fsdp wrap layer with _no_split_module

lxg2015
authored and
lixiaoguang12
committed
fsdp2 support cpu_offload_policy mode

lxg2015
authored and
lixiaoguang12
committed
remove DTensor check for fsdp2

lxg2015
authored and
lixiaoguang12
committed
expose reshard_after_forward for fsdp2

lxg2015
authored and
lixiaoguang12
committed
fix pre_commit

lxg2015
authored and
lixiaoguang12
committed
add exp record at ppo.rst

lxg2015
authored and
lixiaoguang12
committed

Commits on May 2, 2025