Skip to content

Commit 651a730

Browse files
RdoubleAebsmothers
authored andcommitted
Fix qwen2 config (#1620)
1 parent 0dae85f commit 651a730

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

recipes/configs/qwen2/7B_full_single_device.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -60,7 +60,7 @@ optimizer_in_bwd: True
6060
loss:
6161
_component_: torchtune.modules.loss.CEWithChunkedOutputLoss
6262
max_steps_per_epoch: null
63-
gradient_accumulation_steps: 16
63+
gradient_accumulation_steps: 1
6464
compile: False
6565

6666
# Training environment

0 commit comments

Comments
 (0)