Skip to content

Commit 909a0ce

Browse files
yuxianqruodil
authored andcommitted
[https://nvbugs/5442608][fix] Update CUDA graph config for get_model_yaml_config. (NVIDIA#6693)
Signed-off-by: Yuxian Qiu <[email protected]> Co-authored-by: ruodil <[email protected]> Signed-off-by: Wangshanshan <[email protected]>
1 parent 72c9963 commit 909a0ce

File tree

1 file changed

+8
-8
lines changed

1 file changed

+8
-8
lines changed

tests/integration/defs/perf/pytorch_model_config.py

Lines changed: 8 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -159,14 +159,14 @@ def get_model_yaml_config(model_label: str,
159159
'llama_v4_maverick_17b_128e_instruct_fp8'
160160
],
161161
'config': {
162-
'use_cuda_graph':
163-
True,
164-
'cuda_graph_padding_enabled':
165-
True,
166-
'cuda_graph_batch_sizes': [
167-
1, 2, 4, 8, 16, 32, 64, 128, 256, 384, 512, 1024, 2048,
168-
4096, 8192
169-
]
162+
'cuda_graph_config': {
163+
'enable_padding':
164+
True,
165+
'batch_sizes': [
166+
1, 2, 4, 8, 16, 32, 64, 128, 256, 384, 512, 1024, 2048,
167+
4096, 8192
168+
]
169+
}
170170
}
171171
}
172172
]

0 commit comments

Comments
 (0)