Skip to content

Commit 48768fd

Browse files
authored
fix: Fix missing key (#6471)
Signed-off-by: Zero Zeng <[email protected]>
1 parent aee35e2 commit 48768fd

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tensorrt_llm/serve/scripts/benchmark_serving.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -475,6 +475,7 @@ async def limited_request_func(request_func_input, streaming, pbar,
475475
"user_throughput": metrics.tput_user,
476476
"mean_request_ar": metrics.mean_request_ar,
477477
"median_request_ar": metrics.median_request_ar,
478+
"std_request_ar": metrics.std_request_ar,
478479
"input_lens": [output.prompt_len for output in outputs],
479480
"output_lens": actual_output_lens,
480481
"ttfts": [output.ttft for output in outputs],

0 commit comments

Comments
 (0)