Skip to content

Commit e3cf182

Browse files
committed
fix ngram
Signed-off-by: Enwei Zhu <[email protected]>
1 parent 441d405 commit e3cf182

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tensorrt_llm/_torch/speculative/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -141,7 +141,7 @@ def get_spec_drafter(model_engine,
141141

142142
if spec_config.spec_dec_mode.is_ngram():
143143
return NGramDrafter(spec_config,
144-
spec_resource_manager=spec_resource_manager,
144+
ngram_pool_manager=spec_resource_manager,
145145
guided_decoder=guided_decoder)
146146

147147
return None

0 commit comments

Comments
 (0)