Skip to content

Commit 7288b72

Browse files
committed
Update max seq len
Signed-off-by: Michal Guzek <[email protected]>
1 parent 57f82eb commit 7288b72

File tree

3 files changed

+3
-3
lines changed

3 files changed

+3
-3
lines changed

tests/integration/defs/accuracy/references/gsm8k.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -171,6 +171,6 @@ microsoft/Phi-4-multimodal-instruct:
171171
microsoft/Phi-4-multimodal-instruct-long-rope:
172172
- accuracy: 75.85
173173
microsoft/Phi-4-mini-instruct:
174-
- accuracy: 75.00
174+
- accuracy: 82.30
175175
LGAI-EXAONE/EXAONE-4.0-32B:
176176
- accuracy: 88.36

tests/integration/defs/accuracy/references/mmlu.yaml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -226,7 +226,7 @@ nvidia/Nemotron-H-56B-Base-8K:
226226
kv_cache_quant_algo: FP8
227227
accuracy: 83.82
228228
microsoft/Phi-4-mini-instruct:
229-
- accuracy: 65.00
229+
- accuracy: 68.98
230230
# Created a dummy accuracy to track tp_size=2 for phi4-mini model.
231231
# TODO: update once https://nvbugs/5393849 is fixed.
232232
microsoft/Phi-4-mini-instruct-tp2:

tests/integration/defs/accuracy/test_llm_api_pytorch.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2303,7 +2303,7 @@ class TestPhi4MiniInstruct(LlmapiAccuracyTestHarness):
23032303
MODEL_PATH = f"{llm_models_root()}/Phi-4-mini-instruct"
23042304

23052305
def test_auto_dtype(self):
2306-
with LLM(self.MODEL_PATH) as llm:
2306+
with LLM(self.MODEL_PATH, max_seq_len=4096) as llm:
23072307
task = CnnDailymail(self.MODEL_NAME)
23082308
task.evaluate(llm)
23092309
task = MMLU(self.MODEL_NAME)

0 commit comments

Comments
 (0)