Llama3 video fix

[sywangyi]

• vision models: @yonigozlan @molbap
• CIs: @ydshieh

when running tests/models/video_llama_3/test_modeling_video_llama_3.py::VideoLlama3IntegrationTest all fail cause by lm_head.weight is missing.

[ydshieh]

@zucchini-nlp

The current failure (on main) is from

Untangle config inheritance (#41541)

For this PR, it fixed the CI, but I don't know if it's the best / correct way.

Could you check, taking the above context.

[sywangyi]

this issue still exists in the latest main, will you consider merging the PR @ydshieh @zucchini-nlp ?

[zucchini-nlp]

Thanks for the ping, notifications in gh get lost sometimes 🫠

I'll trigger a slow CI and will merge

[zucchini-nlp]

run-slow: video_llama_3

[github-actions]

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/video_llama_3"]
quantizations: []

[github-actions]

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	fb0e325e	workflow commit (merge commit)
PR	8d065d33	branch commit (from PR)
main	9120f5e4	base commit (on main)

Model CI Report

❌ 2 new failed tests from this PR 😭

• video_llama_3:
  tests/models/video_llama_3/test_modeling_video_llama_3.py::VideoLlama3IntegrationTest::test_small_model_integration_test_batch_different_resolutions (❌ ⟹ ❌)
  tests/models/video_llama_3/test_modeling_video_llama_3.py::VideoLlama3IntegrationTest::test_small_model_integration_test_batch_wo_image (❌ ⟹ ❌)

[zucchini-nlp]

I will fix it on your behalf by checking inside CI runners, looks like a diff due to hardware

[github-actions]

[For maintainers] Suggested jobs to run (before merge)

run-slow: video_llama_3

[zucchini-nlp]

run-slow: video_llama_3

[github-actions]

Workflow Run ⚙️

This comment contains run-slow, running the specified jobs:

models: ["models/video_llama_3"]
quantizations: []

[github-actions]

CI Results

Workflow Run ⚙️

Commit Info

Context	Commit	Description
RUN	8378b609	workflow commit (merge commit)
PR	7f19a358	branch commit (from PR)
main	223fe523	base commit (on main)

✅ No failing test specific to this PR 🎉 👏 !

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.