Skip to content

[Transformers v5] SarvamMLAForCausalLM #38734

@hmellor

Description

@hmellor

This is a sub-issue forming part of the work in #38379, please read the description of this issue before beginning to work on this one.

Which test is failing?

As of huggingface/transformers#41250 the ignore_keys argument to validate_rope was removed in favour of ClassVars (ignore_keys_at_rope_validation) attached to the config classes themselves.

$ pytest tests/models/test_initialization.py::test_can_initialize_large_subset[SarvamMLAForCausalLM]
...
TypeError: RotaryEmbeddingConfigMixin.validate_rope() got an unexpected keyword argument 'ignore_keys'

How to configure my environment?

It's very important that you install both vLLM and Transformers from source so that your test results reflect the current state of both libraries.

# Or your fork
git clone https://github.com/huggingface/transformers.git
git clone https://github.com/vllm-project/vllm.git

cd vllm
VLLM_USE_PRECOMPILED=1 uv pip install -e .
uv pip install -e ../transformers

Metadata

Metadata

Assignees

Labels

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions