Skip to content

Commit f35504f

Browse files
committed
Add explanation comment
Signed-off-by: Tomer Asida <[email protected]>
1 parent 3e646eb commit f35504f

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

tensorrt_llm/_torch/models/checkpoints/hf/weight_mapper.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -59,6 +59,7 @@ def should_skip_module(self, module_name: str) -> bool:
5959
def _duplicate_kv_weights(self, module: nn.Module, new_name: str,
6060
weights: dict):
6161
if new_name in ['k_proj', 'v_proj']:
62+
# k_proj and v_proj shape is [num_kv_heads*head_dim, hidden_dim]
6263
num_kv_heads = weights['weight'].shape[0] // self._head_dim
6364
processed_weights = {
6465
k:

0 commit comments

Comments
 (0)