Skip to content

Error Node Fixes#76

Merged
hannamw merged 1 commit intomainfrom
release/20260114-071736
Jan 14, 2026
Merged

Error Node Fixes#76
hannamw merged 1 commit intomainfrom
release/20260114-071736

Conversation

@hannamw
Copy link
Collaborator

@hannamw hannamw commented Jan 14, 2026

Fixes two bugs:

  • Error nodes for skip transcoders were computed without accounting for the skip connection, resulting in inflated errors
  • Error nodes for gemma-3 instruct models were only being zeroed out at position 0, rather than at the first 4 positions (corresponding to the 4 static BOS-adjacent tokens that their transcoders were not trained on)

Squashed changes from error-vector-fix branch.
@hannamw hannamw merged commit e09b5f3 into main Jan 14, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant