Igor #15
Open
Igor #15
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…st symmetric (n-k)::n::n+0.1
…ations. Starting version of MLP at jumps analysis.
…s to move to analysis structure.
… change is needed to use data in [batch_size, seq_len] format (changes in Block, Decoder, etc.
…ring of circuits from main loop has problems sometimes because of dict(obj).get(key, {}) in helpers.analyze_{evolution,*} methods because dictobj is NoneType sometimes.
…rossLevelDetector. Not yet fully integrated and tested
…its are found in ablation manner using ExampleSampler to choose small number of examples each time. Main train_with_enhanced_token_analysis_with_registration updated.
…nced_canonical_circuits.py main train loop. Circuit detection together with task-based circuits analysis. pytorch based fast sampler implemented.
…ers with canonical ids. Finished phase 1.
…hole code reorganized and compacted. Ready for new analyzers circuit finding, i.e., weight space and mlp-sparsity.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Merge the igor branch with master