Skip to content

Pull requests: karpathy/minbpe

New pull request New
24 Open 37 Closed
24 Open 37 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

add parallel tokenizer
#99 opened Sep 20, 2025 by NinjaKelly Loading…
1
Extract best-pair selection from _encode_chunk into find_best_pair() for clarity
#97 opened Aug 7, 2025 by manoogim Loading…
add lexicographic ordering for breaking ties to make the tokenizer deterministic
#90 opened Sep 21, 2024 by dapopov-st Loading…
Add pyproject toml
#89 opened Sep 17, 2024 by gianlucagiudice Loading…
updating stats across merge to reduce computation
#88 opened Sep 1, 2024 by imdaredevil Loading…
Update README.md
#86 opened Jul 1, 2024 by wenming-ma Loading…
Optimal algorithm for _encode_chunk(): 20% faster encoding, with 0.5% better COMPRESSION
#84 opened Jun 17, 2024 by Majdoddin Loading…
Deduplication of text chunks with frequency count, training and encoding 5x speedup enhancement New feature or request
#82 opened Jun 8, 2024 by Majdoddin Loading…
4
calling len(ids) in merge() function only once to increase performance
#76 opened May 14, 2024 by crpatil1901 Loading…
Link to Mojo port added
#75 opened May 14, 2024 by dorjeduck Loading…
Count only nonoverlapping occurences of a pair
#72 opened May 6, 2024 by Majdoddin Loading…
Update regex.py to correctly parse scripts with combining marks
#71 opened May 5, 2024 by ajaykg Loading…
5
Updated decode() method in GPT4Tokenizer so that it handles special t…
#63 opened Apr 7, 2024 by Vakarva Loading…
Handle error when running out of pairs to merge
#54 opened Mar 6, 2024 by vinhdq842 Loading…
updated self.vocab initialization and reuse self._build_vocab()
#53 opened Mar 2, 2024 by muerghq Loading…
Video2Post Generation Workflow
#49 opened Feb 26, 2024 by xihajun • Draft
8 of 17 tasks
3
Update lecture.md based on video tutorial content from 08:15 through 28:23
#42 opened Feb 23, 2024 by astaff Loading…
Automating testing using github actions
#41 opened Feb 22, 2024 by nobleaustine Loading…
Use pyproject.toml, pdm and ruff for improved reproducibility and cleaner code
#40 opened Feb 22, 2024 by nizhib Loading…
Create setup.py
#39 opened Feb 22, 2024 by Biswajit2902 Loading…
1
Train BasicTokenizer on GPU with PyTorch, 100x speedup
#38 opened Feb 22, 2024 by kuprel Loading…
5
Fix small typos
#34 opened Feb 21, 2024 by ggaughan Loading…
1
Simplify generation of printable representation
#26 opened Feb 21, 2024 by SultanOrazbayev Loading…
2
Batch encoding decoding
#22 opened Feb 20, 2024 by ezzaldeeen Loading…
2
ProTip! Add no:assignee to see everything that’s not assigned.