Fix stop string matching for byte-fragment tokens#46530

Rocketknight1 merged 1 commit into

huggingface:mainhuggingface/transformers:mainfrom

Incheonkirin:fix-stop-string-byte-fragmentsIncheonkirin/transformers:fix-stop-string-byte-fragmentsCopy head branch name to clipboard