Thanks for your effort with this fork, it's so much faster. It's not clear to me which encoding is being used, is it cl100k_base or r50k_base?
According to this link, gpt-3-encoder is using r50k_base, but I don't see any mention of it in the library.
Thanks for your effort with this fork, it's so much faster. It's not clear to me which encoding is being used, is it
cl100k_baseorr50k_base?According to this link,
gpt-3-encoderis usingr50k_base, but I don't see any mention of it in the library.