cohere-ai/tokenizer v1.0.2
cohere-ai/tokenizer
Captured source
source ↗published Jan 28, 2022seen 5dcaptured 8hhttp 200method plain
v1.0.2
Repository: cohere-ai/tokenizer
Tag: v1.0.2
Published: 2022-01-28T21:57:49Z
Prerelease: no
Release notes:
Changelog
- aefd15c WordSplit public bc ocean needs it (#29)
- ec3b62a changed name -- was confusing bc another file has BPE and this one has bPE (#28)