cohere-ai/tokenizer v1.1.2
cohere-ai/tokenizer
Captured source
source ↗published Feb 7, 2023seen 5dcaptured 13hhttp 200method plain
v1.1.2
Repository: cohere-ai/tokenizer
Tag: v1.1.2
Published: 2023-02-07T19:53:30Z
Prerelease: no
Release notes:
Changelog
- 495b650 Stop ignoring case in the pre-tokenizer. (#39)