cohere-ai/tokenizers v0.7.1
cohere-ai/tokenizers
Captured source
source ↗published Aug 15, 2024seen 5dcaptured 8hhttp 200method plain
v0.7.1
Repository: cohere-ai/tokenizers
Tag: v0.7.1
Published: 2024-08-15T19:26:23Z
Prerelease: no
Release notes: Following: https://github.com/daulet/tokenizers/releases/tag/v0.7.1
> # What's Changed > > - Update core tokenizers library to latest: v0.15.2; > - Expose init time parameter to encode special tokens (or not); >
Notability
notability 2.0/10Routine library release