ReleaseCohereCoherepublished Aug 15, 2024seen 5d

cohere-ai/tokenizers v0.7.1

cohere-ai/tokenizers

Open original ↗

Captured source

source ↗
published Aug 15, 2024seen 5dcaptured 8hhttp 200method plain

v0.7.1

Repository: cohere-ai/tokenizers

Tag: v0.7.1

Published: 2024-08-15T19:26:23Z

Prerelease: no

Release notes: Following: https://github.com/daulet/tokenizers/releases/tag/v0.7.1

> # What's Changed > > - Update core tokenizers library to latest: v0.15.2; > - Expose init time parameter to encode special tokens (or not); >

Notability

notability 2.0/10

Routine library release