ReleaseCohereCoherepublished Feb 7, 2023seen 5d

cohere-ai/tokenizer v1.1.2

cohere-ai/tokenizer

Open original ↗

Captured source

source ↗
GH
GitHub/github.com/cohere-ai/tokenizer
cohere-ai/tokenizer v1.1.2
Source ↗
published Feb 7, 2023seen 5dcaptured 13hhttp 200method plain

v1.1.2

Repository: cohere-ai/tokenizer

Tag: v1.1.2

Published: 2023-02-07T19:53:30Z

Prerelease: no

Release notes:

Changelog

  • 495b650 Stop ignoring case in the pre-tokenizer. (#39)