ReleaseCohereCoherepublished Jan 28, 2022seen 5d

cohere-ai/tokenizer v1.0.2

cohere-ai/tokenizer

Open original ↗

Captured source

source ↗
GH
GitHub/github.com/cohere-ai/tokenizer
cohere-ai/tokenizer v1.0.2
Source ↗
published Jan 28, 2022seen 5dcaptured 8hhttp 200method plain

v1.0.2

Repository: cohere-ai/tokenizer

Tag: v1.0.2

Published: 2022-01-28T21:57:49Z

Prerelease: no

Release notes:

Changelog

  • aefd15c WordSplit public bc ocean needs it (#29)
  • ec3b62a changed name -- was confusing bc another file has BPE and this one has bPE (#28)