cohere-ai/tokenizers v0.8.0
cohere-ai/tokenizers
Captured source
source ↗published Aug 15, 2024seen 5dcaptured 10hhttp 200method plain
v0.8.0
Repository: cohere-ai/tokenizers
Tag: v0.8.0
Published: 2024-08-15T19:39:55Z
Prerelease: no
Release notes: Following: https://github.com/daulet/tokenizers/releases/tag/v0.8.0
> # Breaking change: > Path to compiled rust library needs to be specified via -ldflags. I found it most convenient to use CGO_LDFLAGS env variable to avoid always setting it. See https://github.com/daulet/tokenizers/pull/18 for more details. > > # What's Changed > Update to allow for platform dependent libs in CGO
Notability
notability 3.0/10Minor tokenizer library release