coreweave/gpt_bpe
forked from wbrown/gpt_bpe
Captured source
source ↗published Feb 10, 2023seen 6dcaptured 8hhttp 200method plain
coreweave/gpt_bpe
Description: GPT2 Byte Pair Encoding implementation in Golang
Language: Go
License: LGPL-2.1
Stars: 0
Forks: 0
Open issues: 1
Created: 2023-02-10T16:13:58Z
Pushed: 2024-12-13T22:08:31Z
Default branch: main
Fork: yes
Parent repository: wbrown/gpt_bpe
Archived: no
README: gpt-bpe ======= An implementation of GPT2 Byte Pair Encoding Encoder/Decoder in golang. Generally very fast, bottlenecked by the regex engine for whitespace separation.