ForkCoreWeaveCoreWeavepublished Feb 10, 2023seen 6d

coreweave/gpt_bpe

forked from wbrown/gpt_bpe

Open original ↗

Captured source

source ↗
published Feb 10, 2023seen 6dcaptured 8hhttp 200method plain

coreweave/gpt_bpe

Description: GPT2 Byte Pair Encoding implementation in Golang

Language: Go

License: LGPL-2.1

Stars: 0

Forks: 0

Open issues: 1

Created: 2023-02-10T16:13:58Z

Pushed: 2024-12-13T22:08:31Z

Default branch: main

Fork: yes

Parent repository: wbrown/gpt_bpe

Archived: no

README: gpt-bpe ======= An implementation of GPT2 Byte Pair Encoding Encoder/Decoder in golang. Generally very fast, bottlenecked by the regex engine for whitespace separation.