SCRIPT-bpe
hey,
here we'll be experimenting a novel a tokenization scheme introduced by Cohere labs in there paper : BPE stays on SCRIPT.
script is actually a recursive acronym (in the paper)!
teaser:
the complete post will be out soon!
hey,
here we'll be experimenting a novel a tokenization scheme introduced by Cohere labs in there paper : BPE stays on SCRIPT.
script is actually a recursive acronym (in the paper)!
teaser:
the complete post will be out soon!