Building a SentencePiece-Style Unigram Tokenizer in Pure Python
A practical guide to implementing a unigram tokenizer with EM training and Viterbi segmentation, demonstrating systems engineering skills for your portfolio.
EM-Algorithm
A practical guide to implementing a unigram tokenizer with EM training and Viterbi segmentation, demonstrating systems engineering skills for your portfolio.