Subword Tokenization

2026 1:03:31
Synopsis
Slides: https://docs.google.com/presentation/d/1pgQq3AXy67Teayoe0ZyRu8Rjy8SKffwpX0o8M0IRC1M/edit?usp=sharing.

You Might Also Like

SDS 626: Subword Tokenization with Byte-Pair Encoding — with @JonKrohnLearns​ 6:21
Sds 626: Subword Tokenization With Byte-pair Encoding — Wi...
2023
NLSea - Subword Tokenization - handling multilingual data and mispellings 50:15
Nlsea - Subword Tokenization - Handling Multilingual Data An...
2020
Subword-based tokenizers 3:29
Subword-based Tokenizers
2022
Subword Tokenization: Byte Pair Encoding 19:30
Subword Tokenization: Byte Pair Encoding
2021
LLM Tokenizers Explained: BPE Encoding, WordPiece and SentencePiece 5:14
Llm Tokenizers Explained: Bpe Encoding, Wordpiece And Senten...
2025
310 - Understanding sub word tokenization used for NLP 32:16
310 - Understanding Sub Word Tokenization Used For Nlp
2024
How Does Subword Tokenization Work In NLP? - AI and Machine Learning Explained 2:58
How Does Subword Tokenization Work In Nlp? - Ai And Machine ...
2026
Byte Pair Encoding Tokenization 5:23
Byte Pair Encoding Tokenization
2022
Optimizing Word Alignments with Better Subword Tokenization - MT Summit 2021 33:14
Optimizing Word Alignments With Better Subword Tokenization ...
2022
Tokenization Strategies in NLP: Word-based vs Character-based vs Subword 4:59
Tokenization Strategies In Nlp: Word-based Vs Character-base...
2026
Let's build the GPT Tokenizer 2:13:35
Let's Build The Gpt Tokenizer
2025
Download Options
Choose a download method below. All links open in new tabs.
Service Features Action
Ssvid
MP4 & MP3 • HD Quality • Browser Extension Available
Download
SaveFrom
MP4 & MP3 • HD Quality • Browser Extension Available
Download
Security Notice: These are third-party services. We recommend using antivirus software and being cautious of pop-up ads.