Lecture 8: The Gpt Tokenizer: Byte Pair Encoding

2025 53:35
Synopsis
In this lecture, we will learn about Byte Pair Encoding: the tokenizer which powers modern LLMs like GPT-2, GPT-3 and GPT-4.
Download Options
Choose a download method below. All links open in new tabs.
Service Features Action
Ssvid
MP4 & MP3 • HD Quality • Browser Extension Available
Download
SaveFrom
MP4 & MP3 • HD Quality • Browser Extension Available
Download
Security Notice: These are third-party services. We recommend using antivirus software and being cautious of pop-up ads.