Topics PracticeChallenges Pricing

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Daily practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Tokenization/Tiktoken Encodings

Tiktoken Encodings

Subtopic3 questions

Questions tagged with Tiktoken Encodings — part of Tokenization.

Sort

Questions

What happens to emoji ZWJ sequences under cl100k_base vs. o200k_base pre-tokenization?
Short AnswerHard·Qual 4.0OpenAI
What is the primary purpose of regex-based pre-tokenization in cl100k_base, and what constraint does it impose on BPE?
Multiple ChoiceMedium·Qual 4.0
What does the '200k' in o200k_base signify, and what was improved compared to cl100k_base?
Multiple ChoiceMedium·Qual 4.0

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.