Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Tokenization/Unicode

Unicode

Subtopic6 questions

Questions tagged with Unicode — part of Tokenization.

Premium questions for this topic

Sort

Questions

Before the tokenizer even starts splitting, normalization runs. What does it do and why?
FlashcardEasy
What happens to emoji ZWJ sequences under cl100k_base vs. o200k_base pre-tokenization?
Short AnswerHard
PremiumSpot the failure mode:…
Spot the ErrorHard
Which Unicode normalization does BERT's tokenizer apply, and how does it differ from NFC?
Multiple ChoiceMedium
Predict how many tokens the rainbow flag emoji 🏳️‍🌈 uses in a byte level BPE tokenizer with no emoji in training data.
Predict OutputMedium
How does byte level BPE guarantee no unknown tokens, and what is the cost of that guarantee?
FlashcardEasy

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Bain Salesforce

Accenture Decagon