Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Tokenization/Bos

Bos

Subtopic3 questions

Questions tagged with Bos — part of Tokenization.

Premium questions for this topic

Sort

Questions

BOS, EOS, PAD: why do tokenizers reserve these ids instead of using normal text?
FlashcardEasy
What are BOS, EOS, PAD, and role marker special tokens, and what happens when each is missing or duplicated?
FlashcardEasy
What failure mode occurs when a developer duplicates the BOS token by prepending it manually while also using apply_chat_template?
Short AnswerHard

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Ai21 Tata Digital

Hugging Face Tata Digital