Chat Templates

How does the serving stack actually decide when to stop generation and what bugs come from mis-set stop sequences?

What are BOS, EOS, PAD, and role marker special tokens, and what happens when each is missing or duplicated?

Fill in the blanks: the special tokens that control sequence boundaries and conversation structure in modern LLMs.

What are the practical differences between the sentencepiece library and HuggingFace tokenizers for serving a Llama model, and which is recommended?

For serving a Llama model in production with HuggingFace transformers, which tokenizer library is recommended?

Spot the tokenization boundary bug in this manual prompt-building code.

What failure mode occurs when a developer duplicates the BOS token by prepending it manually while also using apply_chat_template?

Why must developers use a model's specific apply_chat_template() rather than building the prompt string manually?