Word Level

Character, word, and subword tokenization each have a dominant failure mode. Match them.

Explain why word-level and character-level tokenization both fail for modern LLMs, and how subword tokenization resolves each failure mode.