Topics Practice Study

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Attention Mechanism/Attention Sink

Attention Sink

Subtopic6 questions

Questions tagged with Attention Sink — part of Attention Mechanism.

Premium questions for this topic

Sort

Questions

Which token most often serves as an attention sink in pretrained autoregressive LLMs?
Multiple ChoiceEasy
Why not just retrain models to eliminate attention sinks entirely?
Short AnswerMedium
Name two production KV-cache eviction policies and what each prioritizes
Short AnswerMedium
Find the bug: a Llama deployment serves traffic without prepending the BOS token.
Spot the ErrorMedium
Spot the errors in this KV eviction strategy for long running generation
Spot the ErrorHard
Why does naive sliding window KV eviction break and how does StreamingLLM's attention sink fix it?
Short AnswerHard

Study answers

Read the beginner answer for every question in this topic.

Study beginner answers

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.

Adobe Freshworks

Flowise Infosys

Microsoft Pinterest

Oracle Robinhood