Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Llama 2
Llama 2
Subtopic
3 questions
Questions tagged with Llama 2 — part of Attention Mechanism.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Modern 7B class LLMs, fill in typical head counts and the resulting per head dimension
Fill in Blank
Easy
Llama-2 70B uses 64 query heads, how many KV heads does it actually keep?
Multiple Choice
Easy
GQA, decode the acronym and describe its KV sharing pattern
Flashcard
Easy
Accenture
Ai4bharat
Droom
Mistral AI
Accenture
Tesla