Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Llama 2
Llama 2
Subtopic
3 questions
Questions tagged with Llama 2 — part of Attention Mechanism.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
What are the typical head counts and head dimensions for modern 7B models?
Fill in Blank
Easy
How many KV heads does Llama-2 70B keep with 64 query heads?
Multiple Choice
Easy
What does GQA stand for, and describe its KV sharing pattern?
Flashcard
Easy
Ai4bharat
Flowise
Droom
Mistral AI
Tesla
Wandb