Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Transformer Architecture
/
Parameter Counting
Parameter Counting
Subtopic
2 questions
Questions tagged with Parameter Counting — part of Transformer Architecture.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Which sublayer of a dense transformer block carries more parameters, attention or FFN?
Multiple Choice
Easy
·
Qual 4.0
Estimate the trainable param count for a Llama-3 8B LoRA at r=16 targeting all-linear modules.
Predict Output
Medium
·
Qual 4.0