Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Transformer Architecture
/
Swiglu
Swiglu
Subtopic
3 questions
Questions tagged with Swiglu — part of Transformer Architecture.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Pick the recipe a 2026 frontier open-weight LLM block actually ships
Multiple Choice
Medium
·
Qual 4.0
Defend the 4x FFN expansion ratio, then explain why SwiGLU breaks the simple rule
Short Answer
Medium
·
Qual 4.0
Match GPT-2 versus Llama-2 attention design choices to their differences
Match Pairs
Medium
·
Qual 4.0