Topics PracticeChallenges Pricing

Zenaique

Personalized AI interview prep. Structured questions across every GenAI sub-discipline. Practice, score, master.

Practice

Topics
Daily practice
Challenges
Dashboard

Browse

Formats
Roles
Companies
Top questions

Product

Pricing
Sign in

© 2026 Zenaique

Topics/Transformer Architecture/Activation Functions

Activation Functions

Subtopic1 questions

Questions tagged with Activation Functions — part of Transformer Architecture.

Sort

Questions

Defend the 4x FFN expansion ratio, then explain why SwiGLU breaks the simple rule
Short AnswerMedium·Qual 4.0

Master this topic

Daily practice mixes topics. Topic specific drill is a Pro feature.