Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Sinusoidal Pe
Sinusoidal Pe
Subtopic
2 questions
Questions tagged with Sinusoidal Pe — part of Attention Mechanism.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through Vaswani 2017's sinusoidal positional encoding. What's the formula? What property does it give the model?
Short Answer
Hard
What's the practical tradeoff between learned and sinusoidal positional embeddings?
Multiple Choice
Medium
Google
Haptik
Jane Street
Microsoft