Zenaique
Topics
Practice
Browse
Reference
Challenges
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Sinusoidal Pe
Sinusoidal Pe
Subtopic
2 questions
Questions tagged with Sinusoidal Pe — part of Attention Mechanism.
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through Vaswani 2017's sinusoidal positional encoding, what's the formula and what property does it give?
Short Answer
Hard
·
Qual 4.0
What's the practical tradeoff between learned and sinusoidal positional embeddings?
Multiple Choice
Medium
·
Qual 4.0
Microsoft