Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Sinusoidal Pe
Sinusoidal Pe
Subtopic
2 questions
Questions tagged with Sinusoidal Pe — part of Attention Mechanism.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Newest
Quality
Difficulty ↑
Difficulty ↓
Questions
Walk through Vaswani 2017's sinusoidal positional encoding, what's the formula and what property does it give?
Short Answer
Hard
What's the practical tradeoff between learned and sinusoidal positional embeddings?
Multiple Choice
Medium
Google
Haptik
Jane Street
Microsoft