Zenaique
Topics
Practice
Study
Browse
Reference
Pricing
Search…
⌘K
Topics
/
Attention Mechanism
/
Memory
Memory
Subtopic
7 questions
Questions tagged with Memory — part of Attention Mechanism.
Premium questions for this topic
Format
Difficulty
Role
Experience
Companies
Sort
Default
Quality
Difficulty ↑
Difficulty ↓
Questions
Premium
What did LangChain fix…
Multiple Choice
Medium
Why did LangChain replace ConversationBufferMemory with session-keyed history stores?
Flashcard
Medium
Premium
Why is treating LangChain…
Short Answer
Medium
Across which of these axes is the KV cache stored: per layer, per head, per batch, or all three?
Flashcard
Easy
How does vocabulary size affect embedding table memory footprint at bfloat16 precision, and what are the tradeoffs of very small vs. very large vocabularies?
Short Answer
Hard
Compute the KV cache memory for a single request at 4096 context on Llama-2 70B (MHA) in FP16.
Predict Output
Hard
How is a RAG vector store used as an external long term memory layer inside an agent?
Short Answer
Medium
Modal Labs
Notion
Ironclad
Lambda Labs
Sambanova
Sarvam
Amd
Baidu
Coinbase
Google
Autodesk
Hugging Face
Siemens
Together Ai