Curated · Senior / Staff
Top 100 Senior / Staff Interview Questions
Here are the top 18 AI interview questions for Senior / Staff candidates, sorted by community quality. Each entry links to a detailed answer with explanations, hints, and source-grade follow-ups. Browse all Senior questions →
Sorted by community quality · refreshed as new questions are published.
- 01Explain scaled dot-product attention.Short AnswerMedium·Qual 4.8
- 02What is the KV cache in transformer inference?FlashcardEasy·Qual 4.7
- 03What is RLHF, and why is it used after pretraining?Multiple ChoiceMedium·Qual 4.7
- 04What does LoRA do, and why is it popular for fine-tuning?Multiple ChoiceMedium·Qual 4.7
- 05In LLM serving, what is the primary driver of end to end latency for a generation request?Multiple ChoiceHard·Qual 4.7
- 06Which metric best measures whether a RAG answer is grounded in the retrieved context?Multiple ChoiceMedium·Qual 4.7
- 07Design a RAG evaluation harness, what do you measure and how?Short AnswerHard·Qual 4.7
- 08When should you fine-tune instead of using RAG?Short AnswerMedium·Qual 4.6
- 09PPO vs DPO, what's the practical difference?FlashcardMedium·Qual 4.6
- 10What is the Model Context Protocol (MCP) and what problem does it solve?Multiple ChoiceEasy·Qual 4.6
- 11What distinguishes an AI agent from a plain LLM call?Multiple ChoiceMedium·Qual 4.5
- 12Which of these are valid concerns when using LLM-as-judge for evaluation?Multi-selectMedium·Qual 4.5
- 13HNSW vs IVF, when do you pick each for a production vector index?FlashcardMedium·Qual 4.5
- 14How does MCP differ from OpenAI-style function calling?FlashcardMedium·Qual 4.5
- 15Match each vector index type to its primary characteristic.Match PairsMedium·Qual 4.5
- 16Describe the typical agent execution loop.Short AnswerMedium·Qual 4.4
- 17Which of these are valid considerations when choosing a chunking strategy for RAG?Multi-selectMedium·Qual 4.4
- 18Estimate the per-call cost of a typical RAG chatbot using GPT-4o-mini.FlashcardMedium·Qual 4.4
18 of 100 requested: only 18 published questions tagged for Senior / Staff so far.
Related top picks
Change experience level
By topic
Top 100 Inference Optimization Interview Questions→Top 100 Fine-Tuning Interview Questions→Top 100 LLM Evaluation Interview Questions→
By role