Curated
Top 25 GenAI Interview Questions
Here are the top 25 GenAI interview questions on Zenaique, sorted by community quality and rating count. Each links to a detailed answer covering reasoning, tradeoffs, and follow-up questions. Browse the full library →
Sorted by community quality, ties broken by rating count then easier first.
- 01Explain scaled dot-product attention.Short AnswerMedium·Qual 4.8
- 02What is the KV cache in transformer inference?FlashcardEasy·Qual 4.7
- 03What is RLHF, and why is it used after pretraining?Multiple ChoiceMedium·Qual 4.7
- 04What does LoRA do, and why is it popular for fine-tuning?Multiple ChoiceMedium·Qual 4.7
- 05In LLM serving, what is the primary driver of end to end latency for a generation request?Multiple ChoiceHard·Qual 4.7
- 06Which metric best measures whether a RAG answer is grounded in the retrieved context?Multiple ChoiceMedium·Qual 4.7
- 07Design a RAG evaluation harness, what do you measure and how?Short AnswerHard·Qual 4.7
- 08When should you fine-tune instead of using RAG?Short AnswerMedium·Qual 4.6
- 09Explain why transformers replaced RNNs for language modeling.Short AnswerMedium·Qual 4.6
- 10What does RAG primarily help with in LLM-based applications?Multiple ChoiceEasy·Qual 4.6OpenAI
- 11Why combine BM25 with dense embeddings for retrieval?Multiple ChoiceEasy·Qual 4.6
- 12PPO vs DPO, what's the practical difference?FlashcardMedium·Qual 4.6
- 13What is the Model Context Protocol (MCP) and what problem does it solve?Multiple ChoiceEasy·Qual 4.6
- 14What distinguishes an AI agent from a plain LLM call?Multiple ChoiceMedium·Qual 4.5
- 15Which components make up a standard transformer block?Multiple ChoiceEasy·Qual 4.5
- 16Which of these are valid concerns when using LLM-as-judge for evaluation?Multi-selectMedium·Qual 4.5
- 17HNSW vs IVF, when do you pick each for a production vector index?FlashcardMedium·Qual 4.5
- 18How does MCP differ from OpenAI-style function calling?FlashcardMedium·Qual 4.5
- 19Match each vector index type to its primary characteristic.Match PairsMedium·Qual 4.5
- 20Describe the typical agent execution loop.Short AnswerMedium·Qual 4.4
- 21Which of these are valid considerations when choosing a chunking strategy for RAG?Multi-selectMedium·Qual 4.4
- 22Estimate the per-call cost of a typical RAG chatbot using GPT-4o-mini.FlashcardMedium·Qual 4.4
- 23Why is cosine similarity preferred over Euclidean distance for text embeddings?FlashcardEasy·Qual 4.4
- 24Why does BPE tokenization use subwords instead of words or characters?FlashcardEasy·Qual 4.4
- 25What is the primary purpose of embeddings in modern NLP?Multiple ChoiceEasy·Qual 4.3
Related top picks
By experience level
By topic
Top 25 Inference Optimization Interview Questions→Top 25 Fine-Tuning Interview Questions→Top 25 LLM Evaluation Interview Questions→
By role