Your team is comparing a vanilla LLM chatbot against a RAG chatbot. What is the single most important difference between them at query time?

The right answer is B. The defining difference between a **RAG chatbot** and a vanilla LLM chatbot is the retrieval step that happens before generation. When a user asks a vanilla chatbot a question, the query goes straight to the LLM. The model answers from whatever it learned during pretraining, which is frozen, possibly out of date, and contains nothing about your private documents. When a user asks a RAG chatbot, the system first turns the query into an embedding, searches a vector index of pre-embedded document chunks, and fetches the top-k most similar chunks. Those chunks are then passed to the LLM in the prompt along with the query. The model still produces the answer, but now it has fresh, relevant, private context to base it on. It can also cite which chunk each claim came from. The model itself is the same in both cases. Nothing got fine-tuned or retrained. The only change is what shows up in the prompt at query time.

The defining difference is the **retrieval step** that a RAG chatbot inserts between the user query and the LLM call. A vanilla chatbot routes the query directly to the model and gets an answer drawn from the model's parametric memory. That memory is whatever was baked into the weights during pretraining: frozen, possibly stale, and containing zero private information. A RAG chatbot adds one operation in between. The query is embedded and an approximate nearest neighbor search runs against a vector index of pre-embedded document chunks. The top-k most relevant chunks are fetched and inserted into the prompt as context alongside the query. The same LLM, unchanged and unfine tuned, now answers from a prompt that contains fresh, relevant, private material. This is what option C gets wrong, and it is the most common confusion in interviews. RAG does not fine-tune anything. Fine-tuning modifies model weights and is a separate mechanism with its own tradeoffs. RAG never touches the weights. It is purely a prompt-time augmentation that hands the model evidence to ground its answer in. The consequence is that RAG handles recency, privacy, and citation, all without any change to the underlying model. Recency means new docs are indexed, not retrained. Privacy means your corpus stays in your index. Citation means the chunk numbers are right there in the prompt.