Spot the Error

Spot the bug: a junior engineer's conversational RAG implementation produces nonsense retrievals on turn 3+. Find the error in the retrieval logic.

Spot the error in this description of SFT loss masking

Spot the bug in this sequence-packing setup

Spot the bug: a Llama-3 fine-tune that skips the end-of-turn token

Spot the errors in this tensor-core utilization claim

Spot the errors in this stop-sequence configuration recommendation

Spot the errors in this claim about speculative decoding

Spot the errors in this KV-eviction strategy for long-running generation

Spot the errors in this explanation of input vs output pricing

Spot the errors in this 'optimize decode by reducing FLOPs' proposal

Spot the errors in this description of continuous batching

Spot the errors in this 'API is slow because of network and tokenizer' explanation

Spot the errors in this 'batching is universal' claim

Spot the error in this code that slices a string to respect a 100-token limit.

Spot the error: 'BPE tokenizers can produce [UNK] when they encounter rare words'

Spot the failure mode: a tokenizer trained with NFC normalization is deployed with an NFKC preprocessing pipeline.

Spot the tokenization boundary bug in this manual prompt-building code.

Spot the error: 'BPE finds the globally optimal vocabulary by iteratively merging the most frequent pair.'

Spot the augmentation config bug in this production RAG YAML that's causing 'lost in the middle' faithfulness regressions on long-context queries.

Spot what's wrong with this prompt: 'You are a helpful assistant. Please be thorough and accurate. Give a good answer.'

Spot the directive-design flaw in this customer-support system prompt that's producing inconsistent behavior despite seemingly-clear instructions.

Spot the injection vulnerabilities in this production prompt template.

Spot the issue with this production prompt template that adds Chain-of-Thought to every customer-support query, including simple fact-lookup ones.

Spot the error in how this MCP server reports a tool failure

Spot the error in this multi-server MCP host configuration