Predict Output

Predict the shape of recall and latency on an IVF index of 10M vectors as nprobe sweeps from 1 to 50.

Predict the trainable parameter count for a Llama-style 7B decoder block by block

Predict the typical layer count for a Llama 7B and a Llama 70B

Predict the break-even read count for Anthropic prompt caching given the 1.25x / 0.1x rates

Estimate the token tax a single tool round-trip adds compared with an inline answer

Estimate the trainable param count for a Llama-3 8B LoRA at r=16 targeting all-linear modules.

With max_grad_norm=1.0 and a raw gradient L2 of 12.5, what is the post-clip norm and scale factor?

For a causal mask over a 4-token sequence, what value sits at row 2, column 3?

Reference: 'The cat sat on the mat.' Generated: 'A feline rested on the rug.' Predict whether BLEU-4 will be close to 0 or close to 1, and explain why.

The same sentence in English, Spanish, Hindi, and Japanese. Predict the token ratio on o200k_base for each.

Predict the retrieval trace: how a multi-hop RAG agent answers a chained question that single-shot RAG would fail on.

Predict whether speculative decoding wins for given α, K, c

Predict supportable concurrent-user count under a 200k TPM rate limit

Predict the total cost of one Claude Sonnet API call with realistic token counts

Predict the KV cache size in GB for given model dimensions

Predict the bandwidth-vs-compute latency of a single Llama-70B decode step on H100

Predict the hardware cost vs gross margin for serving $15/M output tokens on H100

Predict the critical batch size where decode crosses from memory-bound to compute-bound on H100

Predict the throughput and per-request latency behaviour as batch size grows past saturation

Predict the arithmetic intensity of decode at varying batch sizes

Predict how cl100k_base tokenizes '1024', '2048', and '100000', and explain how inconsistent splitting causes LLM arithmetic failures.

Predict whether tokenizer.encode('world') and tokenizer.encode(' world') produce the same token IDs in tiktoken.

Predict the token count difference between 'def fibonacci(n):' and 'def f(n):' in cl100k_base.

Predict how many tokens the rainbow flag emoji 🏳️‍🌈 uses in a byte level BPE tokenizer with no emoji in training data.

Predict the approximate token count difference between 'Hello world' and its Arabic equivalent 'مرحبا بالعالم' in a GPT-4 tokenizer.