Io Foundations

Sequence length vs context window, what is the practical distinction and which one drives KV cache size?

Walk through what actually happens during the prefill phase of an LLM forward pass.

Define LLM inference and explain how it differs from training.