Replicate

Does FlashAttention change the attention output relative to standard attention?

Flash-Decoding parallelizes an axis FlashAttention v2 left alone. Pick which one.

Why is causal attention cheaper than full bidirectional at the same length?

Name two production KV-cache eviction policies and what each prioritizes

Encoder self-attention versus decoder self-attention, what is the single structural difference at the mask level?

Match each transformer family to the kind of attention it uses

Inside a T5-style encoder-decoder, which sub-layer reads the encoder outputs, and through which projection?

Translating one source sentence into many target languages, what attention-side trick scales?

Walk through how a token's d_model embedding is split into per-head pieces inside multi-head attention.

Where inside the attention sub-layer is dropout typically applied during training, and what does dropping there teach the model?