Decoder Only

Modern LLM fine-tuning defaults to causal LM or masked LM, pick one and say why

Translating one source sentence into many target languages, what attention-side trick scales?

Decoder-only LLMs ship without a cross-attention sub-layer, so where does the context go?

Which modern LLM architecture uses cross-attention?