Padding Mask

At which step in the attention pipeline does the mask actually take effect?

A batch packs a causal LM with right-padded sequences and applies only the causal mask. Spot the mistake.

What does a padding mask zero out, and why is it needed when batching variable-length sequences?

Name the additive bias term in attention and the two things it most commonly carries.