Padding Mask

At which step in the attention pipeline does the mask take effect?

A batch packs a causal LM with left padded sequences and applies only the causal mask. Spot the mistake.

What does a padding mask zero out, and why is it needed when batching variable length sequences?

Name the additive bias term in attention and the two things it most commonly carries.