Head Pruning

Head-pruning studies report that many attention heads can be removed with negligible loss. Pick the correct interpretation.

Why does multi-head attention outperform a single large attention head?

What has interpretability research shown about individual attention heads in trained transformers?