D Model

Define d_model and name three architecture knobs that scale with it

Compare hidden_size, d_model, and embedding_dim, three names for the same thing or three different things?

Pick the formula that defines head_dim from hidden_size and num_heads.

Modern 7B-class LLMs, fill in typical head counts and the resulting per-head dimension

If d_model = 768 and num_heads = 12, what is d_head?