Lepton AI

What does the dot product q . k measure inside an attention layer?

Decode the acronym MHA in the transformer attention context.

Along which axis of the QK^T score matrix is softmax applied inside attention?

Design an LLM judge prompt with anchor examples and explain how they reduce score variance

What is short term memory in an agent, and where does it live?

Match MLA, GQA and MQA to their mechanisms, cache reduction and quality posture

Match each RAG failure symptom to the pipeline layer to investigate first

What exactly does the KV cache store and what computational redundancy does it eliminate?

Which config token names the count of parallel attention heads in a layer?

How does the ChatGPT style cross-session memory differ from within session rolling summary?