TopicsInference OptimizationAn engineer says 'FP8…MCQ·Hard·Asked atArize AiNVIDIATwo SigmaNextNext questionWhat is the KV cache in transformer inference?Flashcard·EasyPrevSkipNext