TopicsInference OptimizationWhy is 'reduce FLOPs…Short answer·Medium·Asked atAdaCognizantNVIDIANextNext questionWhat is the KV cache in transformer inference?Flashcard·EasyPrevSkipNext