Unlocking Longer Generation with Key-Value Cache Quantization

T1Covered by 1 source · first reported by Hugging Face Blog at 16 May 2024, 00:00 UTC