Making LLMs lighter with AutoGPTQ and transformers

ai

Sources