Mistral's blog says 49 billion active parameters, its docs say 52 billion

T2Covered by 1 source · first reported by UploadVR / Road to VR / MIXED at 07 Oct, 04:45 UTC

Mistral published Mistral Large 4 on 6 October and gave it two different sizes on the same day. The announcement calls it "a 1 trillion-parameter natively multimodal model with 49 billion active parameters", while the model's documentation page, dated 6 October as well, says it "features 52B active…

iottelecomxr

Sources

• T2Mistral's blog says 49 billion active parameters, its docs say 52 billionUploadVR / Road to VR / MIXED07 Oct, 04:45