ModelBest Open-Sources MiniCPM-V 4.7, Its First MoE Multimodal Model, Running in 3GB on a Phone
ModelBest's MiniCPM-V 4.7 comes in 35B-A3B and 1B sizes. The MoE version decodes at over 13 tokens/s in about 3GB of memory on an iPhone 17 Pro Max, the company says.
Sources
- T2ModelBest Open-Sources MiniCPM-V 4.7, Its First MoE Multimodal Model, Running in 3GB on a PhoneChina: SCMP Tech / TechNode / Pandaily / KrASIA / Sixth Tone