Taobao's MNN Team Open-Sources MNN-Pocket-0.3B, a 173MB On-Device Model Built for Phone Apps

T2Covered by 1 source · first reported by China: SCMP Tech / TechNode / Pandaily / KrASIA / Sixth Tone at 06 Nov, 07:45 UTC

Alibaba's MNN team at Taobao open-sourced MNN-Pocket-0.3B, a 173MB INT4 on-device model it says decodes about 350 tokens per second offline on an iPhone 18 Pro.