Baidu Open-Sources ERNIE-5.5-Flash-Base, a 280B MoE Base Model With 14B Active Parameters

T2Covered by 1 source · first reported by China: SCMP Tech / TechNode / Pandaily / KrASIA / Sixth Tone at 06 Nov, 01:57 UTC

Baidu released ERNIE-5.5-Flash-Base, a raw pretraining checkpoint with 280B total and 14B active parameters, 128K training context and 1M-token support, for further training.

releases

Sources

• T2Baidu Open-Sources ERNIE-5.5-Flash-Base, a 280B MoE Base Model With 14B Active ParametersChina: SCMP Tech / TechNode / Pandaily / KrASIA / Sixth Tone06 Nov, 01:57