Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

T1Covered by 1 source · first reported by Hugging Face Blog at 16 Oct, 01:44 UTC

Sources

• T1Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation PipelineHugging Face Blog16 Oct, 01:44