Apple ran Meta's 816B Muse Spark Open on four Mac Studios at over 36 tokens a second

T2Covered by 1 source · first reported by UploadVR / Road to VR / MIXED at 17 Oct, 00:23 UTC

Apple has run Muse Spark Open, an 816-billion-parameter model from Meta with 42 billion parameters active at a time, across four Mac Studios and measured over 36 tokens a second. Apple’s machine learning researchers say the model "cannot fit on a single machine", and their figures put four M5 Ultra…

aiiotsciencetelecomxr

Sources

• T2Apple ran Meta's 816B Muse Spark Open on four Mac Studios at over 36 tokens a secondUploadVR / Road to VR / MIXED17 Oct, 00:23