Quoting Ted Sanders
In general, LLM performance is incredibly multidimensional. There's no guarantee of a fixed ordering where the model that is best at math is also the model that's best at jokes. Despite that complexity, much of the variation in performance is explained by just a single variable: model size. In…
Sources
- T2Quoting Ted SandersSimon Willison's Weblog