When Can LLMs Replace Humans in A/B Tests?

T1Covered by 1 source · first reported by Stripe / Shopify Eng / Netflix TechBlog / Dropbox Tech / Slack Eng / Spotify Eng at 13 Aug, 18:57 UTC

TL;DR: LLM predictions can stand in for human outcomes in A/B tests, but only by assumption, not by design.... The post When Can LLMs Replace Humans in A/B Tests? appeared first on Spotify Engineering.

ai

Sources

• T1When Can LLMs Replace Humans in A/B Tests?Stripe / Shopify Eng / Netflix TechBlog / Dropbox Tech / Slack Eng / Spotify Eng13 Aug, 18:57