Teaching Sidekick to say no: automated data curation with LLM judge consensus

T1Covered by 1 source · first reported by Stripe / Shopify Eng / Netflix TechBlog / Dropbox Tech / Slack Eng / Spotify Eng at 15 Jun, 19:30 UTC

Production training data only captures successful queries; it can't teach a model when to say no. We built an automated curation pipeline using LLM judge consensus to close that gap.

ai

Sources

• T1Teaching Sidekick to say no: automated data curation with LLM judge consensusStripe / Shopify Eng / Netflix TechBlog / Dropbox Tech / Slack Eng / Spotify Eng15 Jun, 19:30