The Lifecycle of LLM-as-a-Judge: Building, Aligning, and Monitoring at scale
By Emma Yanyang Kong, JJ Tan, Ishan Gupta, Lars Olds, Claire Campbell, David Fagnan, Ratna Kavuri, Rohan Gosain, Veli Balin, Minsu Jang, Louis Garcia Introduction Any team generating text with an LLM at scale hits the same problem. You cannot evaluate everything manually. You don't know which…
Sources
- T1The Lifecycle of LLM-as-a-Judge: Building, Aligning, and Monitoring at scaleStripe / Shopify Eng / Netflix TechBlog / Dropbox Tech / Slack Eng / Spotify Eng