Running Apache Spark experiments in my sleep (and on a plane)
By Prashanth Gedde Narayanaswamy As one of Netflix’s largest and critical data pipelines, member-sessionizer consolidates tens of billions of hourly client events, encompassing user taps, playbacks, and engagement signals, into individual viewing sessions per profile. A quick two-week tuning effort…
Sources
- T1Running Apache Spark experiments in my sleep (and on a plane)Stripe / Shopify Eng / Netflix TechBlog / Dropbox Tech / Slack Eng / Spotify Eng