How Rent the Runway Evolved a Sustainable Data Pipeline for Ecommerce

Anna Smith from Rent the Runway talks about how they've evolved their data pipeline over time to deal with infrastructure constraints, disparate data sources, and changing data sources/quality all while still serving reports and data back to the website with minimal downtime. Anna also covers how they leveraged Luigi to ensure robust reporting without forcing non-technical analysts to learn Python.


This video was recorded at the NYC Data Engineering meetup at Spotify in NYC.