Zen and the Art of Storage Services at Pinterest
Raghavendra Prabhu, engineering manager for the infrastructure team at Pinterest, walks through their new storage product, Zen. Built at Pinterest, Zen was originally conceived in summer 2013 and since then has grown to be one of the thier most widely used storage solutions, powering the home feed, interest graph, messages, news and other key features.
In this talk, RVP goes over the design motivation for Zen and describes its internals including the API, type system and HBase backend. He also discusses their learnings from running the system in production over the last year and a half, the features added and performance improvements made to accommodate the fast adoption we have seen since launch.
This talk was given at SF Data Engineering meetup at Galvanize in San Francisco.