Apache Kafka at Wikimedia

Andrew Otto, Systems Engineer at Wikimedia Foundation, talks about the analytics cluster at Wikimedia that allows them to support ~20 billion page views a month (Kafka, Hadoop, Hive, etc). Andrew shares how and why they chose to go with Kafka (scalable log transport) and how they've implemented Kafka with four brokers, a custom-built producer and kafkatee and Camus as their consumers.


This talk was given at the Apache Kafka NYC meetup at Yodle.

We have many more articles on Apache Kafka. Check out our collection of top 12 tech talks on Apache Kafka.