Kiyoto Tamura Kiyoto Tamura on

Fluentd is an open source data collector started by Treasure Data, that helps simplify and scale log management. In this talk, Kiyoto Tamura, Director of Developer Relations at Treasure Data, Inc. gives an overview and demo of Fluentd and goes through its most popular use cases.

Continue
Alexis Lê-Quôc Alexis Lê-Quôc on

Imagine you are tasked with building a platform to monitor the performance of 500,000 servers in real-time. How would you design it? What tools would you choose? (Cassandra? Storm? Spark? HBase? ...) What technical challenges would you expect? As a monitoring company, Datadog receives tens of billions of telemetry data points every day and is working to change the way operations teams understand and troubleshoot their infrastructure and applications. In this talk, Alexis Lê-Quôc from Datadog talks about how they built their (Python-based) low-latency, real-time analytics pipeline. This talk was recorded at the NYC Data Engineering meetup at The Huffington Post.

Continue