When you need to execute code on a cluster of machines, deciding which machine should run that code becomes a complex problem, known as scheduling. We're all familiar with routing problems, such as the recent RapGenius incident. It turns out that simple improvements to randomized routing can dramatically improve performance! Sparrow is a distributed scheduling algorithm for low latency, high throughput workloads.

Continue