Analysis of the US pipeline incidents since Jan 2010
-
Updated
Dec 11, 2017 - Jupyter Notebook
Analysis of the US pipeline incidents since Jan 2010
Finds the skew that makes your Spark jobs list. Reads the event logs Spark already writes: stragglers with their cause (hot key vs slow node), spill, GC pressure, priced in drag seconds. No Spark install needed; 600MB logs parsed in 4s.
Add a description, image, and links to the spill topic page so that developers can more easily learn about it.
To associate your repository with the spill topic, visit your repo's landing page and select "manage topics."