Optimizing Speculative Execution in Spark Heterogeneous Environments
Abstract: Slow tasks in Spark computing environments extend stage execution time. Spark uses speculative execution to solve the straggler problem by launching extra backup for the straggler to finish early. The Spark original and improved…