Apache Spark, you may have heard, performs faster than Hadoop MapReduce in Big Data analytics. An open source technology commercially stewarded by Databricks Inc., Spark can “run programs up to 100x faster than Hadoop MapReduce in memory, or 10x faster on disk,” its main project site states.

Those claims aren’t readily attributed on the main site, but the Spark FAQ further states “it has been used to sort 100TB of data 3X faster than Hadoop MapReduce on 1/10th of the machines, winning the 2014 Daytona GraySort Benchmark.

Source: adtmag.com
Author: David Ramel