Spark isn’t perfect, but what is these days? Learn about the good and the bad that Spark has to offer. If you’re looking for a solution for processing huge chucks of data, […]
Apache Spark: Promises and Challenges
Achieving a 300% Speedup in ETL With Apache Spark
Large or frequent file dumps can slow the ingest pipeline down. See how Cloudera combated this to achieve a 300% speedup instead. A common design pattern often emerges when teams begin to […]
This Week in Hadoop: NiFi, Sparkling Water, Ambari, and Spark
This week’s round-up of interesting big data technologies from Spark to NiFi with some microservices thrown in for modern data application development. Learn about how to rapidly iterate data applications, while reusing […]
Spark fragmentation undermines community
The Hadoop distribution war comes down to a final battle between Cloudera’s CDH and Hortonworks’ HDP. That wasn’t always the case. At the peak of the market’s fragmentation, many companies offered Hadoop […]
Spark Summit Preview, Tableau Comes To Android: Big Data Roundup
The Spark Summit heads to San Francisco. Tableau is bringing its mobile client to Android. Microsoft Ventures eyes machine learning startups. We have all this and more in our Big Data Roundup […]
Is Spark Overhyped?
There’s no doubt that the Apache Spark phenomena has taken the big data world by storm. But can the technology actually deliver according to the tremendous hype that is accompanying it, or […]
How Spark and Hadoop Are Advancing Cancer Research
The combination of Spark and Hadoop has supercharged big data analysis across many industries and use cases by lowering the barrier of entry to advanced analytics and thereby enabling data scientists to […]
Big Data Benchmark: Google Cloud Dataflow Beats Apache Spark
Big Data consultancy Mammoth Data today published a benchmark study that shows Google’s Cloud Dataflow service outperforms the extremely popular open source data processing engine, Apache Spark. Google hired the company to […]
What Spark’s Structured Streaming really means
Thanks to an impressive grab bag of improvements in version 2.0, Spark’s quasi-streaming solution has become more powerful and easier to manage Last year was a banner year for Spark. Big names […]
More Organizations Kicking the Tires of Spark As Data Tool of Choice
One would obviously expect Hadoop to dominate the discussions at the recent Strata & Hadoop World conference in San Jose, CA. But much of the buzz this year was around Apache Spark, […]
BI Corner 