It’s hard to believe, but the first Hadoop cluster went into production at Yahoo 10 years ago. What began as an experiment in distributed computing for an Internet search engine has turned into a global phenomenon and a focal point for a big data ecosystem driving billions in spending.
Here are some thoughts on the big yellow elephant’s milestone from the people involved in Hadoop’s early days. Hadoop’s story started before January 2006, of course. In the early 2000s, Doug Cutting, who created the Apache Lucene search engine, was working with Mike Cafarella to build a more scalable search engine called Nutch.
Author: Alex Woodie