In the previous article, we discussed how to maintain the overall quality of a big data company by categorizing the following items: Collection, Unified structure, Processing, Delivery, Pruning
We already covered collection and unified structure, so now we will dive into the rest. Processing Processing data is the most critical part of any big data company. The ability to process data at scale and be resilient to failures can make a significant contribution to the overall quality of a company. One thing many businesses dismiss, which happens to be important to this process, is having separate environments.
Author: Reza Qorbani