The great data science hope: Machine learning can cure your terrible data hygiene

Data lakes didn’t quite pan out so now it’s all about an abstraction layer and machine learning to save the day. Hopefully, machine learning can cleanse your data on the fly since humans have proved repeatedly they aren’t meticulous enough.

Will there ever be a technology that can fix decades of poor data hygiene? Probably not, but that isn’t going to stop technology vendors from trying. The good news: Machine learning may come closest to saving your data management hide. Data hygiene isn’t easy. You can’t hire enough interns to even come close to rectifying past mistakes. The reality is enterprises haven’t been creating data dictionaries, meta data and clean information for years.

Author: Larry Dignan


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s