Overview

Why is data management important?
Overview - Data Management

Summary

  • Data science has never been as much about machine learning as it has about cleaning, shaping, and moving data from place to place.

  • Here are the important concepts in data management:

    • Sources - how to get training data

    • Labeling - how to label proprietary data at scale

    • Storage - how to store data and metadata appropriately

    • Versioning - how to update data through user activity or additional labeling

    • Processing - how to aggregate and convert raw data and metadata