How are Data Engineering & Data Science related (if at all)? Which has good scope in the future?
If you landed here from LinkedIn, then you probably have the right context! Let's continue on the topic directly: As per my understanding and experience in #datafield so far, data like a software has lifecycle! 🚲 Few stages: i) Inception (collection of data from disparate systems e.g., transactional systems, sensors, etc.) ii) Collection (the generated data is collected through different methods and stored at a place) iii) Cleaning (generally the data collected isn’t processing ready hence some sort of preparation is required) iv) Processing (using various business logics and/or logical transformations the data is processed so that it gives out some information) v) Presenting (the well-processed data is then presented using various dashboarding tools/techniques e.g., Tableau, Power-BI) vi) Intelligence (using the data, the machine learning models are built which can identify patterns and predict the future patterns using mathematical/statistical methods) ...
