Posts

How are Data Engineering & Data Science related (if at all)? Which has good scope in the future?

If you landed here from LinkedIn, then you probably have the right context! Let's continue on the topic directly:   As per my understanding and experience in #datafield so far, data like a software has lifecycle! 🚲 Few stages: i) Inception (collection of data from disparate systems e.g., transactional systems, sensors, etc.) ii) Collection (the generated data is collected through different methods and stored at a place) iii) Cleaning (generally the data collected isn’t processing ready hence some sort of preparation is required) iv) Processing (using various business logics and/or logical transformations the data is processed so that it gives out some information) v) Presenting (the well-processed data is then presented using various dashboarding tools/techniques e.g., Tableau, Power-BI) vi) Intelligence (using the data, the machine learning models are built which can identify patterns and predict the future patterns using mathematical/statistical methods)   ...

Web 3.0!!! What is it?? Why should we learn about it??

Image
  Hey There, Welcome again to my blog! 😊   In this blog, we will try to learn about this buzzword called …yeah, you guessed it right, “Web 3.0”! 😂   Simply put "Web 3.0 is internet decentralized!"   You might say, "Sanket, last time you wrote something about decentralized data architecture...amm what was that...yeah...Data Mesh! (Check: https://paradiseofanintrovert.blogspot.com/2022/02/data-mesh-is-it-here-to-kill-data.html ) Is it like these days we need to apply this 'decentralized' term everywhere....like literally everywhere??" 😅   Well..your question is apt and we shall try to understand more on this new term for sure!     So, what exactly is Web 3.0???   🤔🤔       I tried to do a Brave search on this and look what I found:   So..there is no clear explanation for this!!!?? How do we understand about it then??? “Wait…what??? You did a Brave search??? Don’t we normally do a Goog...

Data Mesh : Is it here to kill Data Engineering jobs???? 😦🤔

Image
Hey There, 🖐 Welcome again to my blog!! 😁 Today I want to talk about something I came across recently. The term is known as Data Mesh!  The folks from networking field would probably relate it to mesh topology where each node in any network is directly connected other node.🤓 "Is it the same concept applied to Data or more specifically Data Warehousing, Sanket?" you might ask. Well, let's try to decode and learn about this new concept which was coined by Zhamak Dehghani from thoughtworks for better handling of data in our warehouses.  Mind you, this is still evloving and we may need to catch up with it in order to be updated(like any other field! 😅). What is Data Mesh?? Data Mesh is applying decentralization in our traditional warehousing methods in order to have data as a product(DaaP) for individual domains. Another way to put it would be:   "Much in the same way that software engineering teams transitioned from monolithic applications to microservice architectu...

What did I learn while trying to run 2 e-commerce stores(closed) in Dropshipping model?

Image
  Hey There, Welcome to my blog! 😊 In this blog, I am trying to share what all things I came across while trying to run an e-commerce store(twice!) and what I learned from it.   What is Dropshipping model that you mentioned in the title, Sanket? Okay…so, for those who are not aware about it already, dropshipping is a business model to run e-commerce business with the least amount of risk. Basically, we don’t have to manage any inventory in order to have this type of e-commerce biz. “Then, who will have the inventory and how will it be managed?” you might ask! Here, we simply connect the suppliers of any product with the customer of that product. Essentially, we run a website where people come and select the products that they like/want, and we get them shipped to their home with the help of the supplier. What is Dropshipping? Okay..so now that we know what is dropshipping, let’s continue our discussion.   Now, the question would be “ How can one sta...

Entering into the exciting world of DataScience!!

Image
“An investment in knowledge pays the best interest”                                                                                       - Benjamin Franklin   Hey There, First of all A Very Happy and Prosperous New Year!! 🎉 We all want multi-fold returns on our investment! Don't we??! So, here I've tried to uncover a strategy which can help us to do so! :) Last weekend, I got a chance to sit down on a call with, Himanshu, a good friend from TCS ILP days, hereafter referred to as HSP, who recently switched into a Product based firm as a Data Scientist, to get some information around how was he able to do this and what all things helped him along the way!  Here are th...

Continuing on the Cryptos

Image
  Hii... So, let's continue our discussion on #cryptos and learn about some other coins..shall we? :P These days whenever, there is a mention of BitCoin, Ethereum comes up and if we talk about Ethereum, one other coin comes up...which is Solana! or what it is usually referred to as 'Ethereum Killer'! So,  what is Solana ? It is another blockchain which uses Smart Contracts as Ethereum, but it is faster compared to the Classic Ethereum because of using it achieves consensus using proof of stake and proof of history. Its internal cryptocurrency is SOL. Okay.. "but what is proof of history?" you might ask.! "Proof of History is a sequence of computation that can provide a way to cryptographically verify passage of time between two events. It uses a cryptographically secure function written so that output cannot be predicted from the input, and must be completely executed to generate the output." Reference:  https://tokens-economy.gitbook.io/consensus/chain-...