Author: Dhirendra Sinha – “A product enthusiast”.
Metadata and its challenges
The term metadata was coined in 1969 by Jack E. Myers for his Metamodel product line. The term got quickly endorsed and found its use in computer world with the most popular definition of “Data about data”.
However, metadata in its true form must be robust and complete and it should also go beyond just defining data.
There are various touchpoints which lead to metadata generation –
The question still remains, why is it important to have robust metadata?
With the data size becoming huge and varied, organizations for exposing this information need to have metadata curated and defined suitably to become data driven organizations.
Here are some potential challenges organizations face while doing metadata governance in Data Lake:
The absence of common repository – There is a dearth of single repository which captures the entire metadata of the environment.
No common business vocabulary – It becomes difficult for business users and IT to maintain consistency of information across different channels.
‘Who’ and ‘What’ – Answering who is doing what on the environment, and keeping a track from accountability perspective is the need of the hour.
Impact Analysis – It requires a lot of effort for the IT team to see the impact of a proposed change and understand cross-table dependencies.
Keeping track of rules and inferences – It becomes difficult for businesses to keep a track of the rules and the inferences drawn by analysts.
So, the need today is to have one self-service, scalable enterprise solution which can be a one stop solution to all these challenges.
eCat answers these challenges being a single platform for seamless enterprise metadata management.
In my next blog, I will be covering details about the product i.e. eCat and its enterprise benefits!!