Skip to main content

Metadata management


Metadata management is the administration of data that describes other data. It involves establishing policies and processes that ensure information can be integrated, accessed, shared, linked, analyzed and maintained to best effect across the organization.

Metadata is generated whenever data is created, acquired, added to, deleted from, or updated. For example, document metadata in Microsoft Word includes the file size, date of document creation, the name(s) of the author and most recent modifier, the dates of any changes and the total edit time. Further metadata can be added, including title, tags and comments.

The goal of metadata management is to make it easier for a person or program to locate a specific data asset. This requires designing a metadata repository, populating the repository and making it easy to use information in the repository.

Benefits of metadata management include:
  • Consistency of definitions of metadata so that terminology variations don't cause data retrieval problems.
  • Less redundancy of effort and greater consistency across multiple instances of data because data can be reused appropriately.
  • Maintenance of information across the organization that is not dependent on a particular employee's knowledge.
  • Greater efficiency, leading to faster product and project delivery.

When an organization is establishing policies to manage metadata, it is important for managers to gather together and agree upon a common data vocabulary and taxonomy. Intra-department variations should be addressed, and custom usages eliminated or replaced.

In some cases, the organization may choose to use a metadata repository that comes with a toolset already in use. For instance, ETL vendors offer metadata management applications for cataloging and managing ETL metadata, as well as metadata associated with source and target applications.

Comments

Popular posts from this blog

Black swan

A  black swan event  is an incident that occurs randomly and unexpectedly and has wide-spread ramifications. The event is usually followed with reflection and a flawed rationalization that it was inevitable. The phrase illustrates the frailty of inductive reasoning and the danger of making sweeping generalizations from limited observations. The term came from the idea that if a man saw a thousand swans and they were all white, he might logically conclude that all swans are white. The flaw in his logic is that even when the premises are true, the conclusion can still be false. In other words, just because the man has never seen a black swan, it does not mean they do not exist. As Dutch explorers discovered in 1697, black swans are simply outliers -- rare birds, unknown to Europeans until Willem de Vlamingh and his crew visited Australia. Statistician Nassim Nicholas Taleb uses the phrase black swan as a metaphor for how humans deal with unpredictable events in his 2007...

A Graphics Processing Unit (GPU)

A graphics processing unit (GPU) is a computer chip that performs rapid mathematical calculations, primarily for the purpose of rendering images. A GPU may be found integrated with a central processing unit (CPU) on the same circuit, on a graphics card or in the motherboard of a personal computer or server. In the early days of computing, the CPU performed these calculations. As more graphics-intensive applications such as AutoCAD were developed; however, their demands put strain on the CPU and degraded performance. GPUs came about as a way to offload those tasks from CPUs, freeing up their processing power. NVIDIA, AMD, Intel and ARM are some of the major players in the GPU market. GPU vs. CPU A graphics processing unit is able to render images more quickly than a central processing unit because of its parallel processing architecture, which allows it to perform multiple calculations at the same time. A single CPU does not have this capability, although multi...

6G (sixth-generation wireless)

6G (sixth-generation wireless) is the successor to 5G cellular technology. 6G networks will be able to use higher frequencies than 5G networks and provide substantially higher capacity and much lower latency. One of the goals of the 6G Internet will be to support one micro-second latency communications, representing 1,000 times faster -- or 1/1000th the latency -- than one millisecond throughput. The 6G technology market is expected to facilitate large improvements in the areas of imaging, presence technology and location awareness. Working in conjunction with AI, the computational infrastructure of 6G will be able to autonomously determine the best location for computing to occur; this includes decisions about data storage, processing and sharing.  Advantages of 6G over 5G 6G is expected to support 1 terabyte per second (Tbps) speeds. This level of capacity and latency will be unprecedented and wi...