Data Structuring/ Normalization and Validation the Hidden Key to Unified Information Solution!!!

For the last 2 weeks I have been on the road, sorry just did not get to updating blog, but a constant discussion topic that keeps coming up. “How to truly build a Unified Information system that allows a view across their industrial/ production assets, and the ability to compare, and understand current state, capacity and performance quickly and easily.”

People have tried the intelligence, information semantic products which layer on top and bring valuable representation of information, but while the semantic information is a critical role, and aligns data silos, it is only as good as the data.

When discussing strategies with companies in Upstream oil and gas, Mining, Metals, Refining, Power, Water Utilities, and a common theme is the need to get data structuring/ normalization and key is validation of data.

One person commented last week “we cannot just take all the data from our existing SCADA systems/ historians and bring it to central historian due to no alignment, lack of consistent context, and data validation!”

The problem is not just about aligning data for access, the goal today is to make decisions not just about one process or plant but timely decisions across multiple sites. To achieve this it is not just about gathering existing data, as one set of engineers put it, we need to normalized data this means units and measures been aligned for one. They are putting unifying storage systems but they spend a lot of time going to the source of actual data, and then structuring and normalizing measures. Today this is being done in the control layer and supervisory layer. It is also key that the existing running systems on a plant are not disrupted, so the risk to changing these running systems in these systems is way too high. 

In one case a customer talked about 16 versions of one measure across 14 plants. This same story comes all the time, so the questions is how to achieve a result that does not threaten the existing sites, especially when the challenge today is not in a plant but across sites. These sites have been put in at different times with different systems, and often different objectives.

The key is to look at a layer that allows:

·         cross site administration/ configuration e.g. a distributed system

·         ability establish standards for asset structures / kpis / measures/ units, with the ability to centrally administer these standards and enforce governance

·         ability data collect from both real time and historical data stores

·         ability to set up in these structures validation rules that will validate the captured data to trusted before storage

·         distributed data capture and ability to store locally and aggregate providing data integrity.

The key is a 3 layer solution:

• A data collection platform that can be phyically be distributed but centrally managed with standards governance, providing data structure, intellignece, and validation as close to the source as possible. So that different process/ plant data both realtime and historiacl can be aligned across this common namespace.
• A storage layer that the platform now propagates this now normalized information into one or multiple distributed storage historians, providing a consistent information storage across these different control/ automation systems.
• A unifying information layer with a semantic capability to allow this unified storage + the operational storages from different systems to be aligned. 

These three layers enable success as a team, not any one of them, if you are looking for unified information system that can be trusted, so decisions in the now can be made.