Smart Grid on the Edge – The Data Challenge

Utilities are facing an increasingly complex power delivery environment, with the need to incorporate renewables generation, electric vehicles, and complex demand response programs into their service area operations. In response, many are expanding their Smart Grid strategies to take advantage of new technology and software that can increase the understanding of grid dynamics and improve its efficiency and costs:

  1. There is a growing requirement to make use of the cross-application functionality that a truly integrated Smart Grid environment can deliver. Examples include the ability to incorporate Smart Meter end user voltage readings into DMS and OMS systems. Or using the same data to trigger events and generate transaction requests for Asset Management and Work Order Management Systems.
  2. New analytics techniques and control applications are rapidly emerging with the promise of developing actionable information from existing data streams without adding new banks of sensors or communications infrastructure.

It is true that lower cost, smarter end-point devices, such as PMUs, are proliferating and are now capable of collecting orders of magnitude more useful operating data. Today’s challenge is that we have now also reached the point where it is becoming impossible to economically collect and process this vast amount of data in a central location for use by the many applications that need it.

This problem applies across the entire Industrial IoT and has been named the problem of Data Gravity. As more and more data is collected at the edge devices, the data mass’s center of gravity swings away from the center towards the edge of the IIoT. Fortunately, Moore’s Law is also working for us, and the cost of appropriate, powerful industrial devices has reduced to the point where multiple years’ worth of sensor data can be stored locally in a device costing less than a SCADA RTU. What is also needed, however, is a means of capturing that data and making it transparently available to the control and analytics applications that can use it. The Capture-Curate-Package-Deliver functionality that is required has to be provided on the edge devices, but present the data requested to the central systems regardless of storage location or connectivity – making it look like it is in the next server rack down.

Subsequent postings in this series will explore the detailed requirements of such an Edge Data Services Platform and how it can be incorporated into a utility’s Smart Grid Strategy. In the meantime, please feel free to submit any questions through this blog.

What questions do you have?

Roy Hodges is an Industry Consultant for Exara, Inc. with 10 years’ experience working in communications and software solutions for Smart Grid and Digital Oil Field deployments, both in the U.S. and internationally.

Exara is an Intel Partner that has developed the world’s first Edge Data Services Platform for the Industrial IoT. The Exara Platform is delivered on Intel-based Edge Servers that can be deployed in substations, electrical plant and many other industrial environments. For more information, please visit