T10. Real-time monitoring

This tool encompasses a web-based monitoring system developed to integrate time series data into the INOWAS platform. Real-time sensors can be connected to the INOWAS platform and time series data can be uploaded. The data can be visualized, processed, downloaded and prepared for further usage,  e.g. as a boundary or observation point in a real-time groundwater flow model. 

Please be aware that this tool is under development and currently only available for partners of the SMART-Control WaterJPI project (www.smart-control.inowas.com). 

Sensor Setup

Add Sensor

A new sensor can be added by using the “+Add” button. The sensor location needs to be included by clicking on the specific location on the map. The exact location can be later edited and specified.

Change metadata and add parameter

After creating the sensor, the metadata including the name and location (WGS84) can be edited and parameters can be added using the following categories: 

  • Electrical conductivity 
  • Water level 
  • Pressure head 
  • Dissolved oxygen 
  • Temperature
  • pH 
  • Water content        
  • Redox Potential 
  • Others

Add data sources

For each parameter, time series data can be added as csv or as online sensors using a server connection. 

CSV Upload

To upload a time series via CSV, click on Data Source “+Add” and choose the type “file”. The following window will appear where you can specify the CSV file, the date-time format and the column of the CSV file which corresponds to the date-time as well as the parameter. In addition, the desired time range which should be upload (default is the whole time series saved in the CSV) as well as the value range can be specified. After clicking “Apply”, the data is added to the platform.

Real-time data

To add real-time sensor data, the sensor needs to be previously connected to the INOWAS server (prometheus or http API). If you would like to add your own online sensor, please contact the INOWAS team.

Time series data can be added using a prometheus query as shown below. Here the Elbe river water level provided by Pegelonline WSV (https://www.pegelonline.wsv.de) is connected to the INOWAS platform via the Prometheus server. 

Groundwater sensors of the company UIT can be connected via FTP and SensoWeb to the INOWAS platform. For that the data source type “Online” is chosen. The specific project, sensor and desired parameter needs to be selected. The time and value range can be specified in addition. 

Various data sources

Various data sources of mixed data types for one parameter can be included as shown in the following Figure. Here, a historical time series of water level is combined with an online sensor which is added through the INOWAS Prometheus service. 

The data of the various data sources need to have the same unit (e.g. water level in cm). Please be aware, that if time periods of various data sources overlap, the second data source (bottom) overwrites the values of the first data source (top). You can change the order of the data sources using the “up” and “down” arrows. If no time periods overlap, the data of the various data sources are combined to one time series.

Sensor Data Processing

The uploaded data can be processed in this section. Processing is divided into time and value processing.

Value processing comprises all processing algorithms which directly influence the values of a time series. The following processing operations are implemented:

  • + : add a constant value
  • : substract a constant value
  • * : multiply by a constant value
  • / : divide by a constant value
  • < : filter all data points that are smaller than the value
  • <= : filter all data points that are smaller or equal to the value
  • > : filter all data points that are bigger the value
  • >= : filter all data points that are bigger or equal to the value
  • = : assign a constant value

The operation can be either applied to the whole time series length or the start and end date can be specified (see below). 

In the time processing section, gaps in the time series can be filled (interpolated) and resampling to a different time resolution can be done. For this the interpolation method and the time resolution (Rule) needs to be defined. 

The interpolation methods currently implemented comprise:

  • cubic
  • linear
  • nearest
  • quadaratic
  • slinear
  • time 
  • zero

The documentation for the various interpolation methods can be found in the Python Pandas documentation. The time resolution of the new, processed time series needs to be given as an integer followed by the corresponding time discretisation:

  • t : second
  • min : minutes
  • d : days
  • w : weeks
  • m : months
  • y : years

The sensor processing section encompasses the following functionalities: 

  • fill gaps in time series
  • resampling
  • statistics:
    • Count (number of data values)
    • Mean
    • Min
    • Max
    • Standard deviation
    • Median
    • 25%: first quartile value in the series
    • 75%: third quartile value in the series

Sensor Data Visualization

This tool is developed within the frame of SMART-Control, a WaterJPI project. For further information please visit:
www.smart-control.inowas.com