Quality Assessment with SaQC

We have agreed to using SaQC for our quality assessment steps. This means we can focus on implementation.

SaQC uses a large object called saqc. In practice we load our time series data (pd.DataFrame) into the saqc object and then apply quality assessment steps through function calls on the object. Internally saqc uses a bespoke data structure.

The current concept is to have an saqc object within the CRNSDataHub which we would periodically update with our time series dataset. We could then use saqc to perform quality assessment and re-save the outputs into the CRNSDataHub.