DataCleaningGeneral.json#

Performs standard, general-purpose data cleaning operations.

The process includes the following steps:

  • Restrict the data to those measurements that contain at least a specified set of required data rows.

  • Restrict the data to entries with non-nan values in specified data rows.

Parameters#

  • required_rows: The data rows required for the measurements to be kept.

  • non_nan_rows: Nan values are not accepted in these rows. Entries with nan values here are dropped.

  • non_nan_truncate: More data rows whose parallel entries should also be removed if there is a nan-value in another row, e.g., timestamps.

Task Lists#

  • Main:

    The default operation list.