DQA Manager (dqa.dqa_manager.DQAManager)

class dqa.dqa_manager.DQAManager(logging_level: int = 0)

Provides a central instance to manage the DQA main functions: Loading configs, processing task lists and exporting models.

The configuration is stored as a ConfigSystem object and the datasets as a dictionary.

Methods

export_models()	Exports the models as defined in the configuration.
get_average_feedback_tables(level)	Takes the average of all feedback tables on a specified level.
get_feedback_tables()	Retrieves the feedback tables of the dataset.
load_config(config, config_dir[, parameters])	Loads a DQA configuration.
load_config_file(config_filename[, ...])	Loads a DQA configuration from a file.
loop_task_list([name])	Repeats processing a task list until a ConnectionEnded exception is raised.
process_task_list([name])	Processes one of the task lists defined in the configuration.

join_feedback_tables

export_models()

Exports the models as defined in the configuration.

get_average_feedback_tables(level: str) → dict | DataFrame

Takes the average of all feedback tables on a specified level.

Parameters:

level (str) – The level to take the average on. Can be ‘Measurement’, ‘Machine’, ‘Dataset’ or ‘Total’.

Return type:

A dict structure containing the associations to the averaged tables or a table directly.

get_feedback_tables() → Dict[str, Dict[str, List[DataFrame]]]

Retrieves the feedback tables of the dataset.

Returns:

• A double dictionary result such that result[dataset_name][machine_name] contains a list with a DataFrame for

• each measurement. The rows of this DataFrame are the data rows in the measurement, the columns are the

• data quality indicators computed for them.

load_config(config: Dict[str, Any], config_dir: str, parameters: Dict[str, Any] | None = None)

Loads a DQA configuration. :param config: The configuration loaded from a JSON file. :param config_dir: The working directory. All include paths are relative to this directory. :param parameters: Preprocessor variables to be set in advance, optional.

load_config_file(config_filename: str, config_dir: str | None = None, parameters: Dict[str, Any] | None = None)

Loads a DQA configuration from a file. :param config_dir: The working directory. All include paths are relative to this directory. :param config_filename: The path to load the file from. :param parameters: Preprocessor variables to be set in advance, optional.

loop_task_list(name='Main')

Repeats processing a task list until a ConnectionEnded exception is raised.

Parameters:

name (Name of the task list.) –

process_task_list(name='Main')

Processes one of the task lists defined in the configuration. :param name: The name of the task list, by default ‘Main’.