Real-time automated quality control of atmospheric aerosol time series

actris_qc python package accompanying the manuscript entitled Real-time automated quality control of atmospheric aerosol time series Timo Houben (1,2), Thomas Müller (3), Peter Lünenschloss (1), Jens Voigtländer (3), Thomas Trabert (1,2), Ema Vosgerau (1,2), David Schäfer (1), and Jan Bumberger (1,2,4) (1) Helmholtz Centre for Environmental Research - UFZ, Research Data Management - RDM, Permoserstraße 15, 04318 Leipzig, Germany (2) Helmholtz Centre for Environmental Research - UFZ, Department Monitoring and Exploration Technologies, Permoserstraße 15, 04318 Leipzig, Germany (3) Leibniz Institute for Tropospheric Research (TROPOS), Permoserstraße 15, 04318 Leipzig, Germany (4) German Centre for Integrative Biodiversity Research (iDiv) Halle-Jena-Leipzig, Puschstraße 4, Leipzig 04103, Germany Submitted to AMT (Atmospheric Measurement Tecniques, EGU, Copernicus Publications) Content The files in this package are a snapshot of the repository on Helmholtz GitLab: https://codebase.helmholtz.cloud/qc-of-atmospheric-time-series/actris-quality-control# Find the corresponding release at: https://codebase.helmholtz.cloud/qc-of-atmospheric-time-series/actris-quality-control/-/releases configuration files for TROPOS and Melpitz measurement site data module examples module script for calculating of flag statistics based on logs optimization module qc module containing configurations for Aethalometer and Nephelometer utility module . ├── actris_qc │ ├── __init__.py │ ├── config_melpitz.yml │ ├── config_tropos.yml │ ├── data │ │ ├── __init__.py │ │ └── data_manager.py │ ├── examples │ │ └── anomalies.py │ ├── flag_stats.py │ ├── optimization │ │ ├── __init__.py │ │ ├── inspect_pattern.py │ │ ├── make_pattern.py │ │ ├── opt_scatterLowPass_aligned.py │ │ ├── opt_scatterLowPass.py │ │ └── patterns │ │ ├── ... │ ├── qc │ │ ├── __init__.py │ │ ├── aethalometer.py │ │ └── nephelometer.py │ ├── qc_pipeline.py │ ├── run.py │ ├── tests │ │ ├── __init__.py │ │ ├── conftest.py │ │ └── test_data_manager.py │ └── utils │ ├── __init__.py │ ├── constants.py │ ├── helpers.py │ └── logger.py ├── actris_qc-env.yml └── README.md Setup 1) Install python>3.11 on your system. 2) Download the code from Zenodo or clone the repository. 3) With a terminal/CLI: cd into the directory actris_qc. 4) Install the packages listed in actris_qc-env.yml in a conda/virtual environment, e.g. with conda env create -f actris_qc-env.yml -n actris-qc . 5) Test installation with python run.py config_test.yml 6) QC should run, log should be displayed via stdout and a new directory containing QC workflow results should appear. 7) Edit the config_test.yml according to desired configuration.