wiki:qa-dkrz

QA-DKRZ

Github: https://github.com/IS-ENES-Data/QA-DKRZ

Readthedocs: http://qa-dkrz.readthedocs.io/en/latest/

Documentation (Best Practise): https://redmine.dkrz.de/projects/cordex/wiki/DKRZ_QC_Tool

Installation

It is assumed that miniconda2 is installed in your system.

$ conda create -n qa-dkrz -c conda-forge -c h-dh qa-dkrz=0.6.7=55
$ conda activate qa-dkrz
$ qa-dkrz install --up --force CORDEX
$ scp CORDEX_RCMs_ToU.txt /oceano/gmeteo/users/$USER/.qa-dkrz/QA_TABLES/tables/projects/CORDEX/

Guillaume added some changes in to the configure files in order to avoid know issues in the QA-DKRZ code or no critical warnings for CDS:

In ~/.qa-dkrz/QA_TABLES/tables/projects/CORDEX/CORDEX_check-list.conf add the following lines:

Auxiliary variable <name> has wrong data type & 3_2b,D
Missing time bounds & T_9,D

In ~/.qa-dkrz/QA_TABLES/tables/projects/CF/CF_check-list.conf add the following lines:

Units associated to standard_name are not CF compatible \
& CF_33e,D

Usage

Test (test.conf is attached in this page):

$ qa-dkrz -f test.conf

DRS: Data Reference Syntax

To test the DRS you may want to install esgprep from http://is-enes-data.github.io/esgf-prepare/installation.html and use the esg.cordex.ini attached.

Notes to install in UI

The qa-dkrz does not work on a CentOS 7.7 distribution with linux kernel 3.10. It returns the following error:

(qa-dkrz) [user @] $ qa-dkrz -f test.conf
~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/bin/syncFiles.x: error while loading shared libraries: libssl.so.1.0.0: cannot open shared object file: No such file or directory

(qa-dkrz) [user @] $ conda install openssl = 1.0

(qa-dkrz) [user @] $ qa-dkrz -f test.conf
Traceback (most recent call last):
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa-dkrz.py", line 669, in <module>
    run ()
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa-dkrz.py", line 561, in run
    if not launch_list [0] .start (queue,):
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa_exec.py", line 723, in start
    if not self.run (t_vars):
  File "~/user/miniconda2/envs/qa-dkrz/opt/qa-dkrz/python/qa-dkrz/qa_exec.py", line 583, in run
    period = log_entry ['period'],
KeyError: 'period'

The error on non-existing key period it's because the binary execution doing the actual test it's raising a Segmentation Fault.

The kernel must be updated from 3.10 to a 4.4 version to solve the problem:

#Enable the ELRepo repository on CentOS 7
rpm --import https://www.elrepo.org/RPM-GPG-KEY-elrepo.org
rpm -Uvh https://www.elrepo.org/elrepo-release-7.0-3.el7.elrepo.noarch.rpm
# install the long term support kernel (i.e. 4.4)
yum --enablerepo=elrepo-kernel install kernel-lt
#change to GRUB_DEFAULT=0
vi /etc/default/grub
# Recreate the kernel configuration:
grub2-mkconfig -o /boot/grub2/grub.cfg
# reboot and verify kernel version
uname -sr
Last modified 13 months ago Last modified on Apr 26, 2020 1:29:22 PM

Attachments (4)

Download all attachments as: .zip