Opened 5 years ago

Closed 5 years ago

#5948 closed enhancement (fixed)

Create a service for accessing log outputs from jobs

Reported by: antonio Owned by: vegasm
Priority: minor Milestone: DP2.0
Component: DownscalingPortal Keywords:
Cc:

Description

Create a service for accessing log outputs from jobs.
Also files and produced.

This service should be allow to admin/support team member to access this log information to debug errors.

Attachments (1)

job.log (6.7 KB) - added by vegasm 5 years ago.

Download all attachments as: .zip

Change History (6)

comment:1 Changed 5 years ago by vegasm

  • Milestone set to DP2.0

comment:2 Changed 5 years ago by vegasm

Do you want to receive a file or plain text as response?

comment:3 Changed 5 years ago by antonio

the files could be large therefore the service should be send a reference to a file.

But, for error file logs a quick inspect is better then a text embedded on response is more convenient.

comment:4 Changed 5 years ago by vegasm

there are two log files. One is the output of the execution in the PBS:

#!/bin/bash
### PBS -N 37664
#PBS -V
#PBS -q ensembles
#PBS -l nodes=1:ppn=1
#PBS -l walltime=48:00:00
#PBS -l mem=2gb
#PBS -e /oceano/gmeteo/WORK/ensembles/downscalingPortal/scripts/qsubmat_20160902100910831569000.3897.sh.e$PBS_JOBID
#PBS -o /oceano/gmeteo/WORK/ensembles/downscalingPortal/scripts/qsubmat_20160902100910831569000.3897.sh.o$PBS_JOBID
#PBS -r n
#PBS -V
/software/meteo/matlab/Matlab_R2009a/bin/matlab -logfile /oceano/gmeteo/WORK/ensembles/downscalingPortal/PatternsData/gutierjm/VALUEIberia-1cadfc1ff7/PRED/VALUEIberiaECATmax-2669e064f1/DOWN_METHOD/Analogues-default-c9ee19dc50/DOWN/37664.log -r "cd /oceano/gmeteo/WORK/ensembles/downscalingPortal/PatternsData/gutierjm/VALUEIberia-1cadfc1ff7/PRED/VALUEIberiaECATmax-2669e064f1/DOWN_METHOD/Analogues-default-c9ee19dc50/DOWN;downscaling_37664" -nosplash -nodesktop -display oceano.macc.unican.es:5
sleep 40
exit 0
+ whoami
..
..
..

The other one is referred to the Matlab execution

avoid a potential name conflict.}

In path at 110

In addpath at 87
In init at 4
In downscaling_37664 at 26

{Warning: Function
/vols/seal/oceano/gmeteo/WORK/ensembles/downscalingPortal/MLToolbox/MeteoLab/BayesNets/BNT/FullBNT-1.0.3/KPMtools/isvector.m
has the same name as a MATLAB builtin. We suggest you rename the function to
avoid a potential name conflict.}

In path at 110

In addpath at 87
In init at 4
In downscaling_37664 at 26

{Warning: Function
/vols/seal/oceano/gmeteo/WORK/ensembles/downscalingPortal/MLToolbox/MeteoLab/BayesNets/BNT/FullBNT-1.0.3/KPMtools/isscalar.m
has the same name as a MATLAB builtin. We suggest you rename the function to
avoid a potential name conflict.}

In path at 110

In addpath at 87
In init at 4
In downscaling_37664 at 26

{Warning: Function
..
..
..
..
..

How do you want to receive both? Merged but splitted, different urls, different parameter...

Changed 5 years ago by vegasm

comment:5 Changed 5 years ago by vegasm

  • Resolution set to fixed
  • Status changed from new to closed

attached is the output plain text. Both logs are merged but conveniently separated. The paths are included. This is only valid for downscaling jobs stored in the database.

Note: See TracTickets for help on using tickets.