wiki:GridTutorial

Version 9 (modified by carlos, 6 years ago) (diff)

--

EGI Grid

Práctica 1

El objetivo de esta práctica es tomar contacto con el uso de recursos de computación grid en la VO tut.vo.ibergrid.eu. Recuerde que estos comandos han de ejecutarse desde el frontend ui.macc.unican.es.

  • Generamos un proxy válido para operar en la VO tut.vo.ibergrid.eu:
    [user@ui ~]$ voms-proxy-init -voms tut.vo.ibergrid.eu
    
  • Para obtener información del proxy generado ejecute:
    [user@ui ~]$ voms-proxy-info -all
    
  • Listamos los recursos computación para ejecutar jobs (Computing Element) :
    [user@ui ~]$ lcg-infosites --vo tut.vo.ibergrid.eu ce
    
  • Listamos los recursos de computación de almacenamiento (Storage Element) :
    [user@ui ~]$ lcg-infosites --vo tut.vo.ibergrid.eu se
    
cat <<EOF > job.jdl
Executable = "hostname";
StdOutput = "hostname.out";
StdError = "hostname.err";
OutputSandbox = {"hostname.err","hostname.out"};
Arguments = "-f";
EOF
cat hello.jdl 
#: the name of the file which will be actually executed
Executable = "hello.sh" ; 

CpuNumber = 1;

# the name of the file where standard output stream will be redirected
StdOutput = "stdout.txt";

# the name of the file where standard error stream will be redirected
StdError = "stderr.txt";

# list of local files which will be transferred to 
# the remote resource before the execution
InputSandbox = {"hello.sh"};

# list of remote files which will be transferred from the resource 
# after the execution
OutputSandbox = {"stdout.txt", "stderr.txt"};
Requirements = ( other.GlueCEUniqueID == "ce.ceta-ciemat.es:8443/cream-sge-ibtut.cg" ||
               other.GlueCEUniqueID == "cream01-egi.bifi.unizar.es:8443/cream-slurm-tutiber" );
 cat hello.sh 
#!/bin/sh
echo "Hello World - from $HOSTNAME"
echo -n "It's " 
date

glite-wms-job-submit -a hello.jdl 

Connecting to the service https://wms01.ific.uv.es:7443/glite_wms_wmproxy_server


====================== glite-wms-job-submit Success ======================

The job has been successfully submitted to the WMProxy
Your job identifier is:

https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw

==========================================================================


[carlos@ui ~]$ glite-wms-job-status https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
Current Status:     Scheduled
Status Reason:      unavailable
Destination:        ce.ceta-ciemat.es:8443/cream-sge-ibtut.cg
Submitted:          Tue Mar 22 19:19:21 2016 CET
==========================================================================

[carlos@ui ~]$ glite-wms-job-status https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
Current Status:     Scheduled
Status Reason:      unavailable
Destination:        ce.ceta-ciemat.es:8443/cream-sge-ibtut.cg
Submitted:          Tue Mar 22 19:19:21 2016 CET
==========================================================================

[carlos@ui ~]$ glite-wms-job-status https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
Current Status:     Scheduled
Status Reason:      unavailable
Destination:        ce.ceta-ciemat.es:8443/cream-sge-ibtut.cg
Submitted:          Tue Mar 22 19:19:21 2016 CET
==========================================================================

[carlos@ui ~]$ glite-wms-job-status https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
Current Status:     Scheduled
Status Reason:      unavailable
Destination:        ce.ceta-ciemat.es:8443/cream-sge-ibtut.cg
Submitted:          Tue Mar 22 19:19:21 2016 CET
==========================================================================

[carlos@ui ~]$ glite-wms-job-status https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw


======================= glite-wms-job-status Success =====================
BOOKKEEPING INFORMATION:

Status info for the Job : https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
Current Status:     Done(Success)
Exit code:          0
Status Reason:      Job Terminated Successfully
Destination:        ce.ceta-ciemat.es:8443/cream-sge-ibtut.cg
Submitted:          Tue Mar 22 19:19:21 2016 CET
==========================================================================

[carlos@ui ~]$ glite-wms-job- https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
glite-wms-job-cancel          glite-wms-job-list-match      glite-wms-job-perusal         
glite-wms-job-delegate-proxy  glite-wms-job-logging-info    glite-wms-job-status          
glite-wms-job-info            glite-wms-job-output          glite-wms-job-submit          
[carlos@ui ~]$ glite-wms-job-output https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw

Error - Configuration Error
Output Storage pathname doesn't exist (check the configuration file): /tmp/jobOutput

[carlos@ui ~]$ glite-wms-job-output --help

WMS User Interface version  3.5.3
Copyright (C) 2008 by ElsagDatamat SpA

Usage: glite-wms-job-output [options]   <job Id(s)>

options:
	--help
	--version

	--input, -i	<file_path>
	--dir		<directory_path>
	--proto		<protocol>
	--config, -c	<file_path>
	--vo		<vo_name>
	--list-only
	--nosubdir
	--noint
	--nopurge, -n
	--json
	--pretty-print
	--debug
	--logfile	<file_path>

Please report any bug at:
	alvise.dorigo@pd.infn.it
[carlos@ui ~]$ glite-wms-job-output https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw --dir=$HOME

WMS User Interface version  3.5.3
Copyright (C) 2008 by ElsagDatamat SpA

Usage: glite-wms-job-output [options]   <job Id(s)>

options:
	--help
	--version

	--input, -i	<file_path>
	--dir		<directory_path>
	--proto		<protocol>
	--config, -c	<file_path>
	--vo		<vo_name>
	--list-only
	--nosubdir
	--noint
	--nopurge, -n
	--json
	--pretty-print
	--debug
	--logfile	<file_path>

Please report any bug at:
	alvise.dorigo@pd.infn.it
[carlos@ui ~]$ glite-wms-job-output https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw --dir $HOME

WMS User Interface version  3.5.3
Copyright (C) 2008 by ElsagDatamat SpA

Usage: glite-wms-job-output [options]   <job Id(s)>

options:
	--help
	--version

	--input, -i	<file_path>
	--dir		<directory_path>
	--proto		<protocol>
	--config, -c	<file_path>
	--vo		<vo_name>
	--list-only
	--nosubdir
	--noint
	--nopurge, -n
	--json
	--pretty-print
	--debug
	--logfile	<file_path>

Please report any bug at:
	alvise.dorigo@pd.infn.it
[carlos@ui ~]$ glite-wms-job-output https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw --dir .

WMS User Interface version  3.5.3
Copyright (C) 2008 by ElsagDatamat SpA

Usage: glite-wms-job-output [options]   <job Id(s)>

options:
	--help
	--version

	--input, -i	<file_path>
	--dir		<directory_path>
	--proto		<protocol>
	--config, -c	<file_path>
	--vo		<vo_name>
	--list-only
	--nosubdir
	--noint
	--nopurge, -n
	--json
	--pretty-print
	--debug
	--logfile	<file_path>

Please report any bug at:
	alvise.dorigo@pd.infn.it
[carlos@ui ~]$ glite-wms-job-output --dir . https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw 

Connecting to the service https://wms01.ific.uv.es:7443/glite_wms_wmproxy_server


================================================================================

			JOB GET OUTPUT OUTCOME

Output sandbox files for the job:
https://wms01.ific.uv.es:9000/_u_QD5zc1Ss78keGp0dqnw
have been successfully retrieved and stored in the directory:
/oceano/gmeteo/users/carlos/carlos__u_QD5zc1Ss78keGp0dqnw

================================================================================


[carlos@ui ~]$ ls /oceano/gmeteo/users/carlos/carlos__u_QD5zc1Ss78keGp0dqnw
stderr.txt  stdout.txt
[carlos@ui ~]$ cat /oceano/gmeteo/users/carlos/carlos__u_QD5zc1Ss78keGp0dqnw/stdout.txt 
Hello World - from da-p8-04
It's Tue Mar 22 19:19:39 CET 2016