wiki:WRF4GGridConfiguration

Version 1 (modified by carlos, 11 years ago) (diff)

--

Required Middleware

The following middlewares should be installed to use the corresponding drivers:

  • Globus Toolkit 4 or 5
  • gLite UI 3.1 (GRAM2-based)
  • gLite UI 3.2 (CREAM-based)

Available Resources

lcg-infosites command can be used to obtain VO information on Grid Resources. Before using lcg-infosites. Some using examples are showed below:

  • Find out the CEs of your VO:
    [user@ui~]$ lcg-infosites --vo $VO ce 
    #CPU    Free    Total Jobs      Running Waiting ComputingElement
    ----------------------------------------------------------
      16      16       0              0        0    gantt.cefet-rj.br:8443/cream-pbs-prod
    21561      0    3409              7     3402    ce206.cern.ch:8443/cream-lsf-grid_eela
    21561    826    3409              7     3402    ce204.cern.ch:8443/cream-lsf-grid_eela
    21561    826    3409              7     3402    ce203.cern.ch:8443/cream-lsf-grid_eela
    21561      0    3409              7     3402    ce205.cern.ch:8443/cream-lsf-grid_eela
    21561    826    3409              7     3402    ce208.cern.ch:8443/cream-lsf-grid_eela
    21561      0    3409              7     3402    ce207.cern.ch:8443/cream-lsf-grid_eela
    21561    826    3409              7     3402    ce130.cern.ch:2119/jobmanager-lcglsf-grid_eela
    21561    826    3409              7     3402    ce132.cern.ch:2119/jobmanager-lcglsf-grid_eela
    21561    826    3409              7     3402    ce131.cern.ch:2119/jobmanager-lcglsf-grid_eela
    21561    826    3409              7     3402    ce133.cern.ch:2119/jobmanager-lcglsf-grid_eela
     260     107       4              4        0    ce01-tic.ciemat.es:2119/jobmanager-lcgpbs-prod_eela
    1160     467       0              0        0    gridgate.cs.tcd.ie:2119/jobmanager-pbs-sixhour
    1160     467       0              0        0    gridgate.cs.tcd.ie:2119/jobmanager-pbs-thirtym
    1160     467       5              4        1    gridgate.cs.tcd.ie:2119/jobmanager-pbs-threeday
    1160     467       2              2        0    gridgate.cs.tcd.ie:2119/jobmanager-pbs-oneday
      10      10       0              0        0    ce01.unlp.edu.ar:2119/jobmanager-lcgpbs-long
    ...........
    
  • Find out CE list with running jobs, free cpus, and maximum wallclock and CPU time.
    [user@ui~]$ lcg-info --vo $VO --list-ce --attrs RunningJobs,FreeCPUs,MaxWCTime,MaxCPUTime
    - CE: axon-g01.ieeta.pt:2119/jobmanager-lcgpbs-prod
      - RunningJobs         0
      - FreeCPUs            5
      - MaxWCTime           4320
      - MaxCPUTime          2880
    
    - CE: cale.uniandes.edu.co:8443/cream-pbs-prod
      - RunningJobs         3
      - FreeCPUs            94
      - MaxWCTime           4320
      - MaxCPUTime          2880
    ...........
    
  • Find out the SEs of your VO.
    [user@ui~]$ lcg-infosites --vo $VO se
    Avail Space(Kb) Used Space(Kb)  Type    SEs
    ----------------------------------------------------------
    1258363960      8651392         n.a     se.labmc.inf.utfsm.cl
    288012854       11517683563     n.a     lnx097.eela.if.ufrj.br
    187037782       27605724        n.a     se01.macc.unican.es
    

For more information you could execute lcg-infosites --help or see gLite information

Configuration to access to Grid Resources

Next steps describe an specific configuration of the drivers for Grid Infrastructure.

In file "$GW_LOCATION/etc/gwd.conf":

# Example GT2
IM_MAD = gt2:gw_im_mad_mds2_glue-bdii:-l etc/gt2.list -q (GlueCEAccessControlBaseRule=VO\:prod.vo.eu-eela.eu) -s bdii.eela.ufrj.br:tm_gt2:em_gt2
EM_MAD = em_gt2:gw_em_mad_gram2::rsl_nsh
TM_MAD = tm_gt2:gw_tm_mad_dummy:-u gsiftp\://ui01.macc.unican.es

# Example CREAM
IM_MAD = cream:gw_im_mad_mds2_glue-bdii:-l etc/cream.list -q (GlueCEAccessControlBaseRule=VO\:prod.vo.eu-eela.eu) -s bdii.eela.ufrj.br:tm_cream:em_cream
EM_MAD = em_cream:gw_em_mad_cream::jdl
TM_MAD = tm_cream:gw_tm_mad_dummy:-g

There are three options for the configuration of the IM MAD:

  • -l: host list file to be used.
    • Example of gt2.list for Gisela Infrastructure:
      [user@ui~]$ lcg-infosites --vo $VO ce | awk 'NR>2 {print $6}'|grep jobmanager |awk -F ":" '{print $1}' | uniq
      ce01-tic.ciemat.es
      ce01.unlp.edu.ar
      ce.labmc.inf.utfsm.cl
      tochtli.nucleares.unam.mx
      grid012.ct.infn.it
      ce01.eela.if.ufrj.br
      ce.cp.di.uminho.pt
      ce01.macc.unican.es
      ce01.up.pt
      grid001.fe.up.pt
      
    • Example of cream.list for Gisela Infrastructure:
      [user@ui~]$ lcg-infosites --vo $VO ce | awk 'NR>2 {print $6}'|grep cream |awk -F ":" '{print $1}' | uniq
      gantt.cefet-rj.br
      ce206.cern.ch
      ce204.cern.ch
      ce205.cern.ch
      ce207.cern.ch
      ce208.cern.ch
      tochtli64.nucleares.unam.mx
      ce02.eela.if.ufrj.br
      cream01.cecalc.ula.ve
      ce.egee.di.uminho.pt
      cale.uniandes.edu.co
      grid001.fc.up.pt
      
  • -q: it is possible to configure a GridWay instance to only use queues authorized to your VO by filtering them.
  • -s: information server in a hierarchical configuration.
    IM_MAD = gt2:gw_im_mad_mds2_glue-bdii:-l etc/gt2.list -q (GlueCEAccessControlBaseRule=VO\:prod.vo.eu-eela.eu) -s bdii.eela.ufrj.br:tm_gt2:em_gt2
    

There are two options for the configuration of the TM MAD:

  • -g: starts a GASS server.
  • -u: specifies the URL of a GridFTP server running in the client. For example:
    TM_MAD = tm_gt2:gw_tm_mad_dummy:-u gsiftp\://ui01.macc.unican.es
    

Accessing the VOMS servers

To use the Grid Resources, the user should iniatilize the proxy through voms server:

[user@ui~]$ voms-proxy-init --voms prod.vo.eu-eela.eu
Cannot find file or dir: /oceano/gmeteo/users/carlos/.glite/vomses
Enter GRID pass phrase:
Your identity: /DC=es/DC=irisgrid/O=unican/CN=josecarlos.blanco
Creating temporary proxy ........................................ Done
Contacting  voms.eela.ufrj.br:15003 [/C=BR/O=ICPEDU/O=UFF BrGrid CA/O=UFRJ/OU=IF/CN=host/voms.eela.ufrj.br] "prod.vo.eu-eela.eu" Done
Creating proxy ................................... Done
Your proxy is valid until Tue Aug 23 22:15:06 2011