Changes between Version 2 and Version 3 of DRM4G/ResourceConfiguration


Ignore:
Timestamp:
Nov 4, 2016 6:27:18 PM (6 years ago)
Author:
minondoa
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • DRM4G/ResourceConfiguration

    v2 v3  
    1515Each resource section has to begin with the line `[resource_name]` followed by `key = value` entries.
    1616
    17 Configuration keys common to all resources:
     17=== Configuration keys common to all resources: ===
    1818
    1919    * `enable`:          true or false in order to enable or disable a resource.
     20
    2021    * `communicator` or  authentication type : 
    2122        - `local`:       The resource will be accessed directly.
    22         - `ssh`:         The resource will be accessed through ssh protocol.
    23     * `username`:        Name of the user that will be used to log on to the front-end.
     23        - `ssh`:         The resource will be accessed through ssh protocol via Paramiko's API.
     24        - `op_ssh`:      The resource will be accessed through ssh protocol via OpenSSH's API.
     25
     26    * `username`:        Name of the user that will be used to log on to the front-end.
     27 
    2428    * `frontend`:        Hostname or ip address of either the cluster or grid user interface you'll be connected to. The syntax is "host:port", by default the port used is 22.
     29
    2530    * `private_key`:     Path to the identity file needed to log on to the front-end.
     31
     32    * `public key`:      Path to the public identity file needed to log on to the front-end. (OPTIONAL, by default the '''private_key''''s value will be taken, to which '''.pub''' will be added)
     33
    2634    * `scratch`:         Directory used to store temporary files for jobs during their execution, by default, it is `$HOME/.drm4g/jobs`
     35
    2736    * `lrms` or Local Resource Management System :
    2837        - `pbs`:           TORQUE/PBS cluster.
    2938        - `sge`:           Grid Engine cluster.
    30         - `slurm`:         SLURM cluster.
    31         - `slurm_res`:     [http://www.bsc.es/marenostrum-support-services/res RES(Red Española de Supercomputación)] resources.
    3239        - `loadleveler`:   !LoadLeveler cluster.
    3340        - `lsf`:           LSF cluster.
    3441        - `fork`:          SHELL.
    3542        - `cream`:         CREAM Compute Elements (CE).
     43        - `slurm`:         SLURM cluster.
     44        - `slurm_res`:     [http://www.bsc.es/marenostrum-support-services/res RES(Red Española de Supercomputación)] resources.
    3645
    37 Keys for non-grid resources such as HPC resources:
     46[[NoteBox(tip, Note that for `communicator` you have two options when it comes to accessing a resource through the ssh protocol. If you don't know which one you prefer choose `ssh`.)]]
     47
     48=== Keys for non-grid resources such as HPC resources: ===
    3849
    3950    * `queue`:             Queue available on the resource. If there are several queues, you have to use a "," as follows "queue  = short,medium,long".
     51
    4052    * `max_jobs_in_queue`: Max number of jobs in the queue.
     53
    4154    * `max_jobs_running`:  Max number of running jobs in the queue.
     55
    4256    * `parallel_env`:      It defines the parallel environments available for Grid Engine cluster.
     57
    4358    * `project`:           It specifies the project variable and is for TORQUE/PBS,  Grid Engine and LSF clusters.
    4459
    45 Keys for grid resources:
     60=== Keys for grid resources: ===
    4661 
    4762    * `vo`:                Virtual Organization (VO) name.
     63
    4864    * `host_filter`:       A host list for the VO. Each host is separated by a ",". Here is an example: "host_filter = prod-ce-01.pd.infn.it, creamce2.gina.sara.nl".
     65
    4966    * `bdii`:              It indicates the BDII host to be used. The syntax is "bdii:port". If you do not specify this variable, the `LCG_GFAL_INFOSYS` environment variable defined on the grid user interface will be used by default.                     
     67
    5068    * `myproxy_server`:    Server to store grid credentials. If you do not specify this variable, the `MYPROXY_SERVER` environment variable defined on the grid user interface will be used by default.
    5169
     
    8199[blizzard]
    82100enable            = true
    83 communicator      = ssh
     101communicator      = op_ssh
    84102username          = user
    85103frontend          = blizzard.meteo.unican.es
     
    105123myproxy_server    = px.grid.sara.nl
    106124}}}
     125
     126{{{#!comment
     127#for this maybe another section will be better, since we'll have to explain how to set up the cloud_json and how it works
     128[cesnet]
     129enable         = true
     130communicator   = ssh
     131username       = user
     132vo_user        = drm4g_admin
     133frontend       = ui.macc.unican.es
     134private_key    = ~/.ssh/id_rsa
     135lrms           = fedcloud
     136cloud          = EGI FedCloud - CESNET
     137bdii           = lcg-bdii.cern.ch:2170
     138myproxy_server = myproxy1.egee.cesnet.cz
     139flavour        = Small
     140virtual_image  = Ubuntu-14.04
     141nodes          = 1
     142volume         = 0
     143}}}