Changes between Version 2 and Version 3 of DRM4G/ResourceConfiguration
- Timestamp:
- Nov 4, 2016 6:27:18 PM (6 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
DRM4G/ResourceConfiguration
v2 v3 15 15 Each resource section has to begin with the line `[resource_name]` followed by `key = value` entries. 16 16 17 Configuration keys common to all resources: 17 === Configuration keys common to all resources: === 18 18 19 19 * `enable`: true or false in order to enable or disable a resource. 20 20 21 * `communicator` or authentication type : 21 22 - `local`: The resource will be accessed directly. 22 - `ssh`: The resource will be accessed through ssh protocol. 23 * `username`: Name of the user that will be used to log on to the front-end. 23 - `ssh`: The resource will be accessed through ssh protocol via Paramiko's API. 24 - `op_ssh`: The resource will be accessed through ssh protocol via OpenSSH's API. 25 26 * `username`: Name of the user that will be used to log on to the front-end. 27 24 28 * `frontend`: Hostname or ip address of either the cluster or grid user interface you'll be connected to. The syntax is "host:port", by default the port used is 22. 29 25 30 * `private_key`: Path to the identity file needed to log on to the front-end. 31 32 * `public key`: Path to the public identity file needed to log on to the front-end. (OPTIONAL, by default the '''private_key''''s value will be taken, to which '''.pub''' will be added) 33 26 34 * `scratch`: Directory used to store temporary files for jobs during their execution, by default, it is `$HOME/.drm4g/jobs` 35 27 36 * `lrms` or Local Resource Management System : 28 37 - `pbs`: TORQUE/PBS cluster. 29 38 - `sge`: Grid Engine cluster. 30 - `slurm`: SLURM cluster.31 - `slurm_res`: [http://www.bsc.es/marenostrum-support-services/res RES(Red Española de Supercomputación)] resources.32 39 - `loadleveler`: !LoadLeveler cluster. 33 40 - `lsf`: LSF cluster. 34 41 - `fork`: SHELL. 35 42 - `cream`: CREAM Compute Elements (CE). 43 - `slurm`: SLURM cluster. 44 - `slurm_res`: [http://www.bsc.es/marenostrum-support-services/res RES(Red Española de Supercomputación)] resources. 36 45 37 Keys for non-grid resources such as HPC resources: 46 [[NoteBox(tip, Note that for `communicator` you have two options when it comes to accessing a resource through the ssh protocol. If you don't know which one you prefer choose `ssh`.)]] 47 48 === Keys for non-grid resources such as HPC resources: === 38 49 39 50 * `queue`: Queue available on the resource. If there are several queues, you have to use a "," as follows "queue = short,medium,long". 51 40 52 * `max_jobs_in_queue`: Max number of jobs in the queue. 53 41 54 * `max_jobs_running`: Max number of running jobs in the queue. 55 42 56 * `parallel_env`: It defines the parallel environments available for Grid Engine cluster. 57 43 58 * `project`: It specifies the project variable and is for TORQUE/PBS, Grid Engine and LSF clusters. 44 59 45 Keys for grid resources: 60 === Keys for grid resources: === 46 61 47 62 * `vo`: Virtual Organization (VO) name. 63 48 64 * `host_filter`: A host list for the VO. Each host is separated by a ",". Here is an example: "host_filter = prod-ce-01.pd.infn.it, creamce2.gina.sara.nl". 65 49 66 * `bdii`: It indicates the BDII host to be used. The syntax is "bdii:port". If you do not specify this variable, the `LCG_GFAL_INFOSYS` environment variable defined on the grid user interface will be used by default. 67 50 68 * `myproxy_server`: Server to store grid credentials. If you do not specify this variable, the `MYPROXY_SERVER` environment variable defined on the grid user interface will be used by default. 51 69 … … 81 99 [blizzard] 82 100 enable = true 83 communicator = ssh101 communicator = op_ssh 84 102 username = user 85 103 frontend = blizzard.meteo.unican.es … … 105 123 myproxy_server = px.grid.sara.nl 106 124 }}} 125 126 {{{#!comment 127 #for this maybe another section will be better, since we'll have to explain how to set up the cloud_json and how it works 128 [cesnet] 129 enable = true 130 communicator = ssh 131 username = user 132 vo_user = drm4g_admin 133 frontend = ui.macc.unican.es 134 private_key = ~/.ssh/id_rsa 135 lrms = fedcloud 136 cloud = EGI FedCloud - CESNET 137 bdii = lcg-bdii.cern.ch:2170 138 myproxy_server = myproxy1.egee.cesnet.cz 139 flavour = Small 140 virtual_image = Ubuntu-14.04 141 nodes = 1 142 volume = 0 143 }}}