Changes between Version 76 and Version 77 of DRM4G/Tutorial


Ignore:
Timestamp:
Nov 29, 2016 11:31:27 AM (5 years ago)
Author:
minondoa
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • DRM4G/Tutorial

    v76 v77  
    44= About DRM4G =
    55
    6 `DRM4G` is an open platform, based on [[http://www.gridway.org/doku.php?id=start|GridWay]] , to define, submit, and manage computational jobs. `DRM4G` is a [[https://www.python.org|Python]] ('''2.6+''', '''3.3+''') implementation that provides a single point of control for computing resources without installing any intermediate middlewares. As a result, a user is able to run the same job on laptops, desktops, workstations, clusters, supercomputers, and any grid.
     6`DRM4G` is an open platform, based on [[http://www.gridway.org/doku.php?id=start|GridWay]], used to define, submit, and manage computational jobs. `DRM4G` is a [[https://www.python.org|Python]] ('''2.6+''', '''3.3+''') implementation that provides a single point of control for computing resources without installing any intermediate middlewares. As a result, a user is able to run any job on laptops, desktops, workstations, clusters, supercomputers, and any grid.
     7
     8
    79
    810= Start Guide =
    911
    10 In order to install DRM4G, download the installation script :
    11 
    12 {{{
    13 #!sh
    14 [user@mycomputer~]$ wget --no-check-certificate https://meteo.unican.es/work/DRM4G/drm4g_bootstrap.sh
    15 }}}
    16 
    17 And then run it :
    18 
    19 {{{
    20 #!sh
    21 [user@mycomputer~]$ bash ./drm4g_bootstrap.sh --dir $HOME
    22 
    23 ==========================
    24 DRM4G installation script
    25 ==========================
    26 
    27 --> Checking the last version of DRM4G ...
    28 
    29 --> DRM4G version selected: 2.4.1
    30 
    31 --> Downloading drm4g-2.4.1.tar.gz ...
    32 
    33 --> Unpacking drm4g-2.4.1.tar.gz in directory /home/user ...
    34 
    35 --> Installing DRM4G python requirements locally ...
    36 
    37 ====================================
    38 Installation of DRM4G 2.4.1 is done!
    39 ====================================
    40 
    41 In order to work with DRM4G you have to enable its
    42 environment with the command:
    43 
    44     source /home/user/drm4g/bin/drm4g_init.sh
    45 
    46 You need to run the above command on every new shell you
    47 open before using DRM4G, but just once per session.
    48 }}}
     12In order to install DRM4G, follow this link :
     13
     14* [[https://meteo.unican.es/trac/wiki/DRM4G/Installation|Installation]]
     15
     16
    4917
    5018= Start to run DRM4G =
    5119
    52 [[NoteBox(note, If the the directory `~/.drm4g` does not exist\, `drm4g` will create one with a local configuration)]]
    53 
    54 1. Enable DRM4G:
    55 {{{
    56 #!sh
    57 [user@mycomputer~]$ source $HOME/drm4g/bin/drm4g_init.sh
    58 }}}
    59201. Start up DRM4G :
    6021{{{
     
    9354
    9455
     56
    9557= My first job =
    9658
     
    143105  0   done ---- 19:39:09 19:39:27 0:00:10 0:00:01 0    date.job localhost/fork         
    144106 }}}
    145 1. In this job template, the results from the job are standard output (stdout) and standard error (stderr), both files will be in the same directory of the sob submision:
     1071. In this job template, the results from the job are the standard output (stdout) and standard error (stderr), both files will be in the same directory of the job submision:
    146108 {{{#!sh
    147109 [user@mycomputer~]$ cat stdout.0
     
    151113 }}}
    152114
     115
     116
    153117= How to configure a TORQUE/PBS resource =
    154118
    155119Before starting, configure a public/private key pair for your ssh connection:
    156120
    157 1. Generate a public/private key pair without password :
     1211. Generate a public/private key pair **without password** :
    158122{{{
    159123#!sh
     
    166130}}}
    167131
    168 [[NoteBox(note, DRM4G uses the following environmental variable `EDITOR` to select which editor is going to be used for configuring resources. By default the editor is `vi`)]]
     132[[NoteBox(note, DRM4G uses the environment variable `EDITOR` to select which editor is going to be used for configuring resources. By default the editor is `vi`)]]
    169133
    170134In order to configure a TORQUE/PBS cluster accessed through ssh protocol, you can follow the next steps:
     
    196160max_jobs_in_queue = 2
    197161}}}
    198 1. List and check if resource has been created successfully :
     1621. List and check if the resource has been created successfully :
    199163{{{
    200164#!sh
     
    212176That's it! Now, you can summit jobs to both resources.
    213177
     178
     179
    214180= User Scenarios =
    215181
    216 In this section it will be described how to take advantage of `DRM4G` to calculate the number Pi. To do that, three types of jobs '''single''', '''array''' and '''mpi''' will be used.
     182This section will describe how to take advantage of `DRM4G` to calculate the number Pi. To do that, three types of jobs '''single''', '''array''' and '''mpi''' will be used.
     183
     184
    217185
    218186== Single Job ==
     
    236204./pi_serial $@
    237205}}}
     206
     207
     208
    238209== Array Job ==
    239210