Changes between Version 7 and Version 8 of WRF4GInstall


Ignore:
Timestamp:
Sep 6, 2011 11:09:08 AM (11 years ago)
Author:
valva
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • WRF4GInstall

    v7 v8  
    11[[TOC]]
     2
     3== WRF4G Components ==
     4
     5WRF4G is a software that has 2 main components, one runs in the '''user's interface (UI)''' (usually their PCs) and manages the experiments and the resources used by the experiment. This component is in charge of the design, execution and monitoring of experiments. Once submitted to a resource, WRF4G start to run in a '''Computing Node'''.
     6
     7A user can use the following resources as Computing Nodes:
     8* The same UI where their are running the WRF4G framework.
     9* Workstation or stand-alone server.
     10* Cluster (PBS, SGE, SLURM)
     11* Mainframe HPC.
     12* Grid infrastructures (currently supported globus and gLite)
     13
     14In the examples shown bellow, we will use only a Computing Node that will be the UI where the framework is running.
     15
    216== Required Software ==
    317
    4 WRF4G need the following software preinstalled:
     18WRF4G need the following software preinstalled both in the UI and the Computing Nodes:
    519
    620 * '''Python''', version >= 2.4 and < 3.0.
     
    1933 * Download and unpack the distribution file  [http://meteo.macc.unican.es/work/WRF4G.tar.gz WRF4G.tar.gz] to the installation directory, for example your $HOME directory.
    2034{{{
    21 cd $install_path (i.e cd $HOME)
     35cd $WRF4G_INSTALL_PATH (i.e cd $HOME)
    2236wget http://meteo.macc.unican.es/work/WRF4G.tar.gz
    2337tar xzvf WRF4G.tar.gz
    2438}}}
    2539
    26  * Set up the WRF4G user environment. (To avoid typing the export command everytime you want to use WRF4G, it is advisable to copy this line in $HOME/.bashrc)
     40 * Setup the WRF4G user environment. (To avoid typing the export command every time you want to use WRF4G, it is advisable to copy this line in $HOME/.bashrc)
    2741
    2842{{{
    29 export WRF4G_LOCATION=$install_path/WRF4G
    30 export GW_LOCATION=$WRF4G_LOCATION/opt/drm4g_gridway-5.7
     43export WRF4G_LOCATION=$WRF4G_INSTALL_PATH/WRF4G
    3144export PATH=$WRF4G_LOCATION/bin:$GW_LOCATION/bin:$PATH
    3245}}}
    3346
    34 == Quickstart Guide ==
    35  * A video with the main steps can be downloaded from [http://meteo.macc.unican.es/work/WRF4Gdemo.mpeg here]
    36  * Start the WRF4G Framework:
     47== Veryfing installation ==
     48
     49A video with the main steps can be downloaded from [http://meteo.macc.unican.es/work/WRF4Gdemo.mpeg here]
     50
     51* Start the WRF4G Framework. This command will start the services needed by WRF4G to run.
    3752
    3853{{{
     
    4055}}}
    4156
    42          
    43  * Launch an example in the local machine:
     57* List the computing resources available.
    4458
    4559{{{
     60$ ~/wrf4g$ wrf4g_resources
     61HID PRIO OS              ARCH  MHZ  %CPU    MEM(F/T)     DISK(F/T)      N(U/F/T) LRMS               HOSTNAME                     
     620   1    GNU/Linux2.6.32 unkno 1000    0   1822/3270     2139/8662         0/1/1 FORK               mycomputer
     63}}}
     64             
     65* Launch the test experiment in the machine where WRF4G is installed:
     66  * Go to the folder where the experiment configuration files are located:
     67{{{
    4668cd $WRF4G_LOCATION/experiments/single/testc
    47 wrf4g_submitter.sh
    4869}}}
    4970
    50  * Run wrf4g_ps to see the jobs' status
     71  * Prepare and submit the experiment:
     72{{{
     73valva@sipc18:~/pruebasWRF/WRF4G/experiments/single/testc$ wrf4g_prepare
     74valva@sipc18:~/pruebasWRF/WRF4G/experiments/single/testc$ wrf4g_submit
     75}}}
     76
     77  * Run wrf4g_status to see the jobs' status
    5178
    5279{{{
    53 valva@sipc18:~/pruebasWRF/WRF4G/experiments/single/testc$ wrf4g_ps
     80valva@sipc18:~/pruebasWRF/WRF4G/experiments/single/testc$ wrf4g_status -e testc
    5481Realization Status   Chunks     Comp.Res   WN         Run.Sta       ext   %
    5582testc       Done     3/3        mycomputer sipc18     Finished       0 100.00
    5683}}}
    57   * wrf4g_ps returns the following information:
    58     * Realization: Realization name. It is taken from the field experiment_name in experiment.wrf4g.
    59     * Status: It can be take the following values: Prepared, Submitted, Running, Failed and Done).
    60     * Chunks [Chunk running/Total Chunks]: A realization is split into chunks. Each chunk is sent as a job.
    61     * Computer resource: Resource (cluster) where the job is running.
    62     * WN: Computing node where the job is running.
    63     * Run.Sta: Job status in the WN (Downloading data, running ungrib, real, wrf, ...)
    64     * ext: Exit Code. If exit code is different from 0, there has been an error. Error codes are explained in $WRF4G_LOCATION/lib/bash/wrf4g_exit_codes.sh
    65     * % : percentage of simulation finished.
    6684
    67 
    68  * Check the simulation output and log files in $WRF4G_LOCATION/repository/output
    69 
    70 '''To run a different experiment, you only need to modify the following files according to your needs:'''
    71 
    72  * experiment.wrf4g: Experiment configuration: type of experment, simulation dates, restarts, physics,...
    73  * resources.wrf4g: With this file the resources used by a WRF experiment are configured: data repository, number of processes for MPI, version of WRF to run,.. By default there is a file that stores a configuration that affects to every experiment ($WRF4G_LOCATION/etc/resources.wrf4g). If a file with this name (resources.wrf4g) is found in the folder where experiment.wrf4g is stored, this file will be used instead of the application one ($WRF4G_LOCATION/etc/resources.wrf4g)
    74  * $WRF4G_LOCATION/etc/framework4g.conf: Database and computing resources configuration. After modifying this file, '''wrf4g_framework restart''' must be run.
    75 
    76 For example, to add a new PBS cluster to run jobs:
    77 
    78  * First modify the file $WRF4G_LOCATION/etc/framework4g.conf to add more resources ([https://meteo.macc.unican.es/trac/WRF4G/wiki/DRM4G More information about how to add resources]):
    79 {{{
    80 mycomputer         local://localhost?LRMS_TYPE=fork;NODECOUNT=1
    81 ui01              local://localhost?LRMS_TYPE=pbs;QUEUE_NAME=estadistica
    82 }}}
    83 
    84  * Change the following fields in $WRF4G_LOCATION/etc/resources.wrf4g or copy $WRF4G_LOCATION/etc/resources.wrf4g where experiment.wrf4g is located:
    85    * The repository data if the cluster do not access them directly.
    86    * NP to the number of MPI processess you want to use
    87    * REQUIREMENTS if you want to choose the resource that will run the experiment. REQUIREMENTS ='HOSTNAME = "*ui01*";'
    88 
    89  * Restart the wrf4g_framework: '''wrf4g_framework restart'''
    90  * Submit the experiment with a different name (change the name in experiment.wrf4g)
    91 {{{
    92 cd $WRF4G_LOCATION/experiments/single/snd50c
    93 wrf4g_submitter.sh
    94 }}}
    95 
    96 == Veryfing installation ==
    97  * List the computing resources available for running jobs.
    98 
    99 {{{
    100 $ ~/wrf4g$ gwhost
    101 HID PRIO OS              ARCH  MHZ  %CPU    MEM(F/T)     DISK(F/T)      N(U/F/T) LRMS               HOSTNAME                     
    102 0   1    GNU/Linux2.6.32 unkno 1000    0   1822/3270     2139/8662         0/1/1 FORK               mycomputer
    103 }}}
    104          
    10585 
    10686== Problems ==