wiki:WRF4G2.0/Tutorial2

Version 16 (modified by carlos, 6 years ago) (diff)

--

How to run a demo experiment

Please note that WRF4G is going to be installed on a Grid User Interface named ui.meteo.unican.es, and this machine is configured as a GridFTP server as well.

  1. Install WRF4G :
    [user@ui~]$ wget -O- https://meteo.unican.es/work/WRF4G/install.sh | bash
    ==========================
    WRF4G installation script
    ==========================
    
    --> Downloading wrf4g_x86_64_versions from https://meteo.unican.es/work/WRF4G ...
    
    2015-02-13 13:07:09 URL:https://meteo.unican.es/work/WRF4G/wrf4g_x86_64_versions [36/36] -> "wrf4g_x86_64_versions" [1]
    
    This script will install WRF4G version: 2.2.1
    
    --> Downloading wrf4g-2.2.1-x86_64.tar.gz from https://meteo.unican.es/work/WRF4G ...
    
    2015-02-13 13:07:09 URL:https://meteo.unican.es/work/WRF4G/wrf4g-2.2.1-x86_64.tar.gz [1486041/1486041] -> "wrf4g-2.2.1-x86_64.tar.gz" [1]
    
    --> Unpacking wrf4g-2.2.1-x86_64.tar.gz in directory /home/user ...
    
    ====================================
    Installation of WRF4G 2.2.1 is done!
    ====================================
    
    In order to work with WRF4G you have to enable its 
    environment with the command:
    
        . /home/user/wrf4g/bin/wrf4g_init.sh
    
    You need to run the above command on every new shell you 
    open before using WRF4G, but just once per session.
    
    [user@ui~]$ . /home/user/wrf4g/bin/wrf4g_init.sh
    
  2. Start up WRF4G :
    [user@ui~]$ wrf4g start
    Starting DRM4G .... 
     OK
    
  3. Configure the esrVO resource. If the grid user interface has defined LCG_GFAL_INFOSYS and MYPROXY_SERVER variables, you do not have to indicate bdii and myproxy_server keys in your configuration:
    [user@ui~]$ wrf4g resource edit
    [esrVO]
    enable         = true
    communicator   = local
    username       = user
    frontend       = ui.meteo.unican.es
    lrms           = cream
    vo             = esr
    bdii           = bdii.grid.sara.nl:2170
    myproxy_server = px.grid.sara.nl
    
  4. List and check if resource has been created successfully :
    [user@ui~]$ wrf4g resource list
    RESOURCE            STATE               
    esrVO               enabled
    
  5. List the CEs available on the esr VO:
    [user@ui~]$ wrf4g host list
    HID ARCH       JOBS(R/T) LRMS       HOST
    0   x86_64           0/0 cream-pbs  esrVO::cream.afroditi.hellasgrid.gr
    1   x86_64           0/0 cream-pbs  esrVO::ce1.ipgp.fr    
    2   x86_64           0/0 cream-pbs  esrVO::cr1.ipp.acad.bg
    3   x86_64           0/0 cream-pbs  esrVO::sbgce2.in2p3.fr
    4   x86_64           0/0 cream-pbs  esrVO::ce0.bordeaux.inra.fr
    5   x86_64           0/0 cream-pbs  esrVO::cce.ihep.ac.cn 
    6   x86_64           0/0 cream-pbs  esrVO::ce02.ngcc.acad.bg
    7   x86_64           0/0 cream-pbs  esrVO::ce01.macc.unican.es
    8   x86_64           0/0 cream-pbs  esrVO::cygnus.grid.rug.nl
    9   x86_64           0/0 cream-pbs  esrVO::t2ce06.physics.ox.ac.uk
    10  x86_64           0/0 cream-lsf  esrVO::ce1.ts.infn.it 
    11  x86_64           0/0 cream-lsf  esrVO::gridce1.pi.infn.it
    12  x86_64           0/0 cream-lsf  esrVO::gridce3.pi.infn.it
    13  x86_64           0/0 cream-pbs  esrVO::cream02.grid.uoi.gr
    14  x86_64           0/0 cream-pbs  esrVO::lapp-ce02.in2p3.fr
    15  x86_64           0/0 cream-pbs  esrVO::grid002.jet.efda.org
    16  x86_64           0/0 cream-lsf  esrVO::gridce4.pi.infn.it
    17  x86_64           0/0 cream-lsf  esrVO::gridce0.pi.infn.it
    18  x86_64           0/0 cream-lsf  esrVO::gridce2.pi.infn.it
    19  x86_64           0/0 cream-pbs  esrVO::t2ce06.physics.ox.ac.uk
    20  x86_64           0/0 cream-pbs  esrVO::grid0.fe.infn.it
    21  x86_64           0/0 cream-pbs  esrVO::ce0.m3pec.u-bordeaux1.fr
    22  x86_64           0/0 cream-pbs  esrVO::juk.nikhef.nl  
    23  x86_64           0/0 cream-pbs  esrVO::gridce.ilc.cnr.it
    24  x86_64           0/0 cream-lsf  esrVO::cert-37.pd.infn.it
    25  x86_64           0/0 cream-pbs  esrVO::cream-ce-2.ba.infn.it
    26  x86_64           0/0 cream-sge  esrVO::cccreamceli09.in2p3.fr
    27  x86_64           0/0 cream-sge  esrVO::cccreamceli10.in2p3.fr
    28  x86_64           0/0 cream-pbs  esrVO::gazon.nikhef.nl
    29  x86_64           0/0 cream-pbs  esrVO::klomp.nikhef.nl
    30  x86_64           0/0 cream-pbs  esrVO::cream-ce-3.ba.infn.it
    31  x86_64           0/0 cream-pbs  esrVO::cream-ce-4.ba.infn.it
    32  x86_64           0/0 cream-pbs  esrVO::creamce.gina.sara.nl
    33  x86_64           0/0 cream-lsf  esrVO::prod-ce-01.pd.infn.it
    34  x86_64           0/0 cream-pbs  esrVO::creamce2.gina.sara.nl
    35  x86_64           0/0 cream-pbs  esrVO::creamce3.gina.sara.nl
    36  x86_64           0/0 cream-slur esrVO::ce3.ui.savba.sk
    37  x86_64           0/0 cream-pbs  esrVO::glite-cream.scai.fraunhofer.de
    38  x86_64           0/0 cream-pbs  esrVO::cream-ce02.marie.hellasgrid.gr
    39  x86_64           0/0 cream-pbs  esrVO::cream-ce01.marie.hellasgrid.gr
    40  x86_64           0/0 cream-pbs  esrVO::fal-pygrid-44.lancs.ac.uk
    41  x86_64           0/0 cream-pbs  esrVO::hepgrid6.ph.liv.ac.uk
    42  x86_64           0/0 cream-pbs  esrVO::cream-ce01.ariagni.hellasgrid.gr
    43  x86_64           0/0 cream-pbs  esrVO::snf-189278.vm.okeanos.grnet.gr
    44  x86_64           0/0 cream-pbs  esrVO::snf-458754.vm.okeanos.grnet.gr
    45  x86_64           0/0 cream-pbs  esrVO::hepgrid5.ph.liv.ac.uk
    46  x86_64           0/0 cream-pbs  esrVO::cream01.kallisto.hellasgrid.gr
    47  x86_64           0/0 cream-pbs  esrVO::hepgrid10.ph.liv.ac.uk
    48  x86_64           0/0 cream-pbs  esrVO::hepgrid97.ph.liv.ac.uk
    
  6. Create an identity for 7 days:
    [user@ui~]$ wrf4g id esrVO init
    --> Create a local proxy credential ... 
    Insert your Grid password: 
    Your identity: /DC=es/DC=irisgrid/O=unican/CN=user
    Creating proxy ........................................................................................... Done
    Proxy Verify OK
    Your proxy is valid until: Thu Feb 26 21:37:19 2015
    Your identity: /DC=es/DC=irisgrid/O=unican/CN=user
    Creating proxy .................................................................... Done
    Proxy Verify OK
    A proxy valid for 168 hours (7.0 days) for user /DC=es/DC=irisgrid/O=unican/CN=user now exists on px.grid.sara.nl.
    
  7. Define an experiment called test from a template :
    [user@ui~]$ wrf4g exp test define --from-template=single
    
  8. Take a look at test experiment configuration :
    [user@ui~]$ cat test/experiment.wrf4g 
    [DEFAULT]
    # Experiment configuration
    name                 = test
    # Simulation domain
    max_dom              = 1
    # Experiment time-specification
    #                      start_date          | end_date            | chunk_size_h
    date_time            = 2011-08-28_12:00:00 | 2011-08-30_00:00:00 | 12
    calendar             = standard
    timestep_dxfactor    = 6
    # Running options 
    np                   = 1
    requirements         = ARCH = "x86_64"
    clean_after_run      = yes
    save_wps             = no
    real_parallel        = no
    wrf_parallel         = yes
    # Input data
    domain_path          = /home/user/WRF4G_2_0/repository/domains/Santander_50km
    # Vtables must exist as Vtable.[input_extdata]
    extdata_vtable       = GFS 
    extdata_path         = /home/user/WRF4G_2_0/repository/input/NCEP/GFS
    # Seconds between global analysis input times
    extdata_interval     = 21600     
    preprocessor         = default
    # Output
    output_path          = /home/user/test/output
    postprocessor        = SFC
    wrfout_name_end_date = no
    # app
    app                  = wrf_all_in_one | bundle | /home/user/WRF4G_2_0/repository/apps/WRF/WRFbin-3.4.1_r2265_gfortran.tar.gz
    # WRF-namelist parameters. Override namelist.input variables here
    namelist_version     = 3.4.1
    namelist             = spec_bdy_width     | 10
                           spec_zone          | 1
                           relax_zone         | 9
                           feedback           | 0
                           history_interval   | 180
                           frames_per_outfile | 3
                           e_vert             | 28
                           mp_physics         | 4   
                           radt               | 15
                           ra_lw_physics      | 3
                           ra_sw_physics      | 3
    
  9. Update paths to use ui.meteo.unican.es as a GridFTP server( WRF4G supports several source paths ) :
    [user@ui~]$ cat test/experiment.wrf4g 
    [DEFAULT]
    # Experiment configuration
    name                 = test
    # Simulation domain
    max_dom              = 1
    # Experiment time-specification
    #                      start_date          | end_date            | chunk_size_h
    date_time            = 2011-08-28_12:00:00 | 2011-08-30_00:00:00 | 12
    calendar             = standard
    timestep_dxfactor    = 6
    # Running options 
    np                   = 1
    requirements         = ARCH = "x86_64"
    clean_after_run      = yes
    save_wps             = no
    real_parallel        = no
    wrf_parallel         = yes
    # Input data
    domain_path          = gsiftp://ui.meteo.unican.es/home/user/WRF4G_2_0/repository/domains/Santander_50km
    # Vtables must exist as Vtable.[input_extdata]
    extdata_vtable       = GFS 
    extdata_path         = gsiftp://ui.meteo.unican.es/home/user/WRF4G_2_0/repository/input/NCEP/GFS
    # Seconds between global analysis input times
    extdata_interval     = 21600     
    preprocessor         = default
    # Output
    output_path          = gsiftp://ui.meteo.unican.es/home/user/test/output
    postprocessor        = SFC
    wrfout_name_end_date = no
    # app
    app                  = wrf_all_in_one | bundle | gsiftp://ui.meteo.unican.es/home/user/WRF4G_2_0/repository/apps/WRF/WRFbin-3.4.1_r2265_gfortran.tar.gz
    # WRF-namelist parameters. Override namelist.input variables here
    namelist_version     = 3.4.1
    namelist             = spec_bdy_width     | 10
                           spec_zone          | 1
                           relax_zone         | 9
                           feedback           | 0
                           history_interval   | 180
                           frames_per_outfile | 3
                           e_vert             | 28
                           mp_physics         | 4   
                           radt               | 15
                           ra_lw_physics      | 3
                           ra_sw_physics      | 3
    
  10. Create the test experiment on WRF4G :
    [user@ui~]$ wrf4g exp test create --dir test 
    Checking the variables in experiment.wrf4g file
    Preparing namelist...
    ---> Realization test_20110828T120000
            ---> Chunk 1 2011-08-28_12:00:00 2011-08-29_00:00:00
            ---> Chunk 2 2011-08-29_00:00:00 2011-08-29_12:00:00
            ---> Chunk 3 2011-08-29_12:00:00 2011-08-30_00:00:00
    
  11. Submit the experiment :
    [user@ui~]$ wrf4g exp test submit 
    ---> Submitting Realization test_20110828T120000
            ---> Submitting Chunk 1 2011-08-28_12:00:00 2011-08-29_00:00:00
            ---> Submitting Chunk 2 2011-08-29_00:00:00 2011-08-29_12:00:00
            ---> Submitting Chunk 3 2011-08-29_12:00:00 2011-08-30_00:00:00
    
  12. Check the evolution of the experiment :
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    1/3        esrVO::ce01.macc CONF_APP        0 -     0.00
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    1/3        esrVO::ce01.macc METGRID         0 -     0.00
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    1/3        esrVO::ce01.macc WRF             0 -     0.00
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    2/3        -                SUBMITTED       1 -    33.33
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    2/3        esrVO::ce01.macc CONF_APP        1 -    33.33
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    2/3        esrVO::ce01.macc UNGRIB          1 -    33.33
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    2/3        esrVO::ce01.macc WRF             1 -    33.33
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    3/3        -                SUBMITTED       2 -    66.67
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    3/3        esrVO::ce01.macc CONF_APP        2 -    66.67
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    3/3        esrVO::ce01.macc UNGRIB          2 -    66.67
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    3/3        esrVO::ce01.macc REAL            2 -    66.67
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    RUNNING    3/3        esrVO::ce01.macc WRF             2 -    66.67
    
    [user@ui~]$ wrf4g exp test status
    REALIZATION                                             STATUS     CHUNKS     RESOURCE         RUN STATUS    JID EXT      %
    test_20110828T120000                                    FINISHED   3/3        esrVO::ce01.macc FINISHED        2 0   100.00
    
  13. Check out the output :
    [user@ui~]$ tree /home/user/test/output/test/test_20110828T120000/
    /home/user/test/output/test/test_20110828T120000/
    ├── db.conf
    ├── experiment.pkl
    ├── experiment.wrf4g
    ├── log
    │   ├── log_1_0.tar.gz
    │   ├── log_2_1.tar.gz
    │   └── log_3_2.tar.gz
    ├── namelist.input
    ├── output
    │   ├── wrfout_d01_20110828T120000Z.nc
    │   ├── wrfout_d01_20110828T210000Z.nc
    │   ├── wrfout_d01_20110829T030000Z.nc
    │   ├── wrfout_d01_20110829T120000Z.nc
    │   ├── wrfout_d01_20110829T150000Z.nc
    │   └── wrfout_d01_20110830T000000Z.nc
    ├── realout
    └── restart
        ├── wrfrst_d01_20110829T000000Z.nc
        ├── wrfrst_d01_20110829T120000Z.nc
        └── wrfrst_d01_20110830T000000Z.nc
    
    
  14. You can also check out chunk's logs. Example of chunk number 1 :
    [user@mycomputer~]$ wrf4g rea test_20110828T120000 log 1
    Unpacking /home/user/.wrf4g/var/submission/test/test_20110828T120000/log_1_0.tar.gz file in the ./ directory
    [user@mycomputer~]$ ls log_1_0
    main.log
    metgrid.log
    postprocessor.SFC.log
    preprocessor.default.log
    rsl_real
    rsl_wrf
    ungrib.log