| Version 17 (modified by carlos, 6 years ago) (diff) |
|---|
How to run a demo experiment
Please note that WRF4G is going to be installed on a Grid User Interface named ui.meteo.unican.es, and this machine is configured as a GridFTP server as well.
- Install WRF4G :
[user@ui~]$ cd $HOME [user@ui~]$ wget -O- https://meteo.unican.es/work/WRF4G/install.sh | bash ========================== WRF4G installation script ========================== --> Downloading wrf4g_x86_64_versions from https://meteo.unican.es/work/WRF4G ... 2015-02-13 13:07:09 URL:https://meteo.unican.es/work/WRF4G/wrf4g_x86_64_versions [36/36] -> "wrf4g_x86_64_versions" [1] This script will install WRF4G version: 2.2.1 --> Downloading wrf4g-2.2.1-x86_64.tar.gz from https://meteo.unican.es/work/WRF4G ... 2015-02-13 13:07:09 URL:https://meteo.unican.es/work/WRF4G/wrf4g-2.2.1-x86_64.tar.gz [1486041/1486041] -> "wrf4g-2.2.1-x86_64.tar.gz" [1] --> Unpacking wrf4g-2.2.1-x86_64.tar.gz in directory /home/user ... ==================================== Installation of WRF4G 2.2.1 is done! ==================================== In order to work with WRF4G you have to enable its environment with the command: . /home/user/wrf4g/bin/wrf4g_init.sh You need to run the above command on every new shell you open before using WRF4G, but just once per session. [user@ui~]$ . /home/${USER}/wrf4g/bin/wrf4g_init.sh
- Start up WRF4G :
[user@ui~]$ wrf4g start Starting DRM4G .... OK Starting ssh-agent ... OK
- Configure the esrVO resource. If the grid user interface has defined LCG_GFAL_INFOSYS and MYPROXY_SERVER variables, you do not have to indicate bdii and myproxy_server keys in your configuration:
[user@ui~]$ wrf4g resource edit [esrVO] enable = true communicator = local username = user frontend = ui.meteo.unican.es lrms = cream vo = esr bdii = bdii.grid.sara.nl:2170 myproxy_server = px.grid.sara.nl
- List and check if resource has been created successfully :
[user@ui~]$ wrf4g resource list RESOURCE STATE esrVO enabled
- List the CEs available on the esr VO:
[user@ui~]$ wrf4g host list HID ARCH JOBS(R/T) LRMS HOST 0 x86_64 0/0 cream-pbs esrVO::cream.afroditi.hellasgrid.gr 1 x86_64 0/0 cream-pbs esrVO::ce1.ipgp.fr 2 x86_64 0/0 cream-pbs esrVO::cr1.ipp.acad.bg 3 x86_64 0/0 cream-pbs esrVO::sbgce2.in2p3.fr 4 x86_64 0/0 cream-pbs esrVO::ce0.bordeaux.inra.fr 5 x86_64 0/0 cream-pbs esrVO::cce.ihep.ac.cn 6 x86_64 0/0 cream-pbs esrVO::ce02.ngcc.acad.bg 7 x86_64 0/0 cream-pbs esrVO::ce01.macc.unican.es 8 x86_64 0/0 cream-pbs esrVO::cygnus.grid.rug.nl 9 x86_64 0/0 cream-pbs esrVO::t2ce06.physics.ox.ac.uk 10 x86_64 0/0 cream-lsf esrVO::ce1.ts.infn.it 11 x86_64 0/0 cream-lsf esrVO::gridce1.pi.infn.it 12 x86_64 0/0 cream-lsf esrVO::gridce3.pi.infn.it 13 x86_64 0/0 cream-pbs esrVO::cream02.grid.uoi.gr 14 x86_64 0/0 cream-pbs esrVO::lapp-ce02.in2p3.fr 15 x86_64 0/0 cream-pbs esrVO::grid002.jet.efda.org 16 x86_64 0/0 cream-lsf esrVO::gridce4.pi.infn.it 17 x86_64 0/0 cream-lsf esrVO::gridce0.pi.infn.it 18 x86_64 0/0 cream-lsf esrVO::gridce2.pi.infn.it 19 x86_64 0/0 cream-pbs esrVO::t2ce06.physics.ox.ac.uk 20 x86_64 0/0 cream-pbs esrVO::grid0.fe.infn.it 21 x86_64 0/0 cream-pbs esrVO::ce0.m3pec.u-bordeaux1.fr 22 x86_64 0/0 cream-pbs esrVO::juk.nikhef.nl 23 x86_64 0/0 cream-pbs esrVO::gridce.ilc.cnr.it 24 x86_64 0/0 cream-lsf esrVO::cert-37.pd.infn.it 25 x86_64 0/0 cream-pbs esrVO::cream-ce-2.ba.infn.it 26 x86_64 0/0 cream-sge esrVO::cccreamceli09.in2p3.fr 27 x86_64 0/0 cream-sge esrVO::cccreamceli10.in2p3.fr 28 x86_64 0/0 cream-pbs esrVO::gazon.nikhef.nl 29 x86_64 0/0 cream-pbs esrVO::klomp.nikhef.nl 30 x86_64 0/0 cream-pbs esrVO::cream-ce-3.ba.infn.it 31 x86_64 0/0 cream-pbs esrVO::cream-ce-4.ba.infn.it 32 x86_64 0/0 cream-pbs esrVO::creamce.gina.sara.nl 33 x86_64 0/0 cream-lsf esrVO::prod-ce-01.pd.infn.it 34 x86_64 0/0 cream-pbs esrVO::creamce2.gina.sara.nl 35 x86_64 0/0 cream-pbs esrVO::creamce3.gina.sara.nl 36 x86_64 0/0 cream-slur esrVO::ce3.ui.savba.sk 37 x86_64 0/0 cream-pbs esrVO::glite-cream.scai.fraunhofer.de 38 x86_64 0/0 cream-pbs esrVO::cream-ce02.marie.hellasgrid.gr 39 x86_64 0/0 cream-pbs esrVO::cream-ce01.marie.hellasgrid.gr 40 x86_64 0/0 cream-pbs esrVO::fal-pygrid-44.lancs.ac.uk 41 x86_64 0/0 cream-pbs esrVO::hepgrid6.ph.liv.ac.uk 42 x86_64 0/0 cream-pbs esrVO::cream-ce01.ariagni.hellasgrid.gr 43 x86_64 0/0 cream-pbs esrVO::snf-189278.vm.okeanos.grnet.gr 44 x86_64 0/0 cream-pbs esrVO::snf-458754.vm.okeanos.grnet.gr 45 x86_64 0/0 cream-pbs esrVO::hepgrid5.ph.liv.ac.uk 46 x86_64 0/0 cream-pbs esrVO::cream01.kallisto.hellasgrid.gr 47 x86_64 0/0 cream-pbs esrVO::hepgrid10.ph.liv.ac.uk 48 x86_64 0/0 cream-pbs esrVO::hepgrid97.ph.liv.ac.uk
- Create an identity for 7 days:
[user@ui~]$ wrf4g id esrVO init --> Create a local proxy credential ... Insert your Grid password: Your identity: /DC=es/DC=irisgrid/O=unican/CN=user Creating proxy ........................................................................................... Done Proxy Verify OK Your proxy is valid until: Thu Feb 26 21:37:19 2015 Your identity: /DC=es/DC=irisgrid/O=unican/CN=user Creating proxy .................................................................... Done Proxy Verify OK A proxy valid for 168 hours (7.0 days) for user /DC=es/DC=irisgrid/O=unican/CN=user now exists on px.grid.sara.nl.
- Define an experiment called test from a template :
[user@ui~]$ wrf4g exp test define --from-template=single
- Take a look at test experiment configuration :
[user@ui~]$ cat test/experiment.wrf4g [DEFAULT] # Experiment configuration name = test # Simulation domain max_dom = 1 # Experiment time-specification # start_date | end_date | chunk_size_h date_time = 2011-08-28_12:00:00 | 2011-08-30_00:00:00 | 12 calendar = standard timestep_dxfactor = 6 # Running options np = 1 requirements = ARCH = "x86_64" clean_after_run = yes save_wps = no real_parallel = no wrf_parallel = yes # Input data domain_path = /home/user/WRF4G_2_0/repository/domains/Santander_50km # Vtables must exist as Vtable.[input_extdata] extdata_vtable = GFS extdata_path = /home/user/WRF4G_2_0/repository/input/NCEP/GFS # Seconds between global analysis input times extdata_interval = 21600 preprocessor = default # Output output_path = /home/user/test/output postprocessor = SFC wrfout_name_end_date = no # app app = wrf_all_in_one | bundle | /home/user/WRF4G_2_0/repository/apps/WRF/WRFbin-3.4.1_r2265_gfortran.tar.gz # WRF-namelist parameters. Override namelist.input variables here namelist_version = 3.4.1 namelist = spec_bdy_width | 10 spec_zone | 1 relax_zone | 9 feedback | 0 history_interval | 180 frames_per_outfile | 3 e_vert | 28 mp_physics | 4 radt | 15 ra_lw_physics | 3 ra_sw_physics | 3
- Update paths to use ui.meteo.unican.es as a GridFTP server( WRF4G supports several source paths ) :
[user@ui~]$ cat test/experiment.wrf4g [DEFAULT] # Experiment configuration name = test # Simulation domain max_dom = 1 # Experiment time-specification # start_date | end_date | chunk_size_h date_time = 2011-08-28_12:00:00 | 2011-08-30_00:00:00 | 12 calendar = standard timestep_dxfactor = 6 # Running options np = 1 requirements = ARCH = "x86_64" clean_after_run = yes save_wps = no real_parallel = no wrf_parallel = yes # Input data domain_path = gsiftp://ui.meteo.unican.es/home/user/WRF4G_2_0/repository/domains/Santander_50km # Vtables must exist as Vtable.[input_extdata] extdata_vtable = GFS extdata_path = gsiftp://ui.meteo.unican.es/home/user/WRF4G_2_0/repository/input/NCEP/GFS # Seconds between global analysis input times extdata_interval = 21600 preprocessor = default # Output output_path = gsiftp://ui.meteo.unican.es/home/user/test/output postprocessor = SFC wrfout_name_end_date = no # app app = wrf_all_in_one | bundle | gsiftp://ui.meteo.unican.es/home/user/WRF4G_2_0/repository/apps/WRF/WRFbin-3.4.1_r2265_gfortran.tar.gz # WRF-namelist parameters. Override namelist.input variables here namelist_version = 3.4.1 namelist = spec_bdy_width | 10 spec_zone | 1 relax_zone | 9 feedback | 0 history_interval | 180 frames_per_outfile | 3 e_vert | 28 mp_physics | 4 radt | 15 ra_lw_physics | 3 ra_sw_physics | 3
- Create the test experiment on WRF4G :
[user@ui~]$ wrf4g exp test create --dir test Checking the variables in experiment.wrf4g file Checking the variables in experiment.wrf4g file Preparing namelist 3.4.1 version ... WRF Check Warning: Trimming variable start_year. WRF Check Warning: Trimming variable start_month. WRF Check Warning: Trimming variable start_day. WRF Check Warning: Trimming variable start_hour. WRF Check Warning: Trimming variable start_minute. WRF Check Warning: Trimming variable start_second. WRF Check Warning: Trimming variable end_year. WRF Check Warning: Trimming variable end_month. WRF Check Warning: Trimming variable end_day. WRF Check Warning: Trimming variable end_hour. WRF Check Warning: Trimming variable end_minute. WRF Check Warning: Trimming variable end_second. WRF Check Warning: Trimming variable input_from_file. WRF Check Warning: Trimming variable history_interval. WRF Check Warning: Trimming variable frames_per_outfile. WRF Check Warning: Trimming variable e_we. WRF Check Warning: Trimming variable e_sn. WRF Check Warning: Trimming variable e_vert. WRF Check Warning: Trimming variable dx. WRF Check Warning: Trimming variable dy. WRF Check Warning: Trimming variable grid_id. WRF Check Warning: Trimming variable parent_id. WRF Check Warning: Trimming variable i_parent_start. WRF Check Warning: Trimming variable j_parent_start. WRF Check Warning: Trimming variable parent_grid_ratio. WRF Check Warning: Trimming variable parent_time_step_ratio. WRF Check Warning: Trimming variable mp_physics. WRF Check Warning: Trimming variable ra_lw_physics. WRF Check Warning: Trimming variable ra_sw_physics. WRF Check Warning: Trimming variable radt. WRF Check Warning: Trimming variable sf_sfclay_physics. WRF Check Warning: Trimming variable sf_surface_physics. WRF Check Warning: Trimming variable bl_pbl_physics. WRF Check Warning: Trimming variable bldt. WRF Check Warning: Trimming variable cu_physics. WRF Check Warning: Trimming variable cudt. WRF Check Warning: Trimming variable sf_urban_physics. WRF Check Warning: Trimming variable diff_6th_opt. WRF Check Warning: Trimming variable diff_6th_factor. WRF Check Warning: Trimming variable zdamp. WRF Check Warning: Trimming variable dampcoef. WRF Check Warning: Trimming variable khdif. WRF Check Warning: Trimming variable kvdif. WRF Check Warning: Trimming variable non_hydrostatic. WRF Check Warning: Trimming variable moist_adv_opt. WRF Check Warning: Trimming variable scalar_adv_opt. WRF Check Warning: Trimming variable specified. WRF Check Warning: Trimming variable nested. WRF Check Warning: radt is shorter than dx (0.500000) WRF Check Warning: CAM radiation selected but paerlev/levsiz/cam_abs_dim1/cam_abs_dim2 was not set. Fixing... ---> Realization test-default-20110828T120000: start date 2011-08-28 12:00:00 end date 2011-08-30 00:00:00 ---> Chunk 1 2011-08-28_12:00:00 2011-08-29_00:00:00 ---> Chunk 2 2011-08-29_00:00:00 2011-08-29_12:00:00 ---> Chunk 3 2011-08-29_12:00:00 2011-08-30_00:00:00
- Submit the experiment :
[user@ui~]$ wrf4g exp test submit ---> Submitting Realization test-default-20110828T120000 ---> Submitting Chunk 1 2011-08-28_12:00:00 2011-08-29_00:00:00 ---> Submitting Chunk 2 2011-08-29_00:00:00 2011-08-29_12:00:00 ---> Submitting Chunk 3 2011-08-29_12:00:00 2011-08-30_00:00:00
- Check the evolution of the experiment :
[user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 1/3 esrVO::ce01.macc CONF_APP 0 - 0.00 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 1/3 esrVO::ce01.macc METGRID 0 - 0.00 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 1/3 esrVO::ce01.macc WRF 0 - 0.00 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 2/3 - SUBMITTED 1 - 33.33 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 2/3 esrVO::ce01.macc CONF_APP 1 - 33.33 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 2/3 esrVO::ce01.macc UNGRIB 1 - 33.33 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 2/3 esrVO::ce01.macc WRF 1 - 33.33 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 3/3 - SUBMITTED 2 - 66.67 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 3/3 esrVO::ce01.macc CONF_APP 2 - 66.67 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 3/3 esrVO::ce01.macc UNGRIB 2 - 66.67 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 3/3 esrVO::ce01.macc REAL 2 - 66.67 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 RUNNING 3/3 esrVO::ce01.macc WRF 2 - 66.67 [user@ui~]$ wrf4g exp test status REALIZATION STATUS CHUNKS RESOURCE RUN STATUS JID EXT % test-default-20110828T120000 FINISHED 3/3 esrVO::ce01.macc FINISHED 2 0 100.00
- Check out the output :
[user@ui~]$ tree $HOME/test/output/test/test-default-20110828T120000/ /home/user/test/output/test/test-default-20110828T120000/ ├── db.conf ├── experiment.wrf4g ├── log │ ├── log_1_0.tar.gz │ ├── log_2_1.tar.gz │ └── log_3_2.tar.gz ├── namelist.input ├── output │ ├── wrfout_d01_20110828T120000Z.nc │ ├── wrfout_d01_20110828T210000Z.nc │ ├── wrfout_d01_20110829T030000Z.nc │ ├── wrfout_d01_20110829T120000Z.nc │ ├── wrfout_d01_20110829T150000Z.nc │ └── wrfout_d01_20110830T000000Z.nc ├── realization.json ├── realout └── restart ├── wrfrst_d01_20110829T000000Z.nc ├── wrfrst_d01_20110829T120000Z.nc └── wrfrst_d01_20110830T000000Z.nc
- You can also check out chunk's logs. Example of chunk number 1 :
[user@ui~]$ wrf4g rea test-default-20110828T120000 log 1 Unpacking /home/user/.wrf4g/var/submission/test/test-default-20110828T120000/log_1_0.tar.gz file in the ./ directory [user@ui~]$ ls log_1_0 main.log metgrid.log postprocessor.SFC.log preprocessor.default.log rsl_real rsl_wrf ungrib_GFS.log
