Changes between Version 75 and Version 76 of ESGFNodeInstallation


Ignore:
Timestamp:
Nov 19, 2013 7:34:07 PM (9 years ago)
Author:
carlos
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ESGFNodeInstallation

    v75 v76  
    595595
    596596
     597This takes place in three steps:
     598
     599* Scan each file for metadata and save the metadata in the node database. (This is in contrast to running `esgscan_directory`, which just scans the directory structure.)
     600
     601* Generate a THREDDS catalog based on the scanned information. THREDDS is a data and metadata server used by ESGF.
     602
     603* Notify the idx that one or more catalogs have been generated.
     604
     605=== File Scan Phase ===
     606
     607In order to scan the cordex files for metadata, run `esgscan_directory` to generate a mapfile and after that run `esgpublish` with input from a mapfile:
     608{{{
     609#!sh
     610$ whoami
     611esgf
     612$ cd /usr/local/uvcdat/1.4.0/bin
     613$ ./esgscan_directory -i /esg/config/esgcet/esg.ini --project cordex -o ~/cordex.txt /datasets/CORDEX
     614$ sudo ./esgunpublish -i /esg/config/esgcet/esg.ini --map ~/cordex.txt
     615INFO       2013-11-19 19:32:44,981 Deleting cordex.EUR-22.UCAN.ECMWF-ERAINT.evaluation.r1i1p1.WRF331G_v02.3hr.hfls
     616INFO       2013-11-19 19:32:45,162   Result: SUCCESSFUL
     617INFO       2013-11-19 19:32:45,173 Deleting cordex.EUR-22.UCAN.ECMWF-ERAINT.evaluation.r1i1p1.WRF331G_v02.3hr.hfss
     618INFO       2013-11-19 19:32:45,345   Result: SUCCESSFUL
     619..........................................
     620}}}
     621
     622
    597623First, obtain a digital certificate from an ESGF trusted !MyProxy server, and rename it to whatever path you have defined in esg.ini.
    598624
     
    603629$ /usr/local/globus/bin/myproxy-logon -s vesgint-idx.ipsl.jussieu.fr -l blancojc -o ~/.globus/certificate-file
    604630}}}
     631
    605632
    606633