Changes between Version 75 and Version 76 of ESGFNodeInstallation

Timestamp:

Nov 19, 2013 7:34:07 PM (8 years ago)

Author:

carlos

Comment:

--

ESGFNodeInstallation

@@ -595 +595 @@
 
 
+This takes place in three steps:
+
+* Scan each file for metadata and save the metadata in the node database. (This is in contrast to running `esgscan_directory`, which just scans the directory structure.)
+
+* Generate a THREDDS catalog based on the scanned information. THREDDS is a data and metadata server used by ESGF.
+
+* Notify the idx that one or more catalogs have been generated.
+
+=== File Scan Phase ===
+
+In order to scan the cordex files for metadata, run `esgscan_directory` to generate a mapfile and after that run `esgpublish` with input from a mapfile:
+{{{
+#!sh
+$ whoami 
+esgf
+$ cd /usr/local/uvcdat/1.4.0/bin
+$ ./esgscan_directory -i /esg/config/esgcet/esg.ini --project cordex -o ~/cordex.txt /datasets/CORDEX
+$ sudo ./esgunpublish -i /esg/config/esgcet/esg.ini --map ~/cordex.txt 
+INFO       2013-11-19 19:32:44,981 Deleting cordex.EUR-22.UCAN.ECMWF-ERAINT.evaluation.r1i1p1.WRF331G_v02.3hr.hfls
+INFO       2013-11-19 19:32:45,162   Result: SUCCESSFUL
+INFO       2013-11-19 19:32:45,173 Deleting cordex.EUR-22.UCAN.ECMWF-ERAINT.evaluation.r1i1p1.WRF331G_v02.3hr.hfss
+INFO       2013-11-19 19:32:45,345   Result: SUCCESSFUL
+..........................................
+}}}
+
+
 First, obtain a digital certificate from an ESGF trusted !MyProxy server, and rename it to whatever path you have defined in esg.ini. 
 
@@ -603 +629 @@
 $ /usr/local/globus/bin/myproxy-logon -s vesgint-idx.ipsl.jussieu.fr -l blancojc -o ~/.globus/certificate-file
 }}}
+