Context Navigation

Changes between Version 33 and Version 34 of ESGFNodeTutorial

Timestamp:: Jul 10, 2017 8:03:13 PM (5 years ago)
Author:: zequi
Comment:: --

Legend:

: Unmodified
: Added
: Removed
: Modified

ESGFNodeTutorial

-                      v33
+                      v34
 = ESGF Local Node Deployment Tutorial =
 This page shows how to deploy an ESGF Node that provides data, index and idp services and belongs to the esgf-test federation. The purpose of this node is to test the process of publication in the ESGF.
 This page assumes that command are executed by the root user (not sudo).
+This page shows how to deploy an ESGF Node that provides data and index services and belongs to the esgf-test federation. The purpose of this node is to test the process of publication in the ESGF before publishing into production.
+This page assumes that command are executed by the root user (or sudo -s).
 == Index ==
 …
 {{{
 [root@spock bin]# wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/esgf-installer/2.4/esg-bootstrap --no-check-certificate
+[root@spock bin]# wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/esgf-installer/2.5/esg-bootstrap --no-check-certificate
 [root@spock bin]# chmod 555 ./esg-bootstrap
 [root@spock bin]# ./esg-bootstrap
 …
 {{{
 [root@spock bin]# ./esg-node --version
+Version: v2.4.24-master-release
+Release: Bifrost
+[VERIFIED]
+Version: v2.5.9-master-release
+Release: Midgard
 Earth Systems Grid Federation (http://esgf.llnl.gov)
 ESGF Node Installation Script
 …
 Set node's type:
 {{{
 [root@spock bin]# ./esg-node --set-type data idp index
 node type set to: [ index data idp ] (28)
+[root@localhost bin]# ./esg-node --set-type data index
+node type set to: [ data index ] (12)
 }}}
 …
 {{{
+[root@spock bin]# ./esg-node --install
+}}}
+{{{
+[root@localhost bin]# ./esg-node --install
 Please select the ESGF distribution mirror for this installation (fastest to slowest):
+        -------------------------------------------
+         [1] http://dist.ceda.ac.uk/esgf
+         [2] http://esg-dn2.nsc.liu.se/esgf
+         [3] http://aims1.llnl.gov/esgf
+         [4] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf
+        -------------------------------------------
+select [1] > 1
+}}}
+{{{
+Are you ready to begin the installation? [Y/n]
+Configured host IP address does not match available IPs...
+Detected multiple IP addresses bound to this host...
+Please select the IP address to use for this installation
+        -------------------------------------------
+        [0] : 193.xxx.xxx.xxx
+        [1] : 192.xxx.xxx.xxx
+        -------------------------------------------
+select [] > (select the one that fits your case)
+}}}
+{{{
+Welcome to the ESGF Node installation program! :-)
+What is the fully qualified domain name of this node? [spock.meteo.unican.es]:
+        -------------------------------------------
+         [1] http://dist.ceda.ac.uk/esgf
+         [2] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf
+         [3] http://esg-dn2.nsc.liu.se/esgf
+         [4] http://aims1.llnl.gov/esgf
+        -------------------------------------------
+select [1] >
+}}}
+{{{
+What is the fully qualified domain name of this node? [localhost.localdomain]: spock.meteo.unican.es
 What is the admin password to use for this installation? (alpha-numeric only) []:
 Please re-enter password:
 What is the name of your organization? [unican]:
 Please give this node a "short" name: []: unican
 Please give this node a more descriptive "long" name []: unican
 What is the namespace to use for this node? (set to your reverse fqdn - Ex: "gov.llnl") [es.unican.meteo]:
+What is the name of your organization? [localhost]: Unican
+Please give this node a "short" name: []: Unican
+Please give this node a more descriptive "long" name []: Unican
+What is the namespace to use for this node? (set to your reverse fqdn - Ex: "gov.llnl") []: es.unican.meteo.spock
 What peer group(s) will this node participate in? (esgf-test|esgf-prod) [esgf-test]:
+What is the default peer to this node? [spock.meteo.unican.es]:
+What is the hostname of the node do you plan to publish to? [spock.meteo.unican.es]:
+What email address should notifications be sent as? []:
+Is the database external to this node? [y/N]:
+Please enter the database connection string...
+ (form: postgresql://[username]@[host]:[port]/esgcet)
+What is the default peer to this node? [spock.meteo.unican.es]: VESGINT-IDX.IPSL.UPMC.FR
+What is the hostname of the node do you plan to publish to? [VESGINT-IDX.IPSL.UPMC.FR]:
+What email address should notifications be sent as? []: YOUR-EMAIL
+Is the database external to this node? [y/N]:
 What is the database connection string? [postgresql://dbsuper@localhost:5432/esgcet]: postgresql://
+entered: postgresql://dbsuper@localhost:5432/esgcet
+What is the (low priv) db account for publisher? [esgcet]:
+What is the (low priv) db account for publisher? [esgcet]:
 What is the db password for publisher user (esgcet)? []:
 }}}
 {{{
+Starting Postgress...
+Starting postgresql service:                               [  OK  ]
+S postgres  5614     1  6  80   0 - 53982 poll_s 17:52 ?        00:00:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
+S postgres  5631  5614  0  80   0 - 44735 poll_s 17:52 ?        00:00:00 postgres: logger process
+S postgres  5633  5614  0  80   0 - 53982 poll_s 17:52 ?        00:00:00 postgres: writer process
+S postgres  5634  5614  0  80   0 - 53982 poll_s 17:52 ?        00:00:00 postgres: wal writer process
+S postgres  5635  5614  0  80   0 - 54015 poll_s 17:52 ?        00:00:00 postgres: autovacuum launcher process
+S postgres  5636  5614  0  80   0 - 44734 poll_s 17:52 ?        00:00:00 postgres: stats collector process
 Enter password for postgres user dbsuper:
 Re-enter password for postgres user dbsuper:
 Please Enter PostgreSQL port number [5432]:>
 }}}
 …
 {{{
 Would you like a "system" or "user" publisher configuration:
         -------------------------------------------
         *[1] : System
          [2] : User
         -------------------------------------------
          [C] : (Custom)
         -------------------------------------------
+        -------------------------------------------
+        *[1] : System
+         [2] : User
+        -------------------------------------------
+         [C] : (Custom)
+        -------------------------------------------
 select [1] >
 …
 Is this correct? [Y/n]
 Your publisher configuration file will be: /esg/config/esgcet/esg.ini
+What is your organization's id? [unican]:
+}}}
+{{{
+Would you like to use the DN: (OU=ESGF.ORG, O=ESGF) ? [Y/n]:
+...
+What is your organization's id? [Unican]:
+}}}
+{{{
+Would you like to configure this node for CMIP6 publishing (additional project dependencies will be installed)? [y/N]
+}}}
+{{{
+[VERIFIED]
+Looking for keystore [/esg/config/tomcat/keystore-tomcat]... (don't see one)...
+Keystore setup:
+Launching Java's keytool:
+store_password = ******
+Would you like to use the DN: (OU=ESGF.ORG, O=ESGF) ? [Y/n]:
 Please enter the password for this keystore   :
+Please re-enter the password for this keystore:
 }}}
 …
 }}}
+{{{
+Create user credentials
+Please enter username for tomcat [dnode_user]:
+Please enter password for user, "dnode_user" [********]:
+Would you like to add another user? [y/N]:
+}}}
+{{{
+Please Enter the public (i.e. routable) IP address of this host [193.xxx.xxx.xxx]:>
+Do you wish to use an external IDP peer?(N/y):
+}}}
+{{{
+Do you want to continue with the Globus installation and setup? [Y/n] :
+Do you want to register the MyProxy server with Globus? [Y/n]:
+Please provide a Globus username []: YOUR-GLOBUS-USER
+Globus password []:
+}}}
+When finished, you should see something like this:
+{{{
+Running Node Services...
+node type: [ data index idp ] (29)
+---------------------------
+myproxy-s 23071     root    5u  IPv4 1526752      0t0  TCP *:7512 (LISTEN)
+java      26088     solr   28u  IPv6 1591850      0t0  TCP 127.0.0.1:7983 (LISTEN)
+java      26088     solr   92u  IPv6 1591986      0t0  TCP *:8983 (LISTEN)
+java      26257     solr   28u  IPv6 1592730      0t0  TCP 127.0.0.1:7984 (LISTEN)
+java      26257     solr   92u  IPv6 1593098      0t0  TCP *:8984 (LISTEN)
+postmaste 29509 postgres    3u  IPv6 1449862      0t0  TCP [::1]:5432 (LISTEN)
+postmaste 29509 postgres    4u  IPv4 1449863      0t0  TCP 127.0.0.1:5432 (LISTEN)
+httpd     12706     root    4u  IPv6 1512235      0t0  TCP *:80 (LISTEN)
+---------------------------
+Finished!...
+In order to see if this node has been installed properly you may direct your browser to:
+http://spock.meteo.unican.es/thredds
+http://spock.meteo.unican.es/esg-orp
+http://spock.meteo.unican.es/
+Your peer group membership -- : [esgf-test]
+Your specified "default" peer : [spock.meteo.unican.es]
+Your specified "index" peer - : [spock.meteo.unican.es] (url = http://spock.meteo.unican.es/)
+Your specified "idp" peer --- : [spock.meteo.unican.es] (name = SPOCK.METEO.UNICAN.ES)
+Your temporary certificates have been placed in /etc/tempcerts
+You can install them by executing this : esg-node --install-keypair /etc/tempcerts/hostcert.pem /etc/tempcerts/hostkey.pem
+When promped for the chainfile, specify: /etc/tempcerts/cacert.pem
+[Note: Use UNIX group permissions on /esg/content/thredds/esgcet to enable users to be able to publish thredds catalogs from data therein]
+ %> chgrp -R <appropriate unix group for publishing users> /esg/content/thredds
+        -------------------------------------------------------
+        Administrators of this node should subscribe to the
+        esgf-node-admins@lists.llnl.gov by sending email to: majordomo@lists.llnl.gov
+        with the body: subscribe esgf-node-admins
+        -------------------------------------------------------
+v2.4.24-master-release
+Writing additional settings to db. If these settings already exist, psql will report an error, but ok to disregard.
+ERROR:  insert or update on table "permission" violates foreign key constraint "permission_user_id_fkey"
+DETAIL:  Key (user_id)=(1) is not present in table "user".
+Node installation is complete.
+}}}
 Execute the following: