Changes between Version 33 and Version 34 of ESGFNodeTutorial


Ignore:
Timestamp:
Jul 10, 2017 8:03:13 PM (4 years ago)
Author:
zequi
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • ESGFNodeTutorial

    v33 v34  
    11= ESGF Local Node Deployment Tutorial =
    22
    3 This page shows how to deploy an ESGF Node that provides data, index and idp services and belongs to the esgf-test federation. The purpose of this node is to test the process of publication in the ESGF.
    4 
    5 This page assumes that command are executed by the root user (not sudo).
     3This page shows how to deploy an ESGF Node that provides data and index services and belongs to the esgf-test federation. The purpose of this node is to test the process of publication in the ESGF before publishing into production.
     4
     5This page assumes that command are executed by the root user (or sudo -s).
    66
    77== Index ==
     
    8888
    8989{{{
    90 [root@spock bin]# wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/esgf-installer/2.4/esg-bootstrap --no-check-certificate
     90[root@spock bin]# wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/esgf-installer/2.5/esg-bootstrap --no-check-certificate
    9191[root@spock bin]# chmod 555 ./esg-bootstrap
    9292[root@spock bin]# ./esg-bootstrap
     
    104104{{{
    105105[root@spock bin]# ./esg-node --version
    106 Version: v2.4.24-master-release
    107 Release: Bifrost
     106[VERIFIED]
     107Version: v2.5.9-master-release
     108Release: Midgard
    108109Earth Systems Grid Federation (http://esgf.llnl.gov)
    109110ESGF Node Installation Script
     
    112113Set node's type:
    113114{{{
    114 [root@spock bin]# ./esg-node --set-type data idp index
    115 node type set to: [ index data idp ] (28)
     115[root@localhost bin]# ./esg-node --set-type data index
     116node type set to: [ data index ] (12)
    116117}}}
    117118
     
    119120
    120121{{{
    121 [root@spock bin]# ./esg-node --install
    122 }}}
    123 
    124 {{{
     122[root@localhost bin]# ./esg-node --install
    125123Please select the ESGF distribution mirror for this installation (fastest to slowest):
    126         -------------------------------------------
    127          [1] http://dist.ceda.ac.uk/esgf
    128          [2] http://esg-dn2.nsc.liu.se/esgf
    129          [3] http://aims1.llnl.gov/esgf
    130          [4] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf
    131         -------------------------------------------
    132 select [1] > 1
    133 }}}
    134 
    135 {{{
    136 Are you ready to begin the installation? [Y/n]
    137 Configured host IP address does not match available IPs...
    138 Detected multiple IP addresses bound to this host...
    139 Please select the IP address to use for this installation
    140         -------------------------------------------
    141         [0] : 193.xxx.xxx.xxx
    142         [1] : 192.xxx.xxx.xxx
    143         -------------------------------------------
    144 select [] > (select the one that fits your case)
    145 }}}
    146 
    147 {{{
    148 Welcome to the ESGF Node installation program! :-)
    149 
    150 What is the fully qualified domain name of this node? [spock.meteo.unican.es]:
     124        -------------------------------------------
     125         [1] http://dist.ceda.ac.uk/esgf
     126         [2] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf
     127         [3] http://esg-dn2.nsc.liu.se/esgf
     128         [4] http://aims1.llnl.gov/esgf
     129        -------------------------------------------
     130select [1] >
     131}}}
     132
     133{{{
     134What is the fully qualified domain name of this node? [localhost.localdomain]: spock.meteo.unican.es
    151135What is the admin password to use for this installation? (alpha-numeric only) []:
    152136Please re-enter password:
    153 What is the name of your organization? [unican]:
    154 Please give this node a "short" name: []: unican
    155 Please give this node a more descriptive "long" name []: unican
    156 What is the namespace to use for this node? (set to your reverse fqdn - Ex: "gov.llnl") [es.unican.meteo]:
     137What is the name of your organization? [localhost]: Unican
     138Please give this node a "short" name: []: Unican
     139Please give this node a more descriptive "long" name []: Unican
     140What is the namespace to use for this node? (set to your reverse fqdn - Ex: "gov.llnl") []: es.unican.meteo.spock
    157141What peer group(s) will this node participate in? (esgf-test|esgf-prod) [esgf-test]:
    158 What is the default peer to this node? [spock.meteo.unican.es]:
    159 What is the hostname of the node do you plan to publish to? [spock.meteo.unican.es]:
    160 What email address should notifications be sent as? []:
    161 Is the database external to this node? [y/N]:
    162 Please enter the database connection string...
    163  (form: postgresql://[username]@[host]:[port]/esgcet)
     142What is the default peer to this node? [spock.meteo.unican.es]: VESGINT-IDX.IPSL.UPMC.FR
     143What is the hostname of the node do you plan to publish to? [VESGINT-IDX.IPSL.UPMC.FR]:
     144What email address should notifications be sent as? []: YOUR-EMAIL
     145Is the database external to this node? [y/N]:
    164146What is the database connection string? [postgresql://dbsuper@localhost:5432/esgcet]: postgresql://
    165 entered: postgresql://dbsuper@localhost:5432/esgcet
    166 What is the (low priv) db account for publisher? [esgcet]:
     147What is the (low priv) db account for publisher? [esgcet]:
    167148What is the db password for publisher user (esgcet)? []:
    168149}}}
    169150
    170151{{{
     152Starting Postgress...
     153Starting postgresql service:                               [  OK  ]
     1540 S postgres  5614     1  6  80   0 - 53982 poll_s 17:52 ?        00:00:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data
     1551 S postgres  5631  5614  0  80   0 - 44735 poll_s 17:52 ?        00:00:00 postgres: logger process                         
     1561 S postgres  5633  5614  0  80   0 - 53982 poll_s 17:52 ?        00:00:00 postgres: writer process                         
     1571 S postgres  5634  5614  0  80   0 - 53982 poll_s 17:52 ?        00:00:00 postgres: wal writer process                     
     1581 S postgres  5635  5614  0  80   0 - 54015 poll_s 17:52 ?        00:00:00 postgres: autovacuum launcher process             
     1591 S postgres  5636  5614  0  80   0 - 44734 poll_s 17:52 ?        00:00:00 postgres: stats collector process                 
    171160Enter password for postgres user dbsuper:
    172161Re-enter password for postgres user dbsuper:
     162
    173163Please Enter PostgreSQL port number [5432]:>
    174164}}}
     
    176166{{{
    177167Would you like a "system" or "user" publisher configuration:
    178         -------------------------------------------
    179         *[1] : System
    180         [2] : User
    181         -------------------------------------------
    182         [C] : (Custom)
    183         -------------------------------------------
     168        -------------------------------------------
     169        *[1] : System
     170        [2] : User
     171        -------------------------------------------
     172        [C] : (Custom)
     173        -------------------------------------------
    184174select [1] >
    185175
     
    188178
    189179Is this correct? [Y/n]
     180
    190181Your publisher configuration file will be: /esg/config/esgcet/esg.ini
    191 What is your organization's id? [unican]:
    192 }}}
    193 
    194 {{{
    195 Would you like to use the DN: (OU=ESGF.ORG, O=ESGF) ? [Y/n]:
    196 ...
     182What is your organization's id? [Unican]:
     183}}}
     184
     185{{{
     186Would you like to configure this node for CMIP6 publishing (additional project dependencies will be installed)? [y/N]
     187}}}
     188
     189{{{
     190[VERIFIED]
     191Looking for keystore [/esg/config/tomcat/keystore-tomcat]... (don't see one)...
     192Keystore setup:
     193Launching Java's keytool:
     194store_password = ******
     195Would you like to use the DN: (OU=ESGF.ORG, O=ESGF) ? [Y/n]:
     196
    197197Please enter the password for this keystore   :
     198Please re-enter the password for this keystore:
    198199}}}
    199200
     
    206207}}}
    207208
    208 {{{
    209 Create user credentials
    210 Please enter username for tomcat [dnode_user]: 
    211 Please enter password for user, "dnode_user" [********]:
    212 Would you like to add another user? [y/N]:
    213 }}}
    214 
    215 {{{
    216 Please Enter the public (i.e. routable) IP address of this host [193.xxx.xxx.xxx]:>
    217 Do you wish to use an external IDP peer?(N/y):
    218 }}}
    219 
    220 {{{
    221 Do you want to continue with the Globus installation and setup? [Y/n] :
    222 Do you want to register the MyProxy server with Globus? [Y/n]:
    223 Please provide a Globus username []: YOUR-GLOBUS-USER
    224 Globus password []:
    225 }}}
    226 
    227 When finished, you should see something like this:
    228 
    229 {{{
    230 Running Node Services...
    231 node type: [ data index idp ] (29)
    232 ---------------------------
    233 myproxy-s 23071     root    5u  IPv4 1526752      0t0  TCP *:7512 (LISTEN)
    234 java      26088     solr   28u  IPv6 1591850      0t0  TCP 127.0.0.1:7983 (LISTEN)
    235 java      26088     solr   92u  IPv6 1591986      0t0  TCP *:8983 (LISTEN)
    236 java      26257     solr   28u  IPv6 1592730      0t0  TCP 127.0.0.1:7984 (LISTEN)
    237 java      26257     solr   92u  IPv6 1593098      0t0  TCP *:8984 (LISTEN)
    238 postmaste 29509 postgres    3u  IPv6 1449862      0t0  TCP [::1]:5432 (LISTEN)
    239 postmaste 29509 postgres    4u  IPv4 1449863      0t0  TCP 127.0.0.1:5432 (LISTEN)
    240 httpd     12706     root    4u  IPv6 1512235      0t0  TCP *:80 (LISTEN)
    241 ---------------------------
    242 
    243 
    244 
    245 Finished!...
    246 In order to see if this node has been installed properly you may direct your browser to:
    247 http://spock.meteo.unican.es/thredds
    248 http://spock.meteo.unican.es/esg-orp
    249 http://spock.meteo.unican.es/
    250 
    251 Your peer group membership -- : [esgf-test]
    252 Your specified "default" peer : [spock.meteo.unican.es]
    253 Your specified "index" peer - : [spock.meteo.unican.es] (url = http://spock.meteo.unican.es/)
    254 Your specified "idp" peer --- : [spock.meteo.unican.es] (name = SPOCK.METEO.UNICAN.ES)
    255 Your temporary certificates have been placed in /etc/tempcerts
    256 You can install them by executing this : esg-node --install-keypair /etc/tempcerts/hostcert.pem /etc/tempcerts/hostkey.pem
    257 When promped for the chainfile, specify: /etc/tempcerts/cacert.pem
    258 
    259 [Note: Use UNIX group permissions on /esg/content/thredds/esgcet to enable users to be able to publish thredds catalogs from data therein]
    260  %> chgrp -R <appropriate unix group for publishing users> /esg/content/thredds
    261 
    262         -------------------------------------------------------
    263         Administrators of this node should subscribe to the
    264         esgf-node-admins@lists.llnl.gov by sending email to: majordomo@lists.llnl.gov
    265         with the body: subscribe esgf-node-admins
    266         -------------------------------------------------------
    267 
    268 v2.4.24-master-release
    269 
    270 Writing additional settings to db. If these settings already exist, psql will report an error, but ok to disregard.
    271 ERROR:  insert or update on table "permission" violates foreign key constraint "permission_user_id_fkey"
    272 DETAIL:  Key (user_id)=(1) is not present in table "user".
    273 Node installation is complete.
    274 }}}
     209
     210
     211
     212
     213
     214
     215
     216
     217
     218
     219
     220
     221
     222
     223
     224
     225
     226
     227
     228
     229
     230
     231
     232
     233
    275234
    276235Execute the following: