Changes between Version 33 and Version 34 of ESGFNodeTutorial
- Timestamp:
- Jul 10, 2017 8:03:13 PM (5 years ago)
Legend:
- Unmodified
- Added
- Removed
- Modified
-
ESGFNodeTutorial
v33 v34 1 1 = ESGF Local Node Deployment Tutorial = 2 2 3 This page shows how to deploy an ESGF Node that provides data , index and idp services and belongs to the esgf-test federation. The purpose of this node is to test the process of publication in the ESGF.4 5 This page assumes that command are executed by the root user ( not sudo).3 This page shows how to deploy an ESGF Node that provides data and index services and belongs to the esgf-test federation. The purpose of this node is to test the process of publication in the ESGF before publishing into production. 4 5 This page assumes that command are executed by the root user (or sudo -s). 6 6 7 7 == Index == … … 88 88 89 89 {{{ 90 [root@spock bin]# wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/esgf-installer/2. 4/esg-bootstrap --no-check-certificate90 [root@spock bin]# wget -O esg-bootstrap http://distrib-coffee.ipsl.jussieu.fr/pub/esgf/dist/devel/esgf-installer/2.5/esg-bootstrap --no-check-certificate 91 91 [root@spock bin]# chmod 555 ./esg-bootstrap 92 92 [root@spock bin]# ./esg-bootstrap … … 104 104 {{{ 105 105 [root@spock bin]# ./esg-node --version 106 Version: v2.4.24-master-release 107 Release: Bifrost 106 [VERIFIED] 107 Version: v2.5.9-master-release 108 Release: Midgard 108 109 Earth Systems Grid Federation (http://esgf.llnl.gov) 109 110 ESGF Node Installation Script … … 112 113 Set node's type: 113 114 {{{ 114 [root@ spock bin]# ./esg-node --set-type data idpindex115 node type set to: [ index data idp ] (28)115 [root@localhost bin]# ./esg-node --set-type data index 116 node type set to: [ data index ] (12) 116 117 }}} 117 118 … … 119 120 120 121 {{{ 121 [root@spock bin]# ./esg-node --install 122 }}} 123 124 {{{ 122 [root@localhost bin]# ./esg-node --install 125 123 Please select the ESGF distribution mirror for this installation (fastest to slowest): 126 ------------------------------------------- 127 [1] http://dist.ceda.ac.uk/esgf 128 [2] http://esg-dn2.nsc.liu.se/esgf 129 [3] http://aims1.llnl.gov/esgf 130 [4] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf 131 ------------------------------------------- 132 select [1] > 1 133 }}} 134 135 {{{ 136 Are you ready to begin the installation? [Y/n] 137 Configured host IP address does not match available IPs... 138 Detected multiple IP addresses bound to this host... 139 Please select the IP address to use for this installation 140 ------------------------------------------- 141 [0] : 193.xxx.xxx.xxx 142 [1] : 192.xxx.xxx.xxx 143 ------------------------------------------- 144 select [] > (select the one that fits your case) 145 }}} 146 147 {{{ 148 Welcome to the ESGF Node installation program! :-) 149 150 What is the fully qualified domain name of this node? [spock.meteo.unican.es]: 124 ------------------------------------------- 125 [1] http://dist.ceda.ac.uk/esgf 126 [2] http://distrib-coffee.ipsl.jussieu.fr/pub/esgf 127 [3] http://esg-dn2.nsc.liu.se/esgf 128 [4] http://aims1.llnl.gov/esgf 129 ------------------------------------------- 130 select [1] > 131 }}} 132 133 {{{ 134 What is the fully qualified domain name of this node? [localhost.localdomain]: spock.meteo.unican.es 151 135 What is the admin password to use for this installation? (alpha-numeric only) []: 152 136 Please re-enter password: 153 What is the name of your organization? [ unican]:154 Please give this node a "short" name: []: unican155 Please give this node a more descriptive "long" name []: unican156 What is the namespace to use for this node? (set to your reverse fqdn - Ex: "gov.llnl") [ es.unican.meteo]:137 What is the name of your organization? [localhost]: Unican 138 Please give this node a "short" name: []: Unican 139 Please give this node a more descriptive "long" name []: Unican 140 What is the namespace to use for this node? (set to your reverse fqdn - Ex: "gov.llnl") []: es.unican.meteo.spock 157 141 What peer group(s) will this node participate in? (esgf-test|esgf-prod) [esgf-test]: 158 What is the default peer to this node? [spock.meteo.unican.es]: 159 What is the hostname of the node do you plan to publish to? [spock.meteo.unican.es]: 160 What email address should notifications be sent as? []: 161 Is the database external to this node? [y/N]: 162 Please enter the database connection string... 163 (form: postgresql://[username]@[host]:[port]/esgcet) 142 What is the default peer to this node? [spock.meteo.unican.es]: VESGINT-IDX.IPSL.UPMC.FR 143 What is the hostname of the node do you plan to publish to? [VESGINT-IDX.IPSL.UPMC.FR]: 144 What email address should notifications be sent as? []: YOUR-EMAIL 145 Is the database external to this node? [y/N]: 164 146 What is the database connection string? [postgresql://dbsuper@localhost:5432/esgcet]: postgresql:// 165 entered: postgresql://dbsuper@localhost:5432/esgcet 166 What is the (low priv) db account for publisher? [esgcet]: 147 What is the (low priv) db account for publisher? [esgcet]: 167 148 What is the db password for publisher user (esgcet)? []: 168 149 }}} 169 150 170 151 {{{ 152 Starting Postgress... 153 Starting postgresql service: [ OK ] 154 0 S postgres 5614 1 6 80 0 - 53982 poll_s 17:52 ? 00:00:00 /usr/bin/postmaster -p 5432 -D /var/lib/pgsql/data 155 1 S postgres 5631 5614 0 80 0 - 44735 poll_s 17:52 ? 00:00:00 postgres: logger process 156 1 S postgres 5633 5614 0 80 0 - 53982 poll_s 17:52 ? 00:00:00 postgres: writer process 157 1 S postgres 5634 5614 0 80 0 - 53982 poll_s 17:52 ? 00:00:00 postgres: wal writer process 158 1 S postgres 5635 5614 0 80 0 - 54015 poll_s 17:52 ? 00:00:00 postgres: autovacuum launcher process 159 1 S postgres 5636 5614 0 80 0 - 44734 poll_s 17:52 ? 00:00:00 postgres: stats collector process 171 160 Enter password for postgres user dbsuper: 172 161 Re-enter password for postgres user dbsuper: 162 173 163 Please Enter PostgreSQL port number [5432]:> 174 164 }}} … … 176 166 {{{ 177 167 Would you like a "system" or "user" publisher configuration: 178 179 180 181 182 183 168 ------------------------------------------- 169 *[1] : System 170 [2] : User 171 ------------------------------------------- 172 [C] : (Custom) 173 ------------------------------------------- 184 174 select [1] > 185 175 … … 188 178 189 179 Is this correct? [Y/n] 180 190 181 Your publisher configuration file will be: /esg/config/esgcet/esg.ini 191 What is your organization's id? [unican]: 192 }}} 193 194 {{{ 195 Would you like to use the DN: (OU=ESGF.ORG, O=ESGF) ? [Y/n]: 196 ... 182 What is your organization's id? [Unican]: 183 }}} 184 185 {{{ 186 Would you like to configure this node for CMIP6 publishing (additional project dependencies will be installed)? [y/N] 187 }}} 188 189 {{{ 190 [VERIFIED] 191 Looking for keystore [/esg/config/tomcat/keystore-tomcat]... (don't see one)... 192 Keystore setup: 193 Launching Java's keytool: 194 store_password = ****** 195 Would you like to use the DN: (OU=ESGF.ORG, O=ESGF) ? [Y/n]: 196 197 197 Please enter the password for this keystore : 198 Please re-enter the password for this keystore: 198 199 }}} 199 200 … … 206 207 }}} 207 208 208 {{{ 209 Create user credentials 210 Please enter username for tomcat [dnode_user]: 211 Please enter password for user, "dnode_user" [********]: 212 Would you like to add another user? [y/N]: 213 }}} 214 215 {{{ 216 Please Enter the public (i.e. routable) IP address of this host [193.xxx.xxx.xxx]:> 217 Do you wish to use an external IDP peer?(N/y): 218 }}} 219 220 {{{ 221 Do you want to continue with the Globus installation and setup? [Y/n] : 222 Do you want to register the MyProxy server with Globus? [Y/n]: 223 Please provide a Globus username []: YOUR-GLOBUS-USER 224 Globus password []: 225 }}} 226 227 When finished, you should see something like this: 228 229 {{{ 230 Running Node Services... 231 node type: [ data index idp ] (29) 232 --------------------------- 233 myproxy-s 23071 root 5u IPv4 1526752 0t0 TCP *:7512 (LISTEN) 234 java 26088 solr 28u IPv6 1591850 0t0 TCP 127.0.0.1:7983 (LISTEN) 235 java 26088 solr 92u IPv6 1591986 0t0 TCP *:8983 (LISTEN) 236 java 26257 solr 28u IPv6 1592730 0t0 TCP 127.0.0.1:7984 (LISTEN) 237 java 26257 solr 92u IPv6 1593098 0t0 TCP *:8984 (LISTEN) 238 postmaste 29509 postgres 3u IPv6 1449862 0t0 TCP [::1]:5432 (LISTEN) 239 postmaste 29509 postgres 4u IPv4 1449863 0t0 TCP 127.0.0.1:5432 (LISTEN) 240 httpd 12706 root 4u IPv6 1512235 0t0 TCP *:80 (LISTEN) 241 --------------------------- 242 243 244 245 Finished!... 246 In order to see if this node has been installed properly you may direct your browser to: 247 http://spock.meteo.unican.es/thredds 248 http://spock.meteo.unican.es/esg-orp 249 http://spock.meteo.unican.es/ 250 251 Your peer group membership -- : [esgf-test] 252 Your specified "default" peer : [spock.meteo.unican.es] 253 Your specified "index" peer - : [spock.meteo.unican.es] (url = http://spock.meteo.unican.es/) 254 Your specified "idp" peer --- : [spock.meteo.unican.es] (name = SPOCK.METEO.UNICAN.ES) 255 Your temporary certificates have been placed in /etc/tempcerts 256 You can install them by executing this : esg-node --install-keypair /etc/tempcerts/hostcert.pem /etc/tempcerts/hostkey.pem 257 When promped for the chainfile, specify: /etc/tempcerts/cacert.pem 258 259 [Note: Use UNIX group permissions on /esg/content/thredds/esgcet to enable users to be able to publish thredds catalogs from data therein] 260 %> chgrp -R <appropriate unix group for publishing users> /esg/content/thredds 261 262 ------------------------------------------------------- 263 Administrators of this node should subscribe to the 264 esgf-node-admins@lists.llnl.gov by sending email to: majordomo@lists.llnl.gov 265 with the body: subscribe esgf-node-admins 266 ------------------------------------------------------- 267 268 v2.4.24-master-release 269 270 Writing additional settings to db. If these settings already exist, psql will report an error, but ok to disregard. 271 ERROR: insert or update on table "permission" violates foreign key constraint "permission_user_id_fkey" 272 DETAIL: Key (user_id)=(1) is not present in table "user". 273 Node installation is complete. 274 }}} 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 275 234 276 235 Execute the following: