Version 11 (modified by antonio, 9 years ago) (diff) |
---|
Table of Contents
This installation guide will provide instrucctions about how to install an ESGF data/compute node. For this example, a VM with 1 core, 2GB of RAM and 20GB of Disk. For the installation process it's recommended to provide more cores than 1 core.
Pre-requisites
TCP and UDP ports firewall configuration [[FootNote(...)]]
Corporate Firewall
Port | Direction | Type | Application | Description |
80 | in | tcp | Tomcat | Web server access |
443 | in | tcp | Tomcat | SSL - Secure Web Server Access. |
5432 | in | tcp | Postgres | Postgres Access. (not external: by default bound ONLY TO LOCAL INTERFACE) |
2811 | in | tcp | GridFTP | user-configured GridFTP Server control channel |
(60000-61000) | in/out | tcp | GridFTP | user-configured GridFTP Server data channel (or as defined in the global variable GLOBUS_TCP_PORT_RANGE) |
2812 | in | tcp | GridFTP | BDM-configured GridFTP Server control channel. May run together with the user-configured one though not recommended - system resource intensive! |
(60000-61000) | in/out | tcp | GridFTP | BDM-configured GridFTP Server data channel. May run together with the user-configured one though not recommended - system resource intensive! |
7512 | out | tcp | MyProxy | MyProxy client access to the certificate repository |
8984 | - | tcp | esgf-search (Tomcat) | local connection to the Solr master instance (not external!) |
8983 | in/out | tcp | esgf-search (Tomcat) | Connection to remotes Solr slave instance. Used in distributed search (shard). |
80 | out | tcp | esg-publisher | Local connection to THREDDS server (e.g., to check catalogs) and other nodes (node-manager) |
443 | out | tcp | esg-publisher | Local secure connection to THREDDS server (e.g., to restart the application) and to the idp |
IPTables configuration
Add these rules to the IPTables configuration file, i.e. /etc/sysconfig/iptables
-A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 80 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 443 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 2811 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 2812 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 8984 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 8983 -j ACCEPT -A INPUT -m state --state NEW -m tcp -p tcp --dport 60000:61000 -j ACCEPT
and restart IPTables services
$ services iptables restart
Install RPM packages
Install the sourceforge RPM repository for the *ExtUtils* packages:
$ rpm -i -U -h http://dag.wieers.com/packages/rpmforge-release/rpmforge-release-0.3.6-1.el4.rf.x86_64.rpm
And now the ESGF required RPM packages
$ yum install autoconf automake bison file flex gcc gcc-c++ gettext-devel libtool libuuid-devel libxml2 libxml2-devel libxslt libxslt-devel lsof make openssl-devel pam-devel pax readline-devel tk-devel wget zlib-devel perl-Archive-Tar perl-XML-Parser libX11-devel libtool-ltdl-devel e2fsprogs-devel.x86_64 gcc-gfortran libicu-devel.x86_64 libgtextutils-devel.x86_64 perl-ExtUtils-AutoInstall.noarch perl-ExtUtils-Depends.noarch perl-ExtUtils-CBuilder.x86_64 perl-ExtUtils-CChecker.x86_64 perl-ExtUtils-Config.noarch perl-ExtUtils-DynaGlue.noarch perl-ExtUtils-Embed.x86_64 perl-ExtUtils-F77.noarch perl-ExtUtils-FakeConfig.noarch perl-ExtUtils-FindFunctions.noarch perl-ExtUtils-H2PM.noarch perl-ExtUtils-Helpers.noarch perl-ExtUtils-InstallPaths.noarch perl-ExtUtils-MakeMaker.x86_64 perl-ExtUtils-MakeMaker-Coverage.noarch perl-ExtUtils-ParseXS.x86_64 perl-ExtUtils-PerlPP.noarch perl-ExtUtils-PkgConfig.noarch perl-ExtUtils-TBone.noarch perl-ExtUtils-XSBuilder.noarch
Please make sure that the ntp package is installed: $ yum install ntp
User configuration
Add the esgf user:
$ adduser esgf ... $ passwd esgf ...
configure esgf user with sudoers privileges. Add the following line to /etc/sudoers
esgf ALL=(ALL) ALL
Instaall the ESGF data/compute node
As reference guide the instructions used has been provided by IPSL1.
$ cd /usr/local/bin $ wget -O esg-bootstrap http://198.128.245.140/dist/esgf-installer/esg-bootstrap $ diff <(md5sum esg-bootstrap | tr -s " " | cut -d " " -f 1) <(curl -s http://198.128.245.140/dist/esgf-installer/esg-bootstrap.md5 | tr -s " " | cut -d " " -f 1) $ chmod 555 esg-bootstrap $ esg-bootstrap --devel
Data Publishing
Attachments (8)
- esgcet_models_table.txt (424 bytes) - added by carlos 9 years ago.
- esg.ini (7.3 KB) - added by carlos 9 years ago.
- localopenssl.cnf (9.7 KB) - added by terryk 8 years ago.
- Datanodemgr-doc.pdf (213.7 KB) - added by terryk 8 years ago.
- chain.pem (4.7 KB) - added by terryk 8 years ago.
- ESGF_node_resource_estimate.pdf (446.3 KB) - added by antonio 8 years ago.
- geoiplookup0.2.sh (571 bytes) - added by terryk 8 years ago.
- is-enes2_statistics.txt (10.9 KB) - added by terryk 8 years ago.
Download all attachments as: .zip