Changes between Version 1 and Version 2 of WRF4SG


Ignore:
Timestamp:
Apr 8, 2013 4:25:07 PM (9 years ago)
Author:
carlos
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • WRF4SG

    v1 v2  
    11= WRF4SG =
     2
     3[[PageOutline(1-10,Page Contents)]]
     4
     5== WS-PGRADE/gUSE ==
     6
     7
     8gUSE (grid User Support Environment) is a DCI virtualization environment providing a scalable set of high-level services by which interoperation between DCIs and user communities can be achieved.
     9
     10The WS-PGRADE Portal is a web portal of the gUSE and it is the second generation P-GRADE portal that introduces many advanced features both at the workflow and architecture level. It supports development and submission of distributed applications executed on the computational resources of various distributed computing infrastructures (DCIs) including clusters, service grids (ARC, gLite, Globus, UNICORE), BOINC desktop grids and Google App Engine cloud.
     11
     12It explicitly distinguishes between two different types of user communities: application developers and end-users. Through a dedicated view, the application developers have access to all the advanced workflow features (graph, abstract workflow, template, application and project) to develop new workflow applications.
     13
     14The built-in gUSE repository stores the workflow objects published by the application developers, to be downloaded and further developed by the community. The gUSE repository provides a forum for collaboration and enables workflow sharing between application developers.
     15
     16
     17The newest version is available for download from !SourceForge :[http://sourceforge.net/projects/guse/ gUSE Download]
     18
     19=== Interesting Presentations ===
     20
     21[attachment:'introduction.pptx'​ Introduction to WS-PGRADE]
     22
     23[attachment:'workflow.pptx' How to create a WS-PGRADE workflow​]
     24
     25[attachment:'Application Specific Module_overall.ppt​' Application Specific Module_overall]
     26
     27[attachment:'Application Specific Module_Details.ppt​​' Application Specific Module_Details]
     28
     29[attachment:'MyFirstWorkflow-tutorial1.pdf​​​' My First Workflow]
     30[attachment:'AdvancedWorkflow-tutorial2.pdf​​​' Advanced Workflow]
     31
     32
     33=== Architecture ===
     34
     35The release of gUSE comes together with the Liferay-based WS-PGRADE portal. gUSE is a set of high-level grid services (including workflow manager, storage, broker, grid-submitters for various types of grids, etc. services). It also includes a graphical portal service based on Liferay technology.
     36
     37gUSE is implemented as a set of Web services that bind together in flexible ways on demand to deliver user services in Grid and/or Web services environments. User interfaces for gUSE services are provided by the WS-PGRADE Web application.
     38
     39[[Image(http://www.guse.hu/images/GUSE_Architecture341_s.png)]]
     40
     41The lowest level of the architecture is the services of Web service, Grid service networks. Grid services typically provide job execution, large scale file storage and brokering services in a secured way, while Web services make pre-defined computational algorithms accessible via SOAP messages. gUSE services connect to this tier to perform computation, data management on behalf of the users.
     42
     43==== WS-PGRADE ====
     44
     45The new release of gUSE comes together with the Liferay-based WS-PGRADE portal. It also includes a graphical portal service based on Liferay technology.
     46
     47User interfaces for gUSE services are provided by the WS-PGRADE Web application. WS-PGRADE is a Web portal hosted in a standard portal framework. WS-PGRADE uses the client APIs of gUSE services to turn user requests into sequences of gUSE specific Web service calls. WS-PGRADE hides the communication protocols and sequences behind JSR286 compliant portlets. End users can access WS-PGRADE via Web browsers. A graph editor component can be downloaded from WS-PGRADE via the browser to the user machine. The editor can be used to define the static skeleton of workflows, while the HTML pages of WS-PGRADE provide interfaces to add content to graphs, to generate complete !Grid/Web service applications
     48
     49==== DCI-Bridge ====
     50
     51DCI-Bridge is implemented as a set of Web services that bind together in flexible ways on demand to deliver user services in Grid and/or cluster and/or cloud and/or Web services environments.
     52
     53DCI Bridge is a web application (sevice) that provides standard access to the distributed computing infrastructures (DCIs) like grids, desktop grids, clusters, clouds and service based computational resources by implementing the specification of the OGSA Basic Execution Service 1.0.
     54
     55The DCI Bridge web application creates a transparent layer between the users (workflow systems) and the DCI systems. The user can submit jobs to the various DCI systems using the OGSA Basic Execution Service (BES) interface defined [http://www.ogf.org/documents/GFD.108.pdf here]. As a result, the users do not have to learn the access protocol of the various DCI systems since they are hidden behind the BES interface.
     56
     57The DCI Bridge gives support to the use of the Meta Broker which is able to choose the most ideal environment for the job from the available execution resources. The DCI Bridge will do the task in this specified environment.
     58
     59[[Image(http://www.guse.hu/images/DCI_Bridge_new.png)]]
     60
     61* Resource registry
     62 * Online configuration interface
     63 * !ResourceConfiguration service
     64
     65* Runtime system
     66 * BESFactoryService service
     67 * Job registry
     68 * Proxy manager
     69 * Executor layer handler
     70 * Input queue
     71 * Meta Broker client
     72 * Middleware plugin and queue handler
     73 * Output queue
     74 * Status manager
     75
     76* Application management
     77 * BESManagement and online interface for its use
     78
     79* Monitor
     80 * Application monitor + online interface
     81 * Plugin monitor + online interface
     82 * Job monitor + online interface
     83
     84
     85The job of the Resource Registry subsystem is to provide an online configuration interface to be able to configure the resources which can be called by the DCI Bridge. Also it provides information about the configured resources to other external software components. For the configuration of the resources an online interface is available which is part of the web application. The access to this interface is controlled with container authentication. The available resource publishing goes through on the !ResourceConfiguration service which is accessible with http/https protocol as a generic web service.
     86
     87The job of the Application Management subsystem is the implementation of BES-Management Port-type from the fifth volume of the OGSA Basic Execution Service 1.0 specification which makes possible to supervise the software based access of the BES Factory service.
     88
     89The Runtime System does the effective job running. The subsystem can be called with a service made by OGF which implements the BES WSDL and it makes the operations defined by the OGSA Basic Execution Service 1.0 specification on different grid/cloud/service based middlewares. The separate running systems can be handled with plugins and their numbers can be increased without any restriction.
     90
     91The job of the Monitor subsystem is to handle and visualize the logs and messages of the DCI Bridge, the plugins and the running jobs.
     92
     93===== Connected middlewares =====
     94
     95* [http://globus.org/toolkit/docs/2.4/ GT2], [http://globus.org/toolkit/docs/2.4/ GT4], [http://www.globus.org/toolkit/docs/5.2/5.2.2/ GT5]
     96* [http://dev.globus.org/wiki/Incubator/GEMLCA GEMLCA]
     97* [https://twiki.cern.ch/twiki/bin/view/LCG/GenericInstallGuide320 gLite]
     98* [http://www.clusterresources.com/torquedocs/ PBS]
     99* [https://developers.google.com/appengine/?hl=hu-HU GAE]
     100* [http://www.unicore.eu/ UNICORE]     
     101* [http://www.nordugrid.org/documents/arc-client-install.html ARC]
     102* [http://www-03.ibm.com/systems/technicalcomputing/platformcomputing/products/lsf/ LSF]
     103* [http://boinc.berkeley.edu/trac/wiki/DesktopGrid BOINC]
     104* [http://gbac.sourceforge.net/ GBAC]
     105* [http://www.cloudbroker.com/ CloudBroker]
     106
     107
     108==== Core Services ====
     109
     110gUSE is a set of high-level grid services (including workflow manager, storage). gUSE runs jobs in the DCI Bridge. gUSE services can be hosted on a single host or can be distributed over several server machines to optimize resource usage or increase performance.
     111
     112gUSE services provide data services (user database, proxy credential database, application code database, workflow database, application history and change log database, etc.) and control services (e.g. job submission, workflow enactment, etc.). gUSE services discover each other using a central gUSE service, the information system.
     113
     114
     115=== Documentation ===
     116
     117If you want to see more information about WS-PGRADE/gUSE, you can check out [http://www.guse.hu/?m=documents&s=0 documentation]