wiki:udg/ecoms

Version 161 (modified by gutierjm, 8 years ago) (diff)

--

Recent Changes:

The ECOMS User Data Gateway

The European Climate Observations, Modelling and Services initiative (ECOMS) coordinates the activities of three ongoing European projects (​EUPORIAS, SPECS and NACLIM). Different activities carried out in these projects require seasonal forecasts from state-or-the-art forecasting systems (e.g. NCEP/CFSv2 or ECMWF/System4) for a reduced number of variables. This information can be obtained directly from the data providers, but the resulting formats, aggregations and vocabularies may not be homogeneous across datasets, thus requiring some post processing. Moreover, different data policies hold for the various datasets —which are freely available only in some cases— and therefore data access may not be straightforward. Thus, obtaining seasonal climate forecast data is typically a time consuming task.

As part of the data management activities in these projects, the ECOMS User Data Gateway (ECOMS-UDG) has been developed by the Santander MetGroup in order to facilitate seasonal forecasting data access to end users. The needed variables have been downloaded from data providers and locally stored in a THREDDS data server implementing fine-grained user authorization and using remote data access protocols with data subsetting capabilities. Thus, users can efficiently retrieve the subsets best suited to their particular research aims (for particular regions, periods and/or ensemble members) from a large volumen of information.

Since ​R has been adopted for a number of tasks in these projects (validation, downscaling, etc.), an R package for data exploration and access has been developed (ecomsUDG.Raccess) and additional functionalities will be developed to meet the users' needs. Moreover, a number of alternative tools are being develop in order to provide different user-friendly interfaces for accessing the information (Python, Matlab, web portals, ... ).

{{{#! As part of the data management activities in these projects, the Santander Meteorology Group (UC-CSIC) has established the ECOMS User Data Gateway (ECOMS-UDG) to provide a single access point to collections of impact-relevant variables, gathered from existing state-of-the-art datasets (see the available datasets? and variables?). The ECOMS-UDG is composed of a catalogue of datasets and services provided by a THREDDS data server and a suite of tools for user-friendly data exploration, access and post-processing. A fine-grained user authorization system allows different user roles to access data sets with different data policies. Since ​R has been adopted for a number of tasks in these projects (validation, downscaling, etc.), an R package for data exploration and access has been developed (ecomsUDG.Raccess) and additional functionalities will be developed to meet the users' needs. }}}

This wiki page provides an up-to-date description of the ECOMS-UDG, including information on the available datasets and variables, and the documentation of the available tools. The following documents and links are the basic references:

Contents of the wiki page:

  1. THREDDS Data Server (TDS)?
  2. R Package for Data Access
  3. Other Interfaces for Data Access?
  4. Assessment of Users' Needs
  5. Known Problems and FAQs
  6. Dissemination Activities?

Issues

If you find any issue, problem or make a comment, please drop us a ticket!!.

You can submit the ticket anonymously, but if you want to receive notifications on updates and feedbacks you can provide your e-mail address in the ticket form.

This is the list of tickets, so far:

Ticket Summary Type
No tickets found

Attachments (18)