| 140 | == Metadata Harvesting of ESGF Datasets of a search == |
| 141 | The metadata harvesting will allow after completed, download the datasets from multiple data nodes, and will allow exploring climate datasets without having to download the dataset itself . So we can know its nature in detail before selecting them to download or we can know the services offered from ESGF to access and/or explore the dataset. Some of these services can be explored from ToolsUI NetCDF Java as will be explained after. |
| 142 | |
| 143 | [[NoteBox(note,The harvesting are doing at `dataset` level.)]] |
| 144 | |
| 145 | === What is a ESGF Dataset? === |
| 146 | Dataset is a climate data in a specific version stored by ESGF. One dataset may have several records i.e. the records are the physical replica of a dataset in a data node. |
| 147 | |
| 148 | Also, the datasets are formed of files, i.e. dataset are a virtual container of data, so that the information is contained in files and sometimes in aggregations. The versions of datasets are generated when errors are found in the datasets giving rise to a new corrected version. |
| 149 | |
| 150 | [[NoteBox(tip, Datasets\, files and aggregations have replicas in data nodes. And the ESGF services (THREDDS\, LAS\, HTTP\, GridFTP and OPeNDAP) are always served at replicas level. That is the reason why is necessary do a harvesting before the download.)]] |