Harmonization of open data

EU-wide automated harmonization of open data based on FOSS4G and machine learning.

Challenge

The Geo-Harmonizer project aims to merge national European geodata seamlessly (harmonized) across the entire EU and to make the results available as open data. It is important to use open data licenses and enable broader public access to the data, i.e. not only for scientists and specialists, but also for non-experts. In this way, EU-funded data can be made more easily usable without users being expected to have special or costly infrastructure. This promotes cooperation with national authorities, organizations and NGOs, including existing EU-funded systems such as DIAS or the Copernicus programme. As part of the Geo-Harmonizer project, tools and data were developed to generate decision-relevant geodata such as air quality and pollution, potential natural vegetation, potential for energy generation from solar radiation, wind energy and the like. To add value to these maps, topographic data (DEMs), earth observation data (EO), soil, hydrological and meteorological data were processed using machine learning. The software developed in the project is available as open source software.

Services

mundialis carried out the following activities as part of this project:

  • Research of available open geo, meteorological and satellite data
  • Evaluation and assessment of data sources for geo-harmonizer issues
  • Integration of the actinia REST API for cloud-based calculations
  • Use of Kubernetes to manage containerized services in the cloud
  • Detailed INSPIRE-compliant metadata catalog harvested by European Data Portal
  • Contributions to harmonized environmental quality maps, climate change indicators and maps of potential natural vegetation
  • Development of a GeoServer extension that allows actinia-processed geodata to be published directly as an OGC-compliant service
  • Contributions to the business model/sustainability plan for the period after 2022
Result
  • Publication of the researched open geodata in consolidated form, including evaluation of the data sources
  • Creation of a detailed INSPIRE-compliant metadata catalog, which will be harvested by the European Data Portal
  • Publication of a GeoServer extension that allows actinia-processed geodata to be provided directly as an OGC-compliant service
  • Publication of the data results on Zenodo.org and on the EU data portal
Customer
EU CEF (Central Europe Facility)

Story

When it comes to geodata, each country refers to its own reference systems and spatial resolutions. However, this makes it difficult to seamlessly merge data across national borders. To remedy this, methods were implemented as part of the EU Geo-Harmonizer project with which the project team was able to contribute to the Copernicus products: For example, automated mapping methods were developed and published for the creation of annual land cover maps with a resolution of 30m for the entire period 2000-2020. These data products can now be used directly for national and regional projects throughout Europe. Data processing has been automated and implemented in a cloud environment, which has led to a significant reduction in processing and delivery times.