Implementing and operating the GFM product requires a set of procedures to validate the technical and scientific quality of the GFM output layers of flood information, as well as that of the generating service, with the overall aim to deliver the main GFM output layers (i.e. Observed Flood Extent, Reference Water Mask, Likelihood Values, and other supplementary information) with the best possible quality. The various methods that are used for the GFM product and service quality assessment, which is performed on a quarterly basis each year, are summarized in Table 24.
Central to the GFM product and service quality assessment is a set of Key Performance Indicators (KPIs), listed in Table 25, which are used for the quarterly monitoring and reporting of all aspects of the GFM service and product delivery performance. The 2022, 2023, and 2024 annual product and service quality assessment (QA) reports of the GFM product, as well as the GFM pre-operational QA report, have been published as Technical Reports of the Joint Research Centre (JRC) of European Commission, and are freely accessible via the GFM wiki pages.
|
TASK |
DESCRIPTION |
| Regular assessment of thematic accuracy: |
|
|
Regular checking and monitoring of product timeliness: |
|
|
Regular checking and monitoring of service availability: |
|
Table 24: Overview of the various GFM product and service quality assessment (QA) tasks.
|
KPI |
NAME |
DESCRIPTION |
TARGET VALUE |
|
KPI-1 |
Service Availability |
|
>=99 % |
|
KPI-2 |
Product Timeliness |
|
>=95 % |
|
KPI-3 |
Thematic Accuracy |
|
>=70 % (CSI) |
|
KPI-4 |
Unique Visitors |
|
- |
|
KPI-5 |
Total Visitors |
|
- |
|
KPI-6 |
Total Downloads |
|
- |
|
KPI-7 |
Service Performance Experience |
|
< 20 % |
Table 25: Key Performance Indicators (KPIs) used for GFM product and service quality assessment.