Semantic versioning is used to convey changes to the GFM production system and accordingly to the GFM data layers. The GFM version numbering follows the Semantic Versioning scheme with the given version format of X.Y.Z (MAJOR.MINOR.PATCH).
- MAJOR version increments are done to indicate changes in the system, resulting in incompatibilities of the dedecued GFM data layers. As such, GFM Layers produced from different MAJOR versions can not be used in unison.
- MINOR version increments depict changes in the production system but keeping backwards compatibility of the GFM data layers.
- PATCH version increments, as the name suggested, indicate backwards compatible bug fixes or changes in the underlying auxiliary datasets used in the system.
Release date: Nov 27, 2024 3:00 pm
- The ENSEMBLE algorithm is now producing also results if only one individual flood mapping algorithm provides valid input
Release date: Apr 04, 2024 1:00 pm
- Update no-data masking by using a union of the likelihood nodata mask and flood nodata mask
- Fix the misalignment of no-data values between flood map and likelihood map
- Fix issue in reading of the incidence angle auxiliary data set
Release date: Jan 26, 2024 2:00 pm
- Bugfix in retrieval of SIG0 file paths
Release date: Jan 24, 2024 12:00 pm
- Updated parameters of harmonic model (based on years 2019-2021 and less prone to annual variations)
- Improvements to performance and reliability
- Updated dependencies to allow more flexibility for future developments
- Added automatic encoding of input and output data
- Updated hyperparameters for parameterization.
- Incorporated incidence angle from ellipsoid, splitting the image into three strips and performing parameterization on each strip independently.
- Implemented parallel processing for the divided image stripes.
- Improved permanent and seasonal reference water masks now computed on 5 years of data (instead of 2 years)
- Improved exclusion masks through bringing land cover parameters up-to-date and fine-tuning of disturbing effects
- Improved stability and performance of the whole processing chain by discarding invalid data to reduce memory and CPU occupation
Release date: Sep 11, 2023 2:00pm
- Add workflow task to derive flood anomaly information
- Update methods and CLI to ingest flood anomaly information into metadata database
Release date: Jul 24, 2023 3:30pm
- Stitch past SIG0, past flood and past uncertainty data from multiple adjacent reference S1 scenes to reach full coverage with the current S1 scene. This is used as input to the LIST algorithm for change detection.
Release date: Jun 16, 2023 3:00 PM
- By exploiting the COPWBM, DLR's flood mapper now avoids selecting tiles over ocean which can affect the thresholding.
Release date: Jun 2, 2023 12:52 PM
- Correct ENSEMBLE likelihood to 49 where non-flood
Release date: June 01, 2023, 00:00 AM (midnight)
- Update SIG0 version to V1M1R2
- Minor improvements in production system
Release date: May 26, 2023, 12:00 PM (noon)
- Update HAND to V01R02 (remove circular patterns)
- Update TOPODIST to V02R02 (based on HAND V01R02)
Release date: May 17, 2023, 4:15 PM
- Update DLR flood mapper to v1.3.0 (Fix thresholding failure)
- Update GeoVille ingestion script to v1.4.2 (Delete temporary files)
Release date: Apr 03, 2023, 1:30 PM
- Removing the clipping of the reference water mask to the S1 scene extent.
Release date: Mar 22, 2023 12:00 AM
- Versioning of output layers
- A new table in the metadata database holds the version info of used input data sets and software for each GFM NRT version
- The GFM NRT version is written as GeoTiff metadata tag to the ENSEMBLE output files
- Reduced storage occupancy
- Intermediate files will be written as virtual raster format (GDAL VRT) instead of GeoTiff
- Update affected population layer (GHS POP) to GHS_POP_E2020_GLOBE_R2022A
Release date: Feb 28, 2023 12:00 AM
- Geoserver converts GFM output layers from GeoTiffs to Cloud Optimized GeoTiffs (COG)
Release date: Feb 20, 2023 12:00 AM
- Hotfix: Update GeoVille's API URL in GeoVille's post processing task (gfm-data-processing: v1.3.5)
Release date: Feb 17, 2023 04:00 PM
- Add option to REST API endpoints /sentinel1 and /sentinel_footprint to filter for VV / HH polarized Sentinel-1 scenes (update data-interfaces to v1.7.1)
Release date: Jan 02, 2023 04:00 PM
- Update ENSEMBLE to use a consensus (instead of split decision) approach, when only two algorithms produce a result
- Update reference water mask to version V03 (2020 - 2021)
- Update exclusion layers versions
- Update Sentinel-1 derived parameters
- Updates of flood mapping algorithms:
- TUW flood mapping algorithm (performance improvements)
- DLR flood mapping algorithm (even rounding, updated scale_factor handling)
- data-interfaces (minor performance improvements, add optional num_cpu argument for preparing auxiliary data)
Release date: Dec 15, 2022 11:30 AM
- Increase Flood Mapping DAG stability (concurrency, max_active_runs)
- Update advflag container to v0.2.2 (performance and algorithmic updates)
Release date: Nov 11, 2022 10:00 AM
- Add retries for critical tasks
- Remove SSL certificate check for Sentinel-1 acquisition segments download
Release date: Nov 4, 2022 10:00 AM
- Update EXM-INL6-LOWCOVTILE layer to V01R02
Release date: Sep 7, 2022 2:00 PM
- Improve queuing of Sentinel-1 scenes
Release date: Sep 1, 2022 12:00 AM
- Add --backscatter <scene_path> to CLI "data reconstruct_flood" to retrieve the extent of the scene for reconstructing TUW flood / likelihood results
Release date: Aug 9, 2022 10:00 AM
- Updated HAND, TOPODIST and LOWCOV-PX data sets
- Improvements in task execution and error handling
Release date: Jun 13, 2022 4:00 PM
- update config and call - adv flagging to v0.1.4
- remove advisory flags from ocean
Release date: June 10th, 2022, 2:00 PM
- Improvements in task processing in the production system (add execution timeouts)
Release date: June 1st, 2022, 3:40 PM
- update geoville data post processing docker image to v1.3.3
Release date: May 25, 2022 4:25pm
- Add ENSEMBLE CLI argument post_blobsize to adjust ratio calculation
- Update data-interfaces to v1.5.1
- Use LISTs' hsbaflood:v1.0.0 instead of hsbaflood:latest (same docker image)
Release date: May 19th, 2022, 4:10 PM
- Upgrade GeoVille's gfm data processing (postprocessing) to v1.3.2
- Skips the ingestion of HH and HV polarized datatake IDs of the S1 acquisition segments into the Geoserver
Release date: May 18th, 2022, 4:00 PM
- Upgrade GeoVille's gfm data processing (postprocessing) to v1.3.1
- This ingests the ENSEMBLE flood statistics into GeoVille's database
Release date: May 17th, 2022, 6:30 PM
- Update data-interfaces version to v1.5.0
- Update ensemble version to v1.2.3
- Add ensemble metadata ingestion into metadata DB
Release date: May 2nd, 2022, 4:28 PM
- Update ensemble version to v1.2.2
- Fix likelihood issue (wrong values over masked water)
- Update data-interfaces version to v1.4.1 (use configfile to specify auxiliary data paths, updated GDAL calls)
- Add respective configfile
- Updated version of LOWCOVTILE and LOWBSC
- Update TUW flood jobfile to use updated HARPAR
Release date: April 25th, 2022, 2:15 PM
- upgrade ensemble to v1.2.1
- Set flood_mask and likelihood to nodata where CopWBM is also nodata
- Reference water mask overrules exclusion mask
- Set likelihood to 49 (least confidence for non-flood) where it is excluded by the exclusion layer
- Set likelihood to 0 (highest confidence for non-flood) where refwater is 1 or 2
Release date: April 20th, 2022, 2:33 PM
- activated GeoVille postprocessing script v1.3.0
- add logging option to docker operator for GeoVille postprocessing script
Release date: April 13th, 2022, 4:45 PM
- hotfix: typo ensemble call
Release date: April 13th, 2022, 4:26 PM
- ENSEMBLE update v1.2.0 (main changes likelihood calculation, handling exclusion layer and masking)
- DLR flood mapper v1.2.1
- GeoVille flood ingestion script deactivated for now
- TUW flood mapper jobfile update
Release date: April 13th, 2022, 4:16 PM
- GeoVille Flood ingestion script deactivated
- GeoVille S1 Metadata and S1 Schedule activated
- Increase docker execution timeout from 20 to 30 min
- Minor changes in docker / airflow logging
Release date: January 25th, 2022, 2:34 PM
- Update S1 scene download procedure with deletion of downloaded zipfiles after successful pre-processing
- Bugfix in inserting S1 scene metadata into internal metadata DB
Release date: January 19th, 2022, 4:58 PM
- added Advisory Flag calculation
- Sentinel-1 data acquisition done via DAG
- Query based on internal DB instead of CSW
- Run Sigma0 only for tiles over land
- GFM sigma NRT processor upgrade to SNAP8 and updated orbit file handling
- improved handling of docker container in DockerBashOperator
- new BranchDockerBashOperator
Release date: December 21st, 2021, 10:25 AM
- correctly remove docker container in on_kill() method
Release date: December 16th, 2021, 5:43 PM
First tagged production ready release.
NOTE: Docker image tags of task Compute_Sigma0 have changed
- from "sentinel-1-nrt:latest" to "gfm-sigma-nrt:1.0.0"
- from "sentinel-1-nrt:1.0.0" to "gfm-sigma-nrt:1.0.1"