Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison

<p>Inversion in subsurface hydrology refers to estimating spatial distributions of (typically hydraulic) properties often associated with quantified uncertainty. Many methods are available, each characterized by a set of assumptions, approximations, and numerical implementations. Only a few in...

Full description

Saved in:
Bibliographic Details
Main Authors: T. Xu, S. Xiao, S. Reuschen, N. Wildt, H.-J. Hendricks Franssen, W. Nowak
Format: Article
Language:English
Published: Copernicus Publications 2024-12-01
Series:Hydrology and Earth System Sciences
Online Access:https://hess.copernicus.org/articles/28/5375/2024/hess-28-5375-2024.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846118733439827968
author T. Xu
S. Xiao
S. Reuschen
N. Wildt
H.-J. Hendricks Franssen
H.-J. Hendricks Franssen
W. Nowak
author_facet T. Xu
S. Xiao
S. Reuschen
N. Wildt
H.-J. Hendricks Franssen
H.-J. Hendricks Franssen
W. Nowak
author_sort T. Xu
collection DOAJ
description <p>Inversion in subsurface hydrology refers to estimating spatial distributions of (typically hydraulic) properties often associated with quantified uncertainty. Many methods are available, each characterized by a set of assumptions, approximations, and numerical implementations. Only a few intercomparison studies have been performed (in the remote past) amongst different approaches <span class="cit" id="xref_paren.1">(e.g., <a href="#bib1.bibx77">Zimmerman et al.</a>, <a href="#bib1.bibx77">1998</a>; <a href="#bib1.bibx33">Hendricks Franssen et al.</a>, <a href="#bib1.bibx33">2009</a>)</span>. These intercomparisons guarantee broad participation to push forward research efforts of the entire subsurface hydrological inversion community. However, from past studies until now, comparisons have been made among approximate methods without firm reference solutions. Note that the reference solutions are the best possible solutions with the best estimate and posterior standard deviation and so forth. Without reference solutions, one can only compare competing best estimates and their associated uncertainties in an intercomparison sense, and absolute statements on accuracy are unreachable.</p> <p>Our current initiative defines benchmarking scenarios for groundwater model inversion. These are targeted for community-wide use as test cases in intercomparison scenarios. Here, we develop five synthetic, open-source benchmarking scenarios for the inversion of hydraulic conductivity from pressure data. We also provide highly accurate reference solutions produced with massive high-performance computing efforts and with a high-fidelity Markov chain Monte Carlo (MCMC)-type solution algorithm. Our high-end reference solutions are publicly available along with the benchmarking scenarios, the reference algorithm, and the suggested benchmarking metrics. Thus, in comparison studies, one can test against high-fidelity reference solutions rather than discussing different approximations.</p> <p>To demonstrate how to use these benchmarking scenarios, reference solutions, and suggested metrics, we provide a blueprint comparison of a specific ensemble Kalman filter (EnKF) version. We invite the community to use our benchmarking scenarios and reference solutions now and into the far future in a community-wide effort towards clean and conclusive benchmarking. For now, we aim at an article collection in an appropriate journal, where such clean comparison studies can be submitted together with an editorial summary that provides an overview.</p>
format Article
id doaj-art-3f746f6acdde46aeb13cc75fe1d5b7c4
institution Kabale University
issn 1027-5606
1607-7938
language English
publishDate 2024-12-01
publisher Copernicus Publications
record_format Article
series Hydrology and Earth System Sciences
spelling doaj-art-3f746f6acdde46aeb13cc75fe1d5b7c42024-12-17T10:39:34ZengCopernicus PublicationsHydrology and Earth System Sciences1027-56061607-79382024-12-01285375540010.5194/hess-28-5375-2024Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparisonT. Xu0S. Xiao1S. Reuschen2N. Wildt3H.-J. Hendricks Franssen4H.-J. Hendricks Franssen5W. Nowak6College of Water Conservancy and Hydropower Engineering, Hohai University, Nanjing, ChinaDepartment of Mathematical Sciences, University of Bath, Claverton Down, Bath, BA2 7AY, United KingdomInstitute for Modelling Hydraulic and Environmental Systems, University of Stuttgart, 70569 Stuttgart, GermanyInstitute for Modelling Hydraulic and Environmental Systems, University of Stuttgart, 70569 Stuttgart, GermanyInstitute of Bio- and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, GermanyCentre for High-Performance Scientific Computing in Terrestrial Systems (HPSC-TerrSys), Geoverbund ABC/J, Leo Brandt Strasse, Jülich, GermanyInstitute for Modelling Hydraulic and Environmental Systems, University of Stuttgart, 70569 Stuttgart, Germany<p>Inversion in subsurface hydrology refers to estimating spatial distributions of (typically hydraulic) properties often associated with quantified uncertainty. Many methods are available, each characterized by a set of assumptions, approximations, and numerical implementations. Only a few intercomparison studies have been performed (in the remote past) amongst different approaches <span class="cit" id="xref_paren.1">(e.g., <a href="#bib1.bibx77">Zimmerman et al.</a>, <a href="#bib1.bibx77">1998</a>; <a href="#bib1.bibx33">Hendricks Franssen et al.</a>, <a href="#bib1.bibx33">2009</a>)</span>. These intercomparisons guarantee broad participation to push forward research efforts of the entire subsurface hydrological inversion community. However, from past studies until now, comparisons have been made among approximate methods without firm reference solutions. Note that the reference solutions are the best possible solutions with the best estimate and posterior standard deviation and so forth. Without reference solutions, one can only compare competing best estimates and their associated uncertainties in an intercomparison sense, and absolute statements on accuracy are unreachable.</p> <p>Our current initiative defines benchmarking scenarios for groundwater model inversion. These are targeted for community-wide use as test cases in intercomparison scenarios. Here, we develop five synthetic, open-source benchmarking scenarios for the inversion of hydraulic conductivity from pressure data. We also provide highly accurate reference solutions produced with massive high-performance computing efforts and with a high-fidelity Markov chain Monte Carlo (MCMC)-type solution algorithm. Our high-end reference solutions are publicly available along with the benchmarking scenarios, the reference algorithm, and the suggested benchmarking metrics. Thus, in comparison studies, one can test against high-fidelity reference solutions rather than discussing different approximations.</p> <p>To demonstrate how to use these benchmarking scenarios, reference solutions, and suggested metrics, we provide a blueprint comparison of a specific ensemble Kalman filter (EnKF) version. We invite the community to use our benchmarking scenarios and reference solutions now and into the far future in a community-wide effort towards clean and conclusive benchmarking. For now, we aim at an article collection in an appropriate journal, where such clean comparison studies can be submitted together with an editorial summary that provides an overview.</p>https://hess.copernicus.org/articles/28/5375/2024/hess-28-5375-2024.pdf
spellingShingle T. Xu
S. Xiao
S. Reuschen
N. Wildt
H.-J. Hendricks Franssen
H.-J. Hendricks Franssen
W. Nowak
Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison
Hydrology and Earth System Sciences
title Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison
title_full Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison
title_fullStr Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison
title_full_unstemmed Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison
title_short Towards a community-wide effort for benchmarking in subsurface hydrological inversion: benchmarking cases, high-fidelity reference solutions, procedure, and first comparison
title_sort towards a community wide effort for benchmarking in subsurface hydrological inversion benchmarking cases high fidelity reference solutions procedure and first comparison
url https://hess.copernicus.org/articles/28/5375/2024/hess-28-5375-2024.pdf
work_keys_str_mv AT txu towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison
AT sxiao towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison
AT sreuschen towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison
AT nwildt towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison
AT hjhendricksfranssen towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison
AT hjhendricksfranssen towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison
AT wnowak towardsacommunitywideeffortforbenchmarkinginsubsurfacehydrologicalinversionbenchmarkingcaseshighfidelityreferencesolutionsprocedureandfirstcomparison