Hostname: page-component-cd9895bd7-jn8rn Total loading time: 0 Render date: 2024-12-23T23:02:00.392Z Has data issue: false hasContentIssue false

How to cope with uncertainty monsters in flood risk management?

Published online by Cambridge University Press:  24 January 2024

Martin Knotters*
Affiliation:
Wageningen Environmental Research, Wageningen University & Research, Wageningen, The Netherlands
Onno Bokhove
Affiliation:
Leeds Institute for Fluid Dynamics, School of Mathematics, University of Leeds, Leeds, UK
Rob Lamb
Affiliation:
JBA Trust, Skipton, UK Lancaster Environment Centre, University of Lancaster, Lancaster, UK
P.M. Poortvliet
Affiliation:
Philosophy, Innovation, Communication & Education, Wageningen University & Research, Wageningen, The Netherlands
*
Corresponding author: Martin Knotters; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Strategies are proposed to cope with uncertainties in a way that all possible kinds of uncertainty are named, recognized, statistically quantified as far as possible and utilized in efficient decision-making in flood risk management (FRM). We elaborated on the metaphor of uncertainty as a monster. We recommend two strategies to cope with the uncertainty monster to support efficient decision-making in FRM: monster adaptation and monster assimilation. We present three cases to illustrate these strategies. We argue that these strategies benefit from improving the structure and reducing the complexity of decision problems. We discuss ways to involve decision-makers in FRM, and how communication strategies can be responsive to their informational needs.

Type
Overview Review
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2024. Published by Cambridge University Press

Impact statements

In decision making on flood risk management (FRM) uncertainties have to dealt with. In this article expertise from hydrology, statistics, communication and behavioral science is combined. This collaborative approach contributes to a better understanding of the various ways uncertainties are dealt with in decision making in FRM. Moreover, with this integration of expertise the article opens ways to strategies in which uncertainties are actually assimilated and adapted by decision makers in taking efficient decisions in (local) FRM.

Introduction

Flood risk management (FRM) aims to reduce the harm caused by flooding. In FRM, three sets of actions can be distinguished (Plate, Reference Plate2002). First, actions are needed to operate an existing system in an actual flood risk situation. Second, actions are needed to plan a new system or to revise an existing system to meet new needs and conditions. Following from this second action, a third set of actions is needed to obtain an optimum design for a new or revised system. In all three sets of actions, FRM deals with decision problems of varying complexity, characterized by varying types and levels of uncertainties that may or may not be statistically quantifiable. In this paper, we address the question of how to cope with these uncertainties, with a focus on the third set of actions: designing an optimal system. The key question is: how can uncertainties, whether statistically quantified or not, be dealt with to support efficient decision-making?

The aim of this paper is to propose the strategies to cope with uncertainties in a way that all possible kinds of uncertainty are named, recognized, statistically quantified as far as possible and utilized in efficient decision-making. For this purpose, we use the monster metaphor (Van der Sluijs, Reference Van der Sluijs2005; Smits, Reference Smits2006). We address the following questions:

  1. 1. What are the origins and guises of the various uncertainty monsters?

  2. 2. How are these monsters perceived by decision-makers?

  3. 3. Which coping strategies are available to “tame” the uncertainty monsters?

  4. 4. How do the choice between coping strategies depend on structure and complexity of decision problems?

  5. 5. Which coping strategies are preferred in efficient decision-making?

We show in a mock case on FRM how statistical knowledge on uncertainty can be adapted in order to enable efficient decision-making. We do not pretend to have solutions for complex decision problems with uncertainties. Nevertheless, with this paper, we hope to contribute to improved structure and reduced complexity of decision problems, which we consider as the key conditions for efficient decision-making in FRM. Besides the opportunities for utilization of statistical knowledge on uncertainty in decision-making, we also discuss the limitations.

Origins and guises of uncertainty monsters

The monster metaphor was developed by Smits (Reference Smits2006) to improve the understanding of risk controversies related to new technologies, based on the work of Douglas (Reference Douglas1966) on purity and danger in traditional cultures. The monster metaphor was introduced into the environmental sciences by Van der Sluijs (Reference Van der Sluijs2005). The basic idea is that if two categories that were considered to be mutually exclusive mix up, monstrous hybrids can grow. As Smits (Reference Smits2006) describes, these ambiguous phenomena can evoke feelings of fear or abhorrence, but also feelings of fascination and reverence. Van der Sluijs (Reference Van der Sluijs2005) considers the following mutually exclusive categories that create monsters in the science–policy interface: knowledge versus ignorance, objective versus subjective, facts versus values, prediction versus speculation and science versus policy. These categories can also be found in the area of FRM, where uncertainty monsters can appear at various places, including predictions or speculations on floods and their effects, risk awareness, support base and efficacy and efficiency of decisions. Some of these monsters spit out uncertainties that can more or less easily be statistically quantified. Other monsters spit out uncertainties that can only qualitatively be described. The existence of some monsters and the genesis of new monsters can only be suspected.

The guises of uncertainty monsters can vary. The most simple monster has one head that spits out statistically quantifiable uncertainty only. More complex species are multi-headed. The uncertainties that are spit out vary in space and time and can be mutually dependent. Nevertheless, they can still be quantified statistically although this can be complicated. These uncertainties are referred to as aleatory, which means that they are related to random processes that can be described in probabilistic terms. Besides aleatory uncertainties, epistemic uncertainties that are related to lack of knowledge can be distinguished. However, aleatory and epistemic uncertainty can be blurred, for example, Nearing et al. (Reference Nearing, Tian, Gupta, Clark, Harrison and Weijs2016) argue that most aleatory uncertainty at the scale of watersheds is also epistemic. It might be believed that all epistemic uncertainties can be reduced or eliminated by more accurate and detailed descriptions of hydrological systems. However, these efforts on model improvement can only concern known unknowns, while the existence of unknown unknowns cannot be excluded. Besides known and unknown unknowns, Di Baldassarre et al. (Reference Di Baldassarre, Brandimarte and Beven2016) distinguish wrong assumptions: things we think we know, but we actually do not know. Efforts can be made to represent epistemic uncertainty probabilistically (Montanari and Koutsoyiannis, Reference Montanari and Koutsoyiannis2012). However, it cannot be ruled out that deep uncertainties remain that cannot be expressed in probabilistic terms, also referred to as Knightian uncertainties (Knight, Reference Knight1921) or surprises (Brown, Reference Brown2004; Merz et al., Reference Merz, Sergiy Vorogushyn, Viglione and Blöschl2015).

Brown (Reference Brown2004) defines uncertainty as a state of confidence in knowledge, varying between being certain and accepting that we cannot know, that is indeterminacy. In this definition, confidence is a state of awareness of imperfect knowledge. Ignorance is defined as lack of awareness of imperfect knowledge. Further, Brown (Reference Brown2004) distinguishes “bounded” and “unbounded” uncertainty. “Bounded” means that all possible outcomes are known, but not necessarily all corresponding probabilities. Uncertainty is “unbounded” when some possible outcomes are known, possibly with corresponding probabilities, or when no possible outcomes are known.

Perceptions and behavioral consequences of uncertainty monsters

In the above, we have described that the uncertainty monster may come in different forms and shapes. The guises of the uncertainty monster can influence the perceptions of uncertainties and risks and the ways in which the uncertainty monster is dealt with. The risk perception literature describes that people are subject to forming overall risk perceptions on the basis of various cues (Slovic et al., Reference Slovic, Finucane, Peters and MacGregor2004). One of them is the extent to which (possible) events are viewed to be dreadful – that is, having catastrophic potential, affecting many people and so forth. Another is the experienced level of uncertainty – is it a phenomenon known to science, is it a novel event, and so forth. Typically, individuals rely on such cues in forming perceptions, and cues inform human decision-making, too.

Relying just on contextual cues – or heuristics – may, however, lead to faulty or suboptimal decisions (Kahneman, Reference Kahneman2011). In particular when decision problems are complex in nature, it may be important to process information with logic and reason. Humans are equipped with an analytical system to perform such information processing. However, individuals can also process information with the use of the so-called experiential system. In this case, affect and intuition play a more dominant role in the processing of information and in reaching a decision.

In some cases, individuals may be very aware of risks but still deny it. Denial may be a coping mechanism, and may be brought about when people do not see a clear behavioral pathway to deal with the risk – that is, they lack a sense of efficacy (Maddux and Rogers, Reference Maddux and Rogers1983). In the financial realm, the denial of a risk that one is actually aware of is coined the ostrich effect (Karlsson et al., Reference Karlsson, Loewenstein and Seppi2009). It may also lead to avoiding the search for additional information that could actually help to better understand the risk problem. Another example of how individuals can deal with an uncertainty monster is by continuing to put resources into endeavors that are not likely to be successful, or at least break even the investment made. This can lead to an ironic effect of people clinging on to projects that have limited viability, but given the amount of investments that were already made it is considered a “waste” to abandon the project – a phenomenon called the sunk cost fallacy or Concorde effect (Arkes and Ayton, Reference Arkes and Ayton1999).

There are examples of the Concorde effect in natural flood management (NFM), in which efficacy is at times blown out of proportion (Bokhove et al., Reference Bokhove, Hicks, Kent and Kelmanson2021), in part because it is challenging to assess at a strategic or policy level (Environment Agency, 2022). In particular, lack of upscaling potential of NFM to intermediate and large floods remains an issue, leading to a blended approach that aims to place different types of flood mitigation measures in the right places (Environment Agency, 2021c). Proposing flood storage due to beaver dams is an extreme example; it is officially mentioned in government reports (DEFRA, 2018) without mentioning the lack of upscaling potential (Bokhove et al., Reference Bokhove, Kent and Kelmanson2018) or international viewpoints thereon. The available flood-storage volume behind perfect beaver dams tends to be very small, such that 1,000s–10,000s beaver colonies would be needed to prevent intermediate to larger floods, which remains unrealistic even for 1% coverage. Furthermore, potential dam collapse (Hillman, Reference Hillman1998; Butler and Malanson, Reference Butler and Malanson2005) and lack of planned maintenance are sources of uncertainty. In contrast, in the Netherlands, the 1,000s of beavers roaming the countryside are valued for their local wildlife value, for example, in terms of locally improving water quality and creating wetland habitat, but beavers are deemed destructive with respect to flood mitigation, since they seriously undermine protective berms and dikes. The involved stakeholders (province, water authorities, nature conservation managers and other actors) were increasingly aware of the risks as well of their specific responsibilities toward flood protection and nature conservation, which resulted in a joint policy established in a beaver protocol (Heijer et al., Reference Heijer, Rijke, Bosch-Rekveldt, de Leeuw and Barciela-Rial2023).

On the one hand, here we have argued that an uncritical reliance on uncertain benefits is related to the Concorde effect if one takes account of social and emotional investments. On the other hand, the counter-argument would be that decades of investment of large amounts of public money (and carbon, political capital, etc.) on hard infrastructure may be a Concorde effect in some places, for example, for 149–185 km of the U.K. coastline where protecting or adapting as currently planned appears to be economically unfeasible (CCC, 2018). In either case, it is important to understand both the ongoing benefits and residual risks arising from past investments, and a failure to assimilate the associated uncertainties may provide a platform for pathological monster coping strategies discussed in the following sections.

In analyzing the role of uncertainty in FRM, it is important to be aware of the bounded rationality of human decision-making. This is not to say that humans are irrational, but their rationality is bounded by an array of perceptual and motivational phenomena that may impact or bias behavior (Simon, Reference Simon, Eatwell, Milgate and Newman1990). Given the simple fact that in FRM the stakes are high, it is crucial to adopt a structured and systematic approach toward decision problems. Before doing so, we will first describe the various ways uncertainty in decision-making may be dealt with.

Coping strategies

Van der Sluijs (Reference Van der Sluijs2005) mentioned four possible strategies to cope with the monster of uncertainty: monster exorcism, monster adaptation, monster assimilation and monster embracement. We summarize our interpretations of these strategies and we add monster denial and monster anesthesia to them.

In monster exorcism, it is tried to reduce uncertainty to zero. However, zero uncertainty is unreachable since knowledge is limited, reality is necessarily generalized in models, sample sizes are limited and observations have limited accuracy. Monster adaptation transforms the monster into a phenomenon that fits in the aforementioned categories. This is attempted by quantifying uncertainty to support rational risk management on the basis of optimization of expected utility. Bluntly said, the decision is the outcome, or at least supported by the outcome of calculations. However, uncertainties are not always quantifiable, sometimes hidden, and have sometimes not arisen yet.

Monster embracement can possibly be related to a fascination for the complexity of environmental systems. However, magnification of uncertainties can also be a strategy to trivialize unpleasant outcomes of scientific research.

Monster assimilation differs from monster adaptation in that not only the monster is adapted, but also the mutually exclusive categories that were mixed up, such as science and policy. These categories are assumed to be flexible enough to learn from uncertainty and to change. In monster assimilation a central place is given to uncertainties in environmental risk management. The idea of one certain truth is dropped. Parties involved in risk assessment strive for transparency and learn to live with ambiguity and pluralism.

To the four coping strategies described above, we add two strategies to cope with unwelcome uncertainty: monster denial and monster anesthesia. Van der Sluijs (Reference Van der Sluijs2005) considers the strategy of hiding unwelcome uncertainty as a case of monster exorcism. However, for monster exorcists, uncertainty can be welcome, because it legitimates their efforts to improve deterministic models. Information on uncertainty can be unwelcome for several reasons, in policy as well as in science (see, for instance, Pappenberger and Beven, Reference Pappenberger and Beven2006). They discussed seven possible reasons why uncertainty analysis is not performed in hydrological and hydraulic modeling by a significant part of the professional community, and concluded that none of these seven reasons are, in the end, tenable. Not mentioning or even denying can be a strategy in these cases. Another strategy to deal with unwelcome uncertainty is striving for consensus in the deliberations of supervisory committees. An agreement about the quality of information does not imply that uncertainty is expelled, however. After the deliberations, the unwelcome uncertainty monster sleeps.

Levels of complexity and structure in decision-making

In a discussion on the place of uncertainty in FRM, it makes sense that decision problems can vary in complexity and structure (see Figure 1). A complex decision problem has many components. We consider ambiguity as part of the complexity of a decision problem: different parties may think differently about the causes and effects of risks (interpretive ambiguity), and about what actions are justified once risks are characterized (normative ambiguity) (Renn, Reference Renn2008). Besides complex, decision problems can be poorly structured. We relate structure to the conditions under which decisions are made. Poor structure can make decision problems appear more complex than they actually are. Turnhout et al. (Reference Turnhout, Hisschemöller and Eijsackers2007)) distinguish unstructured, badly structured, moderately structured and well-structured decision problems. In these categories, knowledge is used by means of ideas, concepts, arguments and data, respectively. The roles of scientists are problem signaling, accommodation, advocacy and problem solving, respectively. At best, the policy process can result in learning, finding compromises, negotiation and taking formal decisions, respectively.

Figure 1. Decision problems categorized into levels of complexity and structure, as well as strategies to cope with uncertainty.

The levels of complexity and structure determine which strategy can be chosen to tame the uncertainty monsters (Poortvliet et al., Reference Poortvliet, Knotters, Bergsma, Verstoep and van Wijk2019). In the following section, we argue why monster adaptation and monster assimilation should be strived for to enable efficient decision-making, and monster embracement, exorcism, denial and anesthesia should be avoided. This implicates that decision problems should be structured as well as possible, and be simplified as far as possible. These aims are indicated with the blue, dashed arrows in Figure 1.

Preferred coping strategies: Monster adaptation and monster assimilation

Monster exorcism, monster denial and monster anesthesia can be seen as strategies sprouting from “certainification”: striving for certainty (Van Asselt et al., Reference Van Asselt, Mesman and Van‘t Klooster2007). Although it is acknowledged that certainification enables practitioners to proceed, Van Asselt et al. (Reference Van Asselt, Mesman and Van‘t Klooster2007) question whether this is a sustainable strategy in the long run. For instance, the public can lose trust in policy makers if things went out in a different way than was told. Whereas in controversies, decision-makers tend to certainification, the strategy of opponents can be “decertainification” (monster embracement). To reduce risks of cumbersome decision processes, we prefer monster assimilation and wherever possible monster adaptation above the certainifying strategies of monster exorcism, monster denial and monster anesthesia and decertainifying monster embracement. Besides this, it can be more efficient to take quantified uncertainty into account rather than to make costs to reduce uncertainty (Morgan and Henrion, Reference Morgan and Henrion1990). Therefore, we recommend quantitative uncertainty and risk analysis, that is, monster adaptation rather than monster exorcism, as will become clear in the examples we will consider next. Monster adaptation is possible if uncertainties can be quantified, that is, bounded uncertainties with all probabilities known (Brown, Reference Brown2010). If some or all uncertainties can be described qualitatively only, we prefer monster assimilation as a coping strategy in decision-making. The perceptual model of uncertainty as described by Westerberg et al. (Reference Westerberg, Di Baldassarre, Beven, Coxon and Krueger2017) can be helpful in monster adaptation and assimilation. Westerberg et al. (Reference Westerberg, Di Baldassarre, Beven, Coxon and Krueger2017) illustrated a three-step procedure to construct a perceptual uncertainty model with an example on flood risk change. The three steps include (1) identifying uncertainty in the framing of the studied system and problem, (2) identifying the uncertainty sources in the socio-hydrological system and (3) defining the nature, interactions and relative importance of the uncertainty sources.

These two preferred coping strategies emerging in the FRM practice are exemplified next in three ways, which involve:

  1. A. adaptation to aleatory uncertainty through the design flood concept;

  2. B. assimilation through recognition of epistemic uncertainties in flood hydrology; and,

  3. C. adaptation and assimilation intertwined in a mock pluvial flood-mitigation case study wherein several scenarios are juxtaposed using a graphical cost-effectiveness tool.

A. Monster adaptation: Aleatory uncertainty and the design flood concept

Although direct, systematic observations of precipitation and river flows have been made in some places since at least the 17th century (Deming, Reference Deming2021), it was the development of mathematical theory about the statistics of extremes that enabled a coherent, quantitative approach to flood risk analysis. In the United States, Dawdy et al. (Reference Dawdy, Griffis and Gupta2012)) reported that statistical analysis of flooding started with Fuller (Reference Fuller1914), who advocated that “study of their [floods] past frequency gives the best indication of what may be expected in the future” (although Robert Horton had applied probability analysis to plot flood data on logarithmic paper since 1896).

By the mid-20th century, the theoretical foundations for probabilistic analysis of flooding were growing stronger with pioneering work by Gumbel (Reference Gumbel1958) on extreme value theory, which included analysis of “the design flood,” amongst other applications in climatology, meteorology and hydrology.

Aided by extreme value theory, the concept of a statistical design flood effectively internalized aleatory uncertainty by simplifying the flood-protection decision problem to one of selecting an appropriate tail quantile of the flood distribution to reflect a chosen tolerance of risk. This internalization has proven to be a lasting and important form of monster adaptation, even though some did object to it, exemplified by T. Merriman’s statement in the 1926 Transactions of the American Society of Civil Engineers that flooding could not be “fairly treated by any method of probabilities” (Dawdy et al., Reference Dawdy, Griffis and Gupta2012), arguably a case of determinism leading to monster exorcism.

By the late 1960s and early 1970s, statistical analysis of river flow extremes was an established tool for hydrologists and engineers. Even so, hydrologists were aware of epistemic uncertainties, with the choice of statistical distribution being both an important practical question and a lively topic of research ever since (Benson, Reference Benson1968; Bobée et al., Reference Bobée, Cavadias, Ashkar, Bernier and Rasmussen1993; Vogel et al., Reference Vogel, McMahon and Francis1993a, Reference Vogel, Thomas and McMahon1993b; Kochanek et al., Reference Kochanek, Renard, Arnaud, Aubert, Lang, Cipriani and Sauquet2014). In a global meta-review by Diaconu et al. (Reference Diaconu, Costache and Popa2021)), 20% of 1,326 research papers about flood risk analysis methodology published between 1979 and 2020 concerned statistical analysis. Detailed guidance emerged for practical applications in which choices about statistical distributions and procedures for assessing data adequacy were considered (NERC, 1975; Institute of Hydrology, 1999; Ball et al., Reference Ball, Babister, Nathan, Weeks, Weinmann, Retallick and Testoni2019; England Jr et al., Reference England, Cohn, Faber, Stedinger, Thomas, Veilleux, Kiang and Mason2019). In Europe, Castellarin et al. (Reference Castellarin, Kohnova, Gaal, Fleig, Salinas, Toumazis, Kjeldsen and Macdonald2012) found that public agencies and institutions of six countries provide guidance about statistical distributions suitable for flood hydrology, while national statistical analyses of flood peaks exist in 12 of the 18 countries surveyed.

Deterministic models of flood hydrology have been used in estimating design floods since at least the development of unit hydrograph theory (Sherman, Reference Sherman1932; Clark, Reference Clark1945; Dooge, Reference Dooge1973). Eagleson (Reference Eagleson1972) showed how aleatory uncertainty about rainfall extremes, embedded in a statistical model, could be integrated analytically with a deterministic model of rainfall–runoff dynamics to derive a flood peak flow distribution. In our monster analogy, this physically motivated reasoning can be interpreted as an attempt to address epistemic uncertainty about the representation of complex hydrological processes that may have otherwise been ignored (monster denial). Subsequently, many combinations of stochastic weather models and deterministic hydrological system models have been proposed or applied to support flood risk analysis (Boughton and Droop, Reference Boughton and Droop2003; Lamb, Reference Lamb and Anderson2006). Primary motivations for the rainfall–runoff approaches were to incorporate knowledge about hydrological processes into design flood estimation (Lamb et al., Reference Lamb, Faulkner, Wass and Cameron2016), and to take advantage of both river flow data and precipitation measurements, which can be longer and spatially denser. Aleatory uncertainty in the rainfall or river flow data remained the dominant guise of the uncertainty monster, with the target remaining a design event.

B. Monster assimilation: Recognition of epistemic uncertainties in flood hydrology

The introduction of process-based modeling to derive design flows was at first motivated by a desire to reduce uncertainty by applying deterministic understanding of processes to add information in deriving a design flood. Yet opening the door to physical processes inevitably exposes the decision analysis to complexities of the real world, where it is difficult to find simple adaptations to uncertainty monsters. In flood management, and across other natural hazards, there has been an increasing focus on the epistemic uncertainties, which are not well-determined by historical observations (Beven et al., Reference Beven, Almeida, Aspinall, Bates, Blazkova, Borgomeo, Freer, Goda, Hall, Phillips, Simpson, Smith, Stephenson, Wagener, Watson and Wilkins2018). Where the uncertainties can be expressed in terms of input factors or choices made in applying a model, then sensitivity analysis is a powerful tool to structure and quantify a wide range of sources of uncertainty (Pianosi et al., Reference Pianosi, Beven, Freer, Hall, Rougier, Stephenson and Wagener2016; Gupta and Razavi, Reference Gupta and Razavi2018; Wagener and Pianosi, Reference Wagener and Pianosi2019; Pianosi et al., Reference Pianosi, Sarrazin and Wagener2020).

Quantification is difficult, or may be impossible, for deep epistemic uncertainties (Stein and Stein, Reference Stein and Stein2013), so the uncertainty monster appears in guises that are not amenable to monster adaptation. Instead, we try to assimilate those monsters to avoid the pathological states of embracement, exorcism, denial or anesthesia. Environmental or socioeconomic change is often the dominant uncertainty for long-term FRM planning. A typical paradigm for assimilating such deep uncertainty monsters is to use scenario-based analysis (Hallegatte et al., Reference Hallegatte, Shah, Lempert, Brown and Gill2012), an approach formalized for national FRM investment planning in England by the Environment Agency (2021b). Future projections of risk are needed for scenario-based decision analysis, but growing evidence of historical changes in flooding (Blöschl et al., Reference Blöschl, Hall, Viglione, Rui, Parajka, Merz, Lun, Arheimer, Aronica, Bilibashi, Boháč, Bonacci, Borga, Čanjevac, Castellarin, Chirico, Claps, Frolova, Ganora, Gorbachova, Gül, Hannaford, Harrigan, Kireeva, Kiss, Kjeldsen, Kohnová, Koskela, Ledvinka, Macdonald, Mavrova-Guirguinova, Mediero, Merz, Molnar, Montanari, Murphy, Osuch, Ovcharuk, Radevski, Salinas, Sauquet, Šraj, Szolgay, Volpi, Wilson, Zaimi and Živković2019; Environment Agency, 2020; Hannaford et al., Reference Hannaford, Mastrantonas, Vesuviano and Turner2021; Slater et al., Reference Slater, Villarini, Archfield, Faulkner, Lamb, Khouakhi and Yin2021) has also challenged the assumption of stationarity that has been inherent in most statistical flood models. Practical guidance on the incorporation of nonstationary extreme value analysis is now appearing for flood analysts (US Army Corps of Engineers, 2018; Ryberg et al., Reference Ryberg, Kolars, Kiang and Carr2020; Environment Agency, 2021a), enabling uncertainty relating to the choice of an appropriate baseline to be quantified within a decision analysis.

For example, in JBA Consulting (2022) (Section 6), a decision analyst’s choice between adopting a stationary or nonstationary model for river flow extremes was framed as an epistemic uncertainty in the design of an idealized flood management scheme. The implications were investigated by assessing the sensitivity of the scheme design to this choice between models, using a method outlined in Figure 2, adapted from Rehan (Reference Rehan2016) and Rehan and Hall (Reference Rehan and Hall2016). Context was provided by basing the idealized case on a real flood management scheme, and adding a comparison with a second source of epistemic uncertainty, represented by contamination of the gauged flow data with hydrometric measurement errors that were introduced artificially for the purposes of the experiment. The three possible inputs are plotted in Figure 3. The models adopted for the flood peaks were generalized logistic distributions, which are widely used in U.K. flood hydrology. Sensitivity of the design with respect to these input choices was studied by simulating an FRM economic appraisal to minimize the total present value cost with respect to the design height of the scheme’s flood defense. Monte Carlo simulation (MCS) was used to account for sampling uncertainty about the flood peak distribution for comparison with the epistemic uncertainties.

Figure 2. Schematic of flood risk management (FRM) decision simulation by JBA Consulting (2022). Economic relationships for the scheme costs and flood damages are combined with models for the extreme value distribution of peak river flows and the hydraulic model outputs relating flows and flood depths. The choice between a stationary or a nonstationary flood peak model is represented as an epistemic uncertainty, as is the effect of artificially introducing errors to the gauged flows. Parameters of the peak flow model are sampled randomly in a Monte Carlo simulation to allow the epistemic uncertainties to be compared with aleatory uncertainty related to the sampling of the gauged flows.

Figure 3. Inputs to the flood risk management (FRM) decision simulation shown in Figure 2 as epistemic uncertainties. The curves are generalized logistic distributions, which are adopted as extreme value models for the peak flows. The choices available to the analyst are a stationary model fitted to gauged peak flows, a stationary model fitted after errors were added to the gauged flow data, and a nonstationary model fitted to gauged flows (evaluated for 2016, taken to be the year of the decision analysis).

Results of the simulation in Figure 4 show that the adoption of a nonstationary model for the flood peak distribution would make a substantial difference to the idealized scheme design. This impact was larger than the effect of the second counterfactual case, in which errors were added to the peak flow data as a confounding uncertainty, and distinguishable from the sampling uncertainty as indicated by the interquartile range obtained by MCS.

Figure 4. Results of the flood risk management (FRM) decision simulation outlined in Figure 2, showing the economically optimum defense height, with uncertainties estimated by drawing 1,000 samples from the covariance matrices of generalized logistic distribution parameters fitted to the peak river flows. Panels show the results for different combinations of input factors. Comparison of panels (a) and (b) reveals epistemic uncertainty about the choice between a stationary and nonstationary model for the peak flows. Panel (c) simulates the effect of adding data errors to the stationary model for comparison. Plotted using R v4.2.0 boxplot function with default options: shaded boxes represent interquartile range (IQR), interior thick line is median, interior dot is mean, open circles are outliers and whiskers extend to a maximum of 1.5xIQR beyond the box (see function documentation for further details and Krzywinski and Altman, Reference Krzywinski and Altman2014 for interpretation).

Statistical models applied routinely in U.K. flood management practice have usually been predicated on stationarity assumptions. However, recent guidance (Environment Agency, 2021a) describes situations in which a nonstationary model may be preferred to inform the planning and economic appraisal of FRM schemes. The guidance requires analysts to apply judgment after taking account of different analytical approaches, which raises a need for the type of epistemic uncertainty assimilation that is illustrated in the case study.

Similar uncertainties arise in the context of land use change. This is both a historical issue, in terms of its influence on observed flood data, and an uncertainty in evaluating future flood management actions that involve nature-based solutions (NBS, also called working with natural processes, and including NFM). With rapidly growing interest worldwide in the potential of NBS to deliver multiple co-benefits (Iacob et al., Reference Iacob, Rowan, Brown and Ellis2014; Seddon et al., Reference Seddon, Chausson, Berry, Cécile, Smith and Turner2020), uncertainties about the effects of land management changes on flooding have received considerable attention (Dadson et al., Reference Dadson, Hall, Murgatroyd, Acreman, Bates, Beven, Heathwaite, Holden, Holman, Lane, O’Connell, Penning-Rowsell, Reynard, Sear, Thorne and Wilby2017; Lane, Reference Lane2017; Möller, Reference Möller2019; Ellis et al., Reference Ellis, Anderson and Brazier2021). Some modeling studies have attempted to capture uncertainties about land use changes through conditional probabilistic approaches to the inference of shifts in the parameters of deterministic models (Hankin et al., Reference Hankin, Trevor, Chappell, Beven, Smith, Kretzschmar and Lamb2021; Beven et al., Reference Beven, Page, Hankin, Smith, Kretzschmar, Mindham and Chappell2022), although there may be residual risks associated with some systems of NBS (Hankin et al., Reference Hankin, Hewitt, Sander, Danieli, Formetta, Kamilova, Kretzschmar, Kiradjiev, Wong, Pegler and Lamb2020). Controversy about the effectiveness of NBS for FRM (Ellis et al., Reference Ellis, Anderson and Brazier2021) can also be rooted in uncertainties, a form of monster embracement such as that documented by Turnhout et al. (Reference Turnhout, Hisschemöller and Eijsackers2008) in two controversies regarding cockle fisheries and gas mining in the Wadden Sea (an estuarine area with high ecological potential), where scientific uncertainties were exploited by competing stakeholders to undermine each other’s claims.

When confronted with deep uncertainties and knowledge controversies, one strategy that may help to navigate a path from pathological monster coping strategies toward assimilation is expert elicitation. Structured, performance-weighted elicitation has been shown in many applications to add decision- or policy-relevant information (Colson and Cooke, Reference Colson and Cooke2018). Good elicitation practice requires skill, resources and care; it is not a low-cost alternative to research or analysis (Morgan, Reference Morgan2014), and can surface meta-uncertainties related to cognitive biases (Morgan, Reference Morgan2014) or methodological choices (Clemen, Reference Clemen2008). By conditioning expert judgments against calibration questions (for which uncertainty ranges are known objectively) and pooling multiple expert views, it is possible to obtain probabilistic statements from an elicitation (Aspinall and Cooke, Reference Aspinall, Cooke, Rougier, Hill and Sparks2013). In the case of scour damage to bridges caused by river flooding, Lamb et al. (Reference Lamb, Aspinall, Odbert and Wagener2017) demonstrated an elicitation approach to deriving scour failure probabilities (similar to the uncertain failure probabilities in our case study in Section 5C) by applying the method of Cooke (Reference Cooke1991).

C. Monster assimilation and adaptation: Fluvial flood-mitigation case study

We introduce a mock or hypothetical flood-mitigation study on pluvial or surface flooding in a local neighborhood to highlight decision-making challenges in FRM. The study fits in the middle of the monster-metaphor schematic of Figure 1, as it is of intermediate complexity but some uncertainties are difficult to quantify. It is inspired by an actual case. The study will employ a graphical cost-effectiveness tool, see Bokhove et al. (Reference Bokhove, Kelmanson, Kent, Piton and Tacnet2019) and Bokhove (Reference Bokhove2021), which has successfully engaged decision-makers in France and Slovenia (see Piton et al., Reference Piton, Dupire, Arnaud, Mas, Marchal, Moncoulon, Curt and Tacnet2018a, Reference Piton, Pagano, Basile, Cokan and Lesjak2018b; Bokhove et al., Reference Bokhove, Hicks, Kent and Kelmanson2021; Bokhove et al., Reference Bokhove, Kelmanson, Piton and Tacnet2024). First, fluvial flooding of the neighborhood can be caused by the adjacent river and the outflow of the stream or brook “High Beck” into that river is closed off at higher river levels. Newly built flood walls aim to protect against fluvial events with return periods of $ 1:200\mathrm{yrs} $ . Second, High Beck has caused intermittent pluvial or surface flooding for decades, regarding beck-flooding events with return periods of $ 1:10\mathrm{yrs} $ or higher. To avoid increased surface flooding when the beck cannot flow into the river, a pump with a maximum rate of QT = 0.245 m3/s has been installed. Hence, without further interventions, the intermittent surface-flooding events remain. The stream or beck has a length of circa 2,000 m with a drop of circa 100 m. Upstream of the outflow into the river, the beck passes under a canal in a nearly horizontal 200 m-long culvert passing under playing fields to the river, which culvert floods the neighborhood in extreme beck events. The relevant canal segment has a large size of 7.5 km × 10 m × 1.5 km with several overflow weirs to the river.

The council is exploring flood-mitigation measures against the surface flooding, as follows:

(C1) The beck flow gets diverted into the canal instead of being channeled under the canal (C1). An extra canal-river overflow will be built as well as an automated gate to divide water into canal and/or culvert. Costs $ {q}_1 $ .

$ (B2 $ ) Far upstream, bunds (B2) are built at a few flatter areas to slow the beck’s flow during severe rainfall. The bunds partially prevent the downstream surface flooding. Costs $ {q}_2 $ .

$ ( FP3 $ ) The culvert from canal to river will be opened up with playing fields acting as flood-plain storage ( $ FP3 $ ) and protective bunds are built. Costs $ {q}_3 $ .

Measures B2 and FP3 offer insufficient protection in separation against the design flood but five permissible scenarios: C1, B2+FP3, B2+C1, FP3+C1 and B2+FP3+C1, do offer protection against 150 years return-period beck floods modeled using intense 3 h rainfall events. Except when C1 is fully used, scenarios with outflow into the river do require prolonged pumping of beck flood waters over the flood-defense wall into the river, for up to 10 h.

The following monster risks emerge:

(M1) There is a fear of berm collapse of the Victorian-age canal $ C1 $ . Breaches can occur at two weaker spots and would lead canal waters through fields to the river. However, berm collapse is already a fear to-be-dealt-with during heavy rainfall periods when the canal fills from its uphill side. Failure probability $ {p}_1 $ and damage $ {q}_{p_1} $ were a priori unknown. Both fear and ignorance combine in M1.

(M2) The new upstream bunds for $ B2 $ may fail with failure probability $ {p}_2<{p}_1 $ but failure can lead to a flood wave of the beck into urban areas with potential for a lot of damage, given the steep slopes, carrying an estimate damage $ {q}_{p_2} $ , both a priori unknown. Ignorance enters M2.

(M3) The bunds lying in the playing fields for $ FP3 $ may fail with low probability $ {p}_3<{p}_2<{p}_1 $ and each flooding event requires a clean-up of deposited debris; costs $ {q}_{p_3} $ . This monster is one of fear of and opposition against intermittent pollution of the public playing fields.

(M4) Subjective rejections or co-benefits of options can become monsters or fairies. For example, the canal has ecological value and cannot be used for flood protection (according to some); feeding the canal with beck water offsets droughts (a co-benefit) and, hydrographs, probabilities and costs include uncertainty. How do we value such monsters and fairies in the decision-making process?

Costs $ {q}_1,{q}_2,{q}_3 $ are known. Probabilities $ {p}_1,{p}_2,{p}_3 $ and costs $ {q}_{p_1},{q}_{p_2},{q}_{p_3} $ over the entire 25 years write-off period were unknown a priori but have been estimated through expert elicitation, a scientific consensus methodology (Aspinall and Cooke, Reference Aspinall, Cooke, Rougier, Hill and Sparks2013).

For a design-flood event with a $ 1:50\mathrm{yrs} $ return period or an annual event probability of $ 2\% $ the beck’s flood hydrograph is shown in Figure 5. Flooding occurs for discharges above the threshold $ {Q}_T $ . The flood-excess-volume (FEV) responsible for the flood damage is then the time-integrated discharge excess $ Q\left(\mathrm{t}\right)-{Q}_T $ over time $ t $ , with the event starting at $ t={t}_0 $ and ending at $ t={t}_0+T $ :

(1) $$ FEV={\int}_{t_0}^{t_0+T}\left(Q(t)-{Q}_T\right)\;\mathrm{d}t\approx 9600{\mathrm{m}}^3\approx 98\mathrm{m}\hskip0.24em \times 98\mathrm{m} \times 1\mathrm{m}, $$

reexpressed as a (dynamic) square lake of 1 m depth. This High-Beck FEV-lake is large, given the size of the neighborhood. Displaying FEV as a 1 m-deep lake therefore adds a sense of size to a flooding event, with 1 m being (half) a human-size scale.

Figure 5. Hydrograph of a simulated 150 years return-period design flood-event of High Beck, displaying discharge $ Q(t) $ versus time $ t $ with $ 5\% $ error bars indicated as dotted lines. The integrated discharge above the flooding threshold $ {Q}_T=0.245{\mathrm{m}}^3/\mathrm{s} $ constitutes the flood-excess volume, here $ FEV\approx 9600{\mathrm{m}}^3 $ , causing the flood damage.

Base costs $ {q}_1,{q}_2,{q}_3 $ concern basic construction, occurring with probability one. Monster failure or poorly quantified costs concern costs $ {p}_1{q}_{p_1},{p}_2{q}_{p_2},{p}_3{q}_{p_3} $ with the probabilities including adverse monstrous climate-change effects. Each option leads to overall costs, assuming the probabilities to be independent, as follows:

(2a) $$ C(anal),C1:\hskip0.72em {q}_1+{p}_1{q}_{p_1}, $$
(2b) $$ B(und)+ FP3,B2+ FP3:\hskip0.96em {q}_2+{q}_3+{p}_2{q}_{p_2}+{p}_3{q}_{p_3}, $$
(2c) $$ F(lood)P\left( lain\ storage\right)+C1, FP3+C1:\hskip0.72em {q}_3+{q}_1+{p}_3{q}_{p_3}+{p}_1{q}_{p_1}, $$
(2d) $$ B2+C1:\hskip0.72em {q}_2+{q}_1+{p}_2{q}_{p_2}+{p}_1{q}_{p_1}, $$
(2e) $$ B2+ FP3+C1:\hskip0.72em {q}_2+{q}_3+{q}_1+{p}_2{q}_{p_2}+{p}_3{q}_{p_3}+{p}_1{q}_{p_1}. $$

The five flood-mitigation scenarios each mitigate the entire FEV responsible for flood damage of the simulated $ 1:50\mathrm{yrs} $ event, which is the designated design flood. Each scenario can be graphed as a square lake viewed from above with each option $ (C1,B2, FP3 $ ) portioning the square lake, cf. Figure 6, with costs per option overlaid. Any option involving the canal $ (C1 $ ) can include additional storage against higher return-period or monster events beyond the target FEV emerging from the design flood, thus assimilating some monster events. Hitherto, the graphical cost-effectiveness tool has been used to inform decision-makers to make the available scenarios transparent, but no process has been developed to rationally and quantifiably choose between them. How do we value the monsters and fairies involved, in a just and science-based decision-making process, and choose the best one among these flood-mitigation scenarios?

Figure 6. Square-lake cost-effectiveness graphs of five flood-mitigation scenarios to prevent High Beck surface flooding for the $ 1:50\mathrm{yr} $ design flood. These involve possible combinations of storage into canal ( $ C1 $ , purple), upstream bunds ( $ B2 $ , red) and/or downstream flood-plain storage ( $ FP3 $ , green). Base costs $ {q}_1,{q}_2,{q}_3 $ plus costs with uncertainty $ {p}_1{q}_{p_1},{p}_2{q}_{p_2},{p}_3{q}_{p_3} $ have been superimposed using the double-sided arrows. Each square lake with a lateral depth of 1 m (out of the page) and side lengths of 98 m represents the FEV ( $ FEV\approx 9600{\mathrm{m}}^3\approx 98\mathrm{m}\times 98\mathrm{m}\times 1\mathrm{m} $ ) to be reduced to zero by the combinations of mitigation measures. The canal measure $ C1 $ can provide extra mitigation (as indicated) by diverting less flood water to the downstream fields, thus reducing $ FP3 $ , and some to the canal $ C1 $ . In those partial cases, uncertain costs may be lower. Diverting flood waters into the canal does not affect the upstream measure $ B2 $ .

Note that in the square graphs presented here, we have left out the uncertainties in the FEV and the flood-mitigation-measure volumes (the rectangular areas in the graphs). The latter (mitigation) uncertainties can be represented to some extent by using the vertical axis as uncertainty axis, from least to most uncertainty, leading to triangular and quadrilateral instead of rectangular shapes, cf. Bokhove et al. (Reference Bokhove, Kelmanson, Kent, Piton and Tacnet2019) and Bokhove (Reference Bokhove2021).

The above is an example of how the strategies of monster assimilation and monster adaptation can be. The decision problem has been made structured and complexity has been reduced to an unavoidable minimum level. Yet a final step has to be made: decision-makers need to be informed in a comprehensible way, to support what decisions are deemed “good.” Otherwise, new monsters of uncertainty can grow. The question is also what characteristics define “good,” that is, decisions need to be rational, cost-effective/efficient, have minimum regret and maximum political support and so forth. Furthermore, decision-makers should be supported in Bayesian decision-making, which implies that uncertainties are explicitly incorporated in the decision-making process (Morgan and Henrion, Reference Morgan and Henrion1990).

The importance of what could characterize and qualify a “good decision” in FRM can be illustrated by considering what can cause suboptimal decisions. Addressing only one dimension of flood-mitigation problems, albeit rationally, may adversely affect other aspects in that the chosen solution taken:

  1. (a) may lead to new problems (e.g., loss of ecological functions) (Auerswald et al., Reference Auerswald, Moyle, Seibert and Geist2019);

  2. (b) has unintended long-term consequences (e.g., a dependence on higher flood-defense walls to contain river levels for 1-in-200 years protection in a narrow channel could lead to a false sense of security, especially as return periods reduce due to climate change, causing future overtopping or breaches) (Kates et al., Reference Kates, Colten, Laska and Leatherman2006; Di Baldassarre et al., Reference Di Baldassarre, Kooy, Kemerink and Brandimarte2013a, Reference Di Baldassarre, Viglione, Carr, Linda Kuil and Blöschl2013b; Gohari et al., Reference Gohari, Eslamian, Mirchi, Abedi-Koupaei, Bavani and Madani2013); and,

  3. (c) has an uneven distribution of costs and benefits when other sectors and social groups are taken into account (e.g., if optimism bias about the extrapolation of NFM benefits were to cause reduced investment in other, more predictable, flood risk mitigations for vulnerable communities) (Savelli et al., Reference Savelli, Rusca, Cloke and Di Baldassarre2021).

Morgan and Henrion (Reference Morgan and Henrion1990) comprehensively discuss decision-taking criteria in their Section 3.4. In a nutshell, which does insufficient justice to their writing: they distinguish utility-based, rights-based, technology-based and hybrid criteria. In particular, maximization of a multi-attribute utility function would address the points above. Various relevant aspects are then brought together in one utility function, without assigning monetary values to relevant aspects. While that sounds simple, an apparent drawback can be that the as-such defined function often becomes complex and difficult to understand for the decision-makers. Transparency thereon and on the general decision-process can be achieved by defining the relevant decision-criteria and associated functionality at the beginning of the process with all relevant actors, including communication experts, in order to clearly define and accept the chosen criteria. Moreover, also in FRM, it is important to make the decision-process adaptive such that it can be revisited in the future, when new technology, observational data and information become available. Most organizations might find it difficult to adopt such adaptivity, but it should be adopted as long as the process is primarily geared to focus on improved decision-making and not on assigning blame for taking past wrong or suboptimal decisions. Finally, Morgan and Henrion (Reference Morgan and Henrion1990) discuss an “approved process” as decision criterion and declare that to be a widely used approach, in which a decision is considered acceptable when a specified set of procedures is followed. They point out that the language of decision analysis is inappropriate for such a social as opposed to analysis-based process.

A graphical cost-effectiveness tool was exemplified through a hypothetical study with five flood-mitigation scenarios. Each scenario had base construction costs and potentially additional costs associated with failures of uncertain nature, and some scenarios had a co-benefit. An outstanding question is how to construct a decision-tree in order to make the best decision under such uncertainties. While the square-lake cost-effectiveness graphics has proven to be beneficial to decision-makers, see Piton et al. (Reference Piton, Dupire, Arnaud, Mas, Marchal, Moncoulon, Curt and Tacnet2018a) and Piton et al. (Reference Piton, Pagano, Basile, Cokan and Lesjak2018b), a pressing question is how to visualize and explain decision-trees such these can be understood and applied by decision-makers.

This case study falls in the middle of our schematic of FRM-challenges displayed in Figure 1, as it is of intermediate complexity with estimates of the uncertainties involved. Intuitively, it seems obvious that the optimal scenario must include the canal-storage option since the canal offers extra buffer capacity beyond the target flood-excess volume FEV. However, when it turns out that the canal option becomes (nearly) impossible, it shifts the study to the right side of the schematic where FRM is poorly-structured: for example, when a combined-sewer overflow (CSO) pollutes the beck during intermediate rainfall and a short extra CSO-pipe along part of the beck and debris filter could prevent pollution flowing into the canal and lower pollution flow into the river, the issue can become that the public council is only responsible to deal with flooding, that the nonprofit “Trust” only maintains the canal and its ecological value, that private business “The Shire” is only responsible for the sewer system and that there is no legislation to enforce effective collaboration to solve the integral water-sewer management challenge described. A case of monster anesthesia?

The decision-making bodies on FRM can have highly different levels of expertise. In the Netherlands, for example, (fluvial and pluvial) FRM is channeled to a large extent through so-called waterboards or “Waterschappen,” which boards contain elected people who are exclusively focusing on decisions in water management. Perhaps in contrast, in the UK, FRM decisions span a range of organizations with differing responsibilities (Finlay and Bolton, Reference Finlay and Bolton2022), sometimes working independently, but often in partnership, and involving people with range of expertise and interests. Consequently, equipping decision-making bodies with adequate (visualization) tools to be engaged in a meaningful way with FRM will be a different task depending on the situation.

Discussion

In the present contribution, we have described the various guises of uncertainty monsters and possible coping strategies. If efficient decision-making in FRM is aimed for, then monster adaptation and monster assimilation are the preferred coping strategies. We argued that these strategies benefit from improving structure and reducing complexity of decision problems. Against this light, it is helpful to unpack the steps needed to effectively communicate uncertainties in FRM.

As exemplified by the cases above, a dominant aspect of FRM is the epistemic nature of uncertainty. That is, it deals with phenomena that we do not fully understand (yet) due to limited scientific knowledge or one being ignorant. Dealing effectively with epistemic uncertainty requires a deliberate risk communication strategy. In their framework, Van der Bles et al. (Reference Van der Bles, Van der Linden, Freeman, Mitchell, Galvao, Zaval and Spiegelhalter2019) stipulated that (1) what, (2) in what form, (3) to whom and (4) to what effect are all elements to be considered:

  1. 1. the object, source, level and magnitude of uncertainty;

  2. 2. how is the uncertainty described, in which format, and via which medium?

  3. 3. what kind of audience is involved, what is their relationship with the content of the communication and the communicator?

  4. 4. communication can have impact on the thinking (cognition), feeling (affect), trust and, importantly, decision-making.

However, neither maximized structure nor minimized complexity of decision problems nor prudent communication still do not guarantee that decision-makers take this information into account. Indeed, monster adaptation and assimilation imply careful consideration of information, referred to as the central route of information processing (Petty and Cacioppo, Reference Petty and Cacioppo1984). Decision-makers may not always be motivated or equipped to this. The attitudes of decision-makers can be changed via an alternative route, to which Petty and Cacioppo (Reference Petty and Cacioppo1984) refer as the peripheral route, characterized by informational cues, such as the number of arguments, the implied expertise of the communicator and so forth. These cues are not directly related to content of the message, but may still influence the decision-making process. Possibly, the involvement of decision-makers in monster adaptation or assimilation could be achieved by a more peripheral route of information processing along storylines, as Shepherd et al. (Reference Shepherd, Boyd, Calel, Chapman, Dessai, Dima-West, Fowler, James, Maraun, Martius, Senior, Sobel, Stainforth, Tett, Trenberth, van den Hurk, Watkins, Wilby and Zenghelis2018) proposed for representing uncertainty in physical aspects of climate change. The conventional approach to representing uncertainty in the physical aspects of climate change is probabilistic, based on ensembles of climate model simulations. However, in the face of deep uncertainties, the known limitations of this approach are becoming increasingly apparent. An alternative is thus emerging which may be called a “storyline” approach. Shepherd et al. (Reference Shepherd, Boyd, Calel, Chapman, Dessai, Dima-West, Fowler, James, Maraun, Martius, Senior, Sobel, Stainforth, Tett, Trenberth, van den Hurk, Watkins, Wilby and Zenghelis2018) defined storylines as “a physically self-consistent unfolding of past events, or of plausible future events or pathways. No a priori probability of the storyline is assessed; emphasis is placed instead on understanding the driving factors involved, and the plausibility of those factors.”

As discussed, structured and evidence-based approaches to communication will help our uncertainty monsters to be assimilated, provided that sufficient resources can be allocated to developing communication strategies that integrate with analyses such as those discussed in this paper. Where uncertainties can only be expressed as conditional on assumed future scenarios or narratives, the expert elicitation approach discussed earlier may be useful. Other, innovative approaches may emerge to aggregate information about uncertain future risks; for example, prediction markets have been proposed as an efficient mechanism to allocate funding for applied climate research (Roulston et al., Reference Roulston, Kaplan, Day and Kaivanto2022).

Open peer review

To view the open peer review materials for this article, please visit http://doi.org/10.1017/wat.2024.4.

Data availability statement

The csv-file, the Python code and Matlab code used in case C can be provided.

Acknowledgments

The authors are grateful to Deborah Oluwasanya (Cambridge University Press) for her enthusiastic support during the writing process. O.B. acknowledges fruitful discussions with and proofreading by Charles Taylor. P.M.P. kindly acknowledges the inspiration gained from the work by David Robert Jones. M.K. acknowledges Cees van Woerkum for sharing useful insights. Constructive and much-appreciated comments by one reviewer have led to several improvements. In particular, we use the reviewer’s comment as a starting point to discuss what could constitute good decision criteria.

Competing interest

The authors declare none.

References

Arkes, HR and Ayton, P (1999) The sunk cost and concorde effects: Are humans less rational than lower animals? Psychological Bulletin 125(5), 591600. https://doi.org/10.1037/0033-2909.125.5.591.CrossRefGoogle Scholar
Aspinall, WP and Cooke, RM (2013) Quantifying scientific uncertainty from expert judgement elicitation. In Rougier, J, Hill, LJ and Sparks, S (eds), Risk and Uncertainty Assessment for Natural Hazards. Cambridge: Cambridge University Press, pp. 6499.CrossRefGoogle Scholar
Auerswald, K, Moyle, P, Seibert, SP and Geist, J (2019) Hess opinions: Socio-economic and ecological trade-offs of flood management–benefits of a transdisciplinary approach. Hydrology and Earth System Sciences 23(2), 10351044. https://doi.org/10.5194/hess-23-1035-2019.CrossRefGoogle Scholar
Ball, J, Babister, M, Nathan, R, Weeks, W, Weinmann, E, Retallick, M and Testoni, I (eds) (2019 ) Australian Rainfall and Runoff: A Guide to Flood Estimation. Commonwealth of Australia. Available at https://arr.ga.gov.au/.Google Scholar
Benson, MA (1968) Uniform flood-frequency estimating methods for federal agencies. Water Resources Research 4(5), 891908. https://doi.org/10.1029/WR004i005p00891.CrossRefGoogle Scholar
Beven, K, Almeida, S, Aspinall, WP, Bates, PD, Blazkova, S, Borgomeo, E, Freer, J, Goda, K, Hall, JW, Phillips, JC, Simpson, M, Smith, PJ, Stephenson, DB, Wagener, T, Watson, M, Wilkins, KL (2018) Epistemic uncertainties and natural hazard risk assessment – Part 1: A review of different natural hazard areas. Natural Hazards and Earth System Sciences 18(10), 27412768. https://doi.org/10.5194/nhess-18-2741-2018.CrossRefGoogle Scholar
Beven, K, Page, T, Hankin, B, Smith, P, Kretzschmar, A, Mindham, D and Chappell, N (2022) Deciding on fitness-for-purpose-of models and of natural flood management. Hydrological Processes 36(11), e14752. https://doi.org/10.1002/hyp.14752.CrossRefGoogle Scholar
Blöschl, G, Hall, J, Viglione, A, Rui, APP, Parajka, J, Merz, B, Lun, D, Arheimer, B, Aronica, GT, Bilibashi, A, Boháč, M, Bonacci, O, Borga, M, Čanjevac, I, Castellarin, A, Chirico, GB, Claps, P, Frolova, N, Ganora, D, Gorbachova, L, Gül, A, Hannaford, J, Harrigan, S, Kireeva, M, Kiss, A, Kjeldsen, TR, Kohnová, S, Koskela, JJ, Ledvinka, O, Macdonald, N, Mavrova-Guirguinova, M, Mediero, L, Merz, R, Molnar, P, Montanari, A, Murphy, C, Osuch, M, Ovcharuk, V, Radevski, I, Salinas, JL, Sauquet, E, Šraj, M, Szolgay, J, Volpi, E, Wilson, D, Zaimi, K and Živković, N (2019) Changing climate both increases and decreases European river floods. Nature 573(7772), 108111. https://doi.org/10.1038/s41586-019-1495-6.CrossRefGoogle ScholarPubMed
Bobée, B, Cavadias, G, Ashkar, F, Bernier, J and Rasmussen, P (1993) Towards a systematic approach to comparing distributions used in flood frequency analysis. Journal of Hydrology 142(1), 121136. https://doi.org/10.1016/0022-1694(93)90008-W.CrossRefGoogle Scholar
Bokhove, O (2021) On communicating cost-effectiveness of flood-mitigation schemes. In Proceedings of the 31st European Safety and Reliability Conference, Angers, France. https://www.rpsonline.com.sg/proceedings/9789811820168/pdf/134.pdf (accessed 01 February 2024).CrossRefGoogle Scholar
Bokhove, O, Hicks, T, Kent, T and Kelmanson, M (2021) Visualising Flood Frequency, Flood Volume and Mitigation of Extreme Events, 5. UK Research Excellence Framework REF2021, Impact Case Study, Mathematics. Available at https://results2021.ref.ac.uk/impact/0ad7c1be-8e91-4aac-ab57-6c1e873cd3f1?page=1&fbclid=IwAR0l2_YmgcmEUWvgHwyMR0WyxJsaL3qM7L92fZ-qFkjzq_-JEAyDDnSTqbw (accessed 01 February 2024).Google Scholar
Bokhove, O, Kelmanson, M, Kent, T, Piton, G and Tacnet, J-M (2019) Communicating (nature-based) solutions using flood-excess volume for three uk and french river floods. River Research and Applications 35, 14021414. https://doi.org/10.1016/j.envsci.2007.07.004.CrossRefGoogle Scholar
Bokhove, O, Kelmanson, M, Piton, G and Tacnet, J-M (2024) Visualising Flood Frequency, Flood Volume and Mitigation of Extreme Events, 6. More UK Success Stories in Industrial Mathematics. Available at https://link.springer.com/book/9783031486821 (accessed 01 February 2024).Google Scholar
Bokhove, O, Kent, T and Kelmanson, M (2018) Using Flood-Excess Volume to Show that Upscaling Beaver Dams for Protection against Extreme Floods Proves Unrealistic. Available at https://eartharxiv.org/repository/view/1281/ (accessed 01 February 2024).CrossRefGoogle Scholar
Boughton, W and Droop, O (2003) Continuous simulation for design flood estimation—a review. Environmental Modelling & Software 18(4), 309318. https://doi.org/10.1016/S1364-8152(03)00004-5.CrossRefGoogle Scholar
Brown, JD (2004) Knowledge, uncertainty and physical geography: Towards the development of methodologies for questioning belief. Transactions of the Institute of British Geographers 29(3), 367381. https://doi.org/10.1111/j.0020-2754.2004.00342.x.CrossRefGoogle Scholar
Brown, JD (2010) Prospects for the open treatment of uncertainty in environmental research. Progress in Physical Geography 34(1), 75100. https://doi.org/10.1177/0309133309357000.CrossRefGoogle Scholar
Butler, DR and Malanson, GP (2005) The geomorphic influences of beaver dams and failures of beaver dams. Geomorphology, Dams in Geomorphology 71(1), 4860. https://doi.org/10.1016/j.geomorph.2004.08.016.CrossRefGoogle Scholar
Castellarin, A, Kohnova, S, Gaal, L, Fleig, A,Salinas, JL, Toumazis, A, Kjeldsen, TR and Macdonald, N (2012 ) Review of Applied-Statistical Methods for Flood-Frequency Analysis in Europe. Publication - Report. Available at https://nora.nerc.ac.uk/id/eprint/19286/ (accessed 2 August 2023).Google Scholar
CCC (2018 ) Managing the Coast in a Changing Climate. Technical report. London: The Committee on Climate Change. https://www.theccc.org.uk/publication/managing-the-coast-in-a-changing-climate/.Google Scholar
Clark, CO (1945) Storage and the unit hydrograph. Transactions of the American Society of Civil Engineers 110(1), 14191446. https://doi.org/10.1061/TACEAT.0005800.Google Scholar
Clemen, RT (2008) Comment on Cooke’s classical method. Reliability Engineering & System Safety, Expert Judgement 93(5), 760765. https://doi.org/10.1016/j.ress.2008.02.003.CrossRefGoogle Scholar
Colson, AR and Cooke, RM (2018) Expert elicitation: Using the classical model to validate experts’ Judgments. Review of Environmental Economics and Policy 12(1), 113132. https://doi.org/10.1093/reep/rex022.CrossRefGoogle Scholar
Cooke, R (1991 ) Cooke: Experts in Uncertainty: Opinion and Subjective Probability in Science. Oxford: Oxford University Press. Available at https://scholar.google.com/scholar_lookup?title=Experts%20in%20uncertainty%3A%20opinions%20and%20subjective%20probability%20in%20science&publication_year=1991&author=R.M.%20Cooke (accessed 2 August 2023).CrossRefGoogle Scholar
Dadson, SJ, Hall, JW, Murgatroyd, A, Acreman, M, Bates, P, Beven, K, Heathwaite, L, Holden, J, Holman, IP, Lane, SN, O’Connell, E, Penning-Rowsell, E, Reynard, N, Sear, D, Thorne, C and Wilby, R (2017) A restatement of the natural science evidence concerning catchment-based ‘natural’ flood management in the UK. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 473(2199), 20160706. https://doi.org/10.1098/rspa.2016.0706.CrossRefGoogle ScholarPubMed
Dawdy, DR, Griffis, VW and Gupta, VK (2012 ) Regional flood-frequency analysis: How we got here and where we are going. Journal of Hydrologic Engineering 17(9), 953959. https://doi.org/10.1061/(ASCE)HE.1943-5584.0000584.CrossRefGoogle Scholar
DEFRA (2018) Working with Natural Processes, Evidence Directory. Available at https://www.gov.uk/flood-and-coastal-erosion-risk-management-research-reports/working-with-natural-processes-to-reduce-flood-risk#reports (accessed 10 January 2024).Google Scholar
Deming, D (2021) Edmond Halley’s contributions to hydrogeology. Groundwater 59(1), 146152. https://doi.org/10.1111/gwat.13059.CrossRefGoogle ScholarPubMed
Di Baldassarre, G, Brandimarte, L and Beven, K (2016) The seventh facet of uncertainty: Wrong assumptions, unknowns and surprises in the dynamics of human–water systems. Hydrological Sciences Journal 61(9), 17481758. https://doi.org/10.1080/02626667.2015.1091460.CrossRefGoogle Scholar
Di Baldassarre, G, Kooy, M, Kemerink, JS and Brandimarte, L (2013a) Towards understanding the dynamic behaviour of floodplains as human-water systems. Hydrology and Earth System Sciences 17(8), 32353244. https://doi.org/10.5194/hess-17-3235-2013.CrossRefGoogle Scholar
Di Baldassarre, G, Viglione, A, Carr, G, Linda Kuil, JLS and Blöschl, G (2013b) Sociohydrology: Conceptualising human-flood interactions. Hydrology and Earth System Sciences 17(8), 32953303. https://doi.org/10.5194/hess-17-3295-2013.CrossRefGoogle Scholar
Diaconu, DC, Costache, R and Popa, MC (2021 ) An overview of flood risk analysis methods. Water 13(4), 474. https://doi.org/10.3390/w13040474.CrossRefGoogle Scholar
Dooge, J (1973) Linear Theory of Hydrologic Systems. Technical Bulletin 1468. United States Department of Agriculture. Available at https://naldc.nal.usda.gov/download/CAT74413771/PDF (accessed 2 August 2023).Google Scholar
Douglas, M (1966) Purity and Danger: An Analysis of the Concepts of Pollution and Taboo. London and New York: Routledge.Google Scholar
Eagleson, PS (1972) Dynamics of flood frequency. Water Resources Research 8(4), 878898. https://doi.org/10.1029/WR008i004p00878.CrossRefGoogle Scholar
Ellis, N, Anderson, K and Brazier, R (2021) Mainstreaming natural flood management: A proposed research framework derived from a critical evaluation of current knowledge. Progress in Physical Geography: Earth and Environment 45(6), 819841. https://doi.org/10.1177/0309133321997299.CrossRefGoogle Scholar
England, JF Jr, Cohn, TA, Faber, BA, Stedinger, JR, Thomas, WO Jr., Veilleux, AG, Kiang, JE and Mason, RR Jr (2019 ) Guidelines for Determining Flood Flow Frequency — Bulletin 17C. USGS Numbered Series 4-B5. Reston, VA: U.S. Geological Survey. https://doi.org/10.3133/tm4B5.CrossRefGoogle Scholar
Environment Agency (2020 ) Rapid Evidence Assessment of Non-stationarity in Sources of UK Flooding. Technical report FRS18087/REA/R1. Bristol, UK. Available at https://assets.publishing.service.gov.uk/media/6038f7cbe90e070558e429ca/Rapid_evidence_assessment_of_non-stationarity_in_sources_of_UK_flooding_-_report__1_.pdf (accessed 10 January 2024).Google Scholar
Environment Agency (2021a) Development of Interim National Guidance on Non-stationary Fluvial Flood Frequency Estimation. Available at https://www.gov.uk/flood-and-coastal-erosion-risk-management-research-reports/development-of-interim-national-guidance-on-non-stationary-fluvial-flood-frequency-estimation (accessed 2 August 2023).Google Scholar
Environment Agency (2021b) Long-Term Investment Scenarios (LTIS) 2019. Available at https://www.gov.uk/government/publications/flood-and-coastal-risk-management-in-england-long-term-investment/long-term-investment-scenarios-ltis-2019 (accessed 2 August 2023).Google Scholar
Environment Agency (2021c) Natural Flood Management Programme: Initial Findings [in en]. Available at https://www.gov.uk/government/publications/natural-flood-management-programme-initial-findings (accessed 4 August 2023).Google Scholar
Environment Agency (2022) Natural Flood Management Programme: Evaluation Report [in en]. Available at https://www.gov.uk/government/publications/natural-flood-management-programme-evaluation-report/natural-flood-management-programme-evaluation-report (accessed 4 August 2023).Google Scholar
Finlay, J and Bolton, P (2022 ) Flood Risk Management and Funding. Research Briefing CBP 7514. London: House of Commons Library. Available at https://commonslibrary.parliament.uk/research-briefings/cbp-7514/ (accessed 18 August 2023).Google Scholar
Fuller, WE (1914) Flood flows. Transactions of the American Society of Civil Engineers 77(1), 564617. https://doi.org/10.1061/taceat.0002552.CrossRefGoogle Scholar
Gohari, A, Eslamian, S, Mirchi, A, Abedi-Koupaei, J, Bavani, AM and Madani, K (2013) Water transfer as a solution to water shortage: A fix that can backfire. Journal of Hydrology 491, 2339. https://doi.org/10.1016/j.jhydrol.2013.03.021.CrossRefGoogle Scholar
Gumbel, EJ (1958) Statistics of Extremes. New York: Columbia University Press.CrossRefGoogle Scholar
Gupta, HV and Razavi, S (2018) Revisiting the basis of sensitivity analysis for dynamical earth system models. Water Resources Research 54(11), 86928717. https://doi.org/10.1029/2018WR022668.CrossRefGoogle Scholar
Hallegatte, S, Shah, A, Lempert, R, Brown, C and Gill, S (2012) Investment Decision Making Under Deep Uncertainty. Technical report 6193. The World Bank. https://openknowledge.worldbank.org/server/api/core/bitstreams/24b2bb36-2aaa-597f-8ed1-de11183d7063/content.Google Scholar
Hankin, B, Hewitt, I, Sander, G, Danieli, F, Formetta, G, Kamilova, A, Kretzschmar, A, Kiradjiev, K, Wong, C, Pegler, S and Lamb, R (2020) A risk-based network analysis of distributed in-stream leaky barriers for flood risk management. Natural Hazards and Earth System Sciences 20(10), 25672584. https://doi.org/10.5194/nhess-20-2567-2020.CrossRefGoogle Scholar
Hankin, B, Trevor, JCP, Chappell, NA, Beven, KJ, Smith, PJ, Kretzschmar, A and Lamb, R (2021) Using micro-catchment experiments for multi-local scale modelling of nature-based solutions. Hydrological Processes 35(11), e14418. https://doi.org/10.1002/hyp.14418.CrossRefGoogle Scholar
Hannaford, J, Mastrantonas, N, Vesuviano, G and Turner, S (2021) An updated national-scale assessment of trends in UK peak river flow data: How robust are observed increases in flooding? Hydrology Research 52(3), 699718. https://doi.org/10.2166/nh.2021.156.CrossRefGoogle Scholar
Heijer, Fd, Rijke, J, Bosch-Rekveldt, M, de Leeuw, A and Barciela-Rial, M (2023) Asset management of flood defences as a co-production—an analysis of cooperation in five situations in the netherlands. Journal of Flood Risk Management 16(3), e12909. https://doi.org/10.1111/jfr3.12909.CrossRefGoogle Scholar
Hillman, GR (1998) Flood wave attenuation by a wetland following a beaver dam failure on a second order boreal stream. Wetlands 18(1), 2134. https://doi.org/10.1007/BF03161439.CrossRefGoogle Scholar
Iacob, O, Rowan, JS, Brown, I and Ellis, C (2014) Evaluating wider benefits of natural flood management strategies: An ecosystem-based adaptation perspective. Hydrology Research 45(6), 774787. https://doi.org/10.2166/nh.2014.184.CrossRefGoogle Scholar
Institute of Hydrology (1999) Flood Estimation Handbook. Available at https://www.ceh.ac.uk/services/flood-estimation-handbook (accessed 1 August 2023).Google Scholar
JBA Consulting (2022) Relative importance of the hydrological uncertainties within the flood modelling chain. Report commissioned by the Environment Agency EAM6. Environment Agency. Available at https://engageenvironmentagency.uk.engagementhq.com/methods-m6-relative-importance-of-hydrological-uncertainties-in-the-flood-modelling-chain (accessed 10 January 2024).Google Scholar
Kahneman, D (2011) Thinking, Fast and Slow. New York: Farrar, Straus & Giroux.Google Scholar
Karlsson, N, Loewenstein, G and Seppi, D (2009) The ostrich effect: Selective attention to information. Journal of Risk and Uncertainty 38(2), 95115. https://doi.org/10.1007/s11166-009-9060-6.CrossRefGoogle Scholar
Kates, RW, Colten, CE, Laska, S and Leatherman, SP (2006) Reconstruction of new orleans after hurricane katrina: A research perspective. Proceedings of the National Academy of Sciences 103(40), 1465314660. https://doi.org/10.1073/pnas.0605726103.CrossRefGoogle ScholarPubMed
Knight, FH (1921) Risk, Uncertainty, and Profit. Boston and New York: Houghton Mifflin Company.Google Scholar
Kochanek, K., Renard, B, Arnaud, P, Aubert, Y, Lang, M, Cipriani, T and Sauquet, E (2014) A data-based comparison of flood frequency analysis methods used in France. Natural Hazards and Earth System Sciences 14(2), 295308. https://doi.org/10.5194/nhess-14-295-2014.CrossRefGoogle Scholar
Krzywinski, M and Altman, N (2014) Visualizing samples with box plots. Nature Methods 11(2), 119120. https://doi.org/10.1038/nmeth.2813.CrossRefGoogle ScholarPubMed
Lamb, R (2006) Rainfall-runoff modeling for flood frequency estimation. In Anderson, Malcolm G. (ed.) Encyclopedia of Hydrological Sciences. Hoboken, New Jersey: John Wiley & Sons Ltd. https://doi.org/10.1002/0470848944.hsa133.Google Scholar
Lamb, R, Aspinall, W, Odbert, H and Wagener, T (2017) Vulnerability of bridges to scour: Insights from an international expert elicitation workshop. Natural Hazards and Earth System Sciences 17(8), 13931409. https://doi.org/10.5194/nhess-17-1393-2017.CrossRefGoogle Scholar
Lamb, R, Faulkner, D, Wass, P and Cameron, D (2016) Have applications of continuous rainfall-runoff simulation realized the vision for process-based flood frequency analysis? Hydrological Processes 30(14), 24632481. https://doi.org/10.1002/hyp.10882.CrossRefGoogle Scholar
Lane, SN (2017) Natural flood management. WIREs Water 4(3), e1211. https://doi.org/10.1002/wat2.1211.CrossRefGoogle Scholar
Maddux, JE and Rogers, RW (1983) Protection motivation and self-efficacy: A revised theory of fear appeals and attitude change. Journal of Experimental Social Psychology 19(5), 469479.CrossRefGoogle Scholar
Merz, B, Sergiy Vorogushyn, UL, Viglione, A and Blöschl, G (2015) Charting unknown waters—on the role of surprise in flood risk assessment and management. Water Resources Research 51(8), 63996416. https://doi.org/10.1002/2015WR017464.CrossRefGoogle Scholar
Möller, I (2019) Applying uncertain science to nature-based coastal protection: Lessons from shallow wetland-dominated shores. Frontiers in Environmental Science 7, 49. https://www.frontiersin.org/articles/10.3389/fenvs.2019.00049.CrossRefGoogle Scholar
Montanari, A and Koutsoyiannis, D (2012) A blueprint for process-based modeling of uncertain hydrological systems. Water Resources Research 48(9). https://doi.org/10.1029/2011WR011412.CrossRefGoogle Scholar
Morgan, GM and Henrion, M (1990) Uncertainty—A Guide to Dealing with Uncertainty in Quantitative Risk and Policy Analysis. New York: Cambridge University Press.CrossRefGoogle Scholar
Morgan, MG (2014) Use (and abuse) of expert elicitation in support of decision making for public policy. Proceedings of the National Academy of Sciences 111(20), 71767184. https://doi.org/10.1073/pnas.1319946111.CrossRefGoogle ScholarPubMed
Nearing, GS, Tian, Y, Gupta, HV, Clark, MP, Harrison, KW and Weijs, SV (2016) A philosophical basis for hydrological uncertainty. Hydrological Sciences Journal 61(9), 16661678. https://doi.org/10.1080/02626667.2016.1183009.CrossRefGoogle Scholar
NERC (1975) Flood Studies Report. Wallingford: Natural Environment Research Council. Available at https://www.ceh.ac.uk/services/flood-estimation-handbook (accessed 1 August 2023).Google Scholar
Pappenberger, F and Beven, KJ (2006) Ignorance is bliss: Or seven reasons not to use uncertainty analysis. Water Resources Research 42(W05302), 18. https://doi.org/10.1029/2005WR004820.CrossRefGoogle Scholar
Petty, RE and Cacioppo, JT (1984) The effects of involvement on responses to argument quantity and quality: Central and peripheral routes to persuasion. Journal of Personality and Social Psychology 46(1), 6981. https://doi.org/10.1037/0022-3514.46.1.69.CrossRefGoogle Scholar
Pianosi, F, Beven, K, Freer, J, Hall, JW, Rougier, J, Stephenson, DB and Wagener, T (2016) Sensitivity analysis of environmental models: A systematic review with practical workflow. Environmental Modelling & Software 79, 214232. https://doi.org/10.1016/j.envsoft.2016.02.008.CrossRefGoogle Scholar
Pianosi, F, Sarrazin, F and Wagener, T (2020) How successfully is open-source research software adopted? Results and implications of surveying the users of a sensitivity analysis toolbox. Environmental Modelling & Software 124, 104579. https://doi.org/10.1016/j.envsoft.2019.104579.CrossRefGoogle Scholar
Piton, G, Dupire, S, Arnaud, P, Mas, A, Marchal, R, Moncoulon, D, Curt, T and Tacnet, J (2018a) DEL6.2 From Hazards to Risk: Models for the DEMOs –Part 3: France: Brague Catchment DEMO. Technical report, NAIAD H2020 project GA 730497. Available at https://naiad2020.eu/wp-content/uploads/2019/02/D6.2_REV_FINAL.pdf (accessed 6 February 2024; see also: https://naiad2020.eu/media-center/project-public-deliverables/).Google Scholar
Piton, G, Pagano, A, Basile, R, Cokan, B and Lesjak, S (2018b) DEL6.2 From Hazards to Risk: Models for the DEMOs –Part 5: Slovenia –Glinscica Catchment DEMO. Technical report, NAIAD H2020 project GA 730497. https://naiad2020.eu/wp-content/uploads/2019/02/D6.2_REV_FINAL.pdf (accessed 6 February 2024; see also: https://naiad2020.eu/media-center/project-public-deliverables/).Google Scholar
Plate, EJ (2002 ) Flood risk and flood management. Advances in flood research. Journal of Hydrology 267(1), 211. https://doi.org/10.1016/S0022-1694(02)00135-X.CrossRefGoogle Scholar
Poortvliet, PM, Knotters, M, Bergsma, P, Verstoep, J and van Wijk, J (2019) On the communication of statistical information about uncertainty in flood risk management. Safety Science 118, 194204. https://doi.org/10.1016/j.ssci.2019.05.024.CrossRefGoogle Scholar
Rehan, B (2016 ) Risk-Based Flood Protection Decisions in the Context of Climatic Variability and Change. University of Oxford. Available at https://ora.ox.ac.uk/objects/uuid:d4f3ecc7-0a85-46fe-a66c-4251ddbca83a (accessed 4 August 2023).Google Scholar
Rehan, BM and Hall, JW (2016) Uncertainty and sensitivity analysis of flood risk management decisions based on stationary and nonstationary model choices. E3S Web of Conferences 7, 20003. https://doi.org/10.1051/e3sconf/20160720003.CrossRefGoogle Scholar
Renn, O (2008) Risk Governance: Coping with Uncertainty in a Complex World. London: Earthscan.Google Scholar
Roulston, M, Kaplan, T, Day, B and Kaivanto, K (2022) Prediction-market innovations can improve climate-risk forecasts. Nature Climate Change 12(10), 879880. https://doi.org/10.1038/s41558-022-01467-6.CrossRefGoogle Scholar
Ryberg, KR, Kolars, KA, Kiang, JE and Carr, ML (2020 ) Flood-Frequency Estimation for Very Low Annual Exceedance Probabilities Using Historical, Paleoflood, and Regional Information with Consideration of Nonstationarity. USGS Numbered Series 2020-5065. Reston, VA: U.S. Geological Survey. https://doi.org/10.3133/sir20205065.CrossRefGoogle Scholar
Savelli, E, Rusca, M, Cloke, H and Di Baldassarre, G (2021) Don’t blame the rain: Social power and the 2015–2017 drought in cape town. Journal of Hydrology 594, 125953. https://doi.org/10.1016/j.jhydrol.2020.125953.CrossRefGoogle Scholar
Seddon, N, Chausson, A, Berry, P, Cécile, AJG, Smith, A and Turner, B (2020) Understanding the value and limits of nature-based solutions to climate change and other global challenges. Philosophical Transactions of the Royal Society B: Biological Sciences 375(1794), 20190120. https://doi.org/10.1098/rstb.2019.0120.CrossRefGoogle ScholarPubMed
Shepherd, TG, Boyd, E, Calel, RA, Chapman, SC, Dessai, S, Dima-West, IM, Fowler, HJ, James, R, Maraun, D, Martius, O, Senior, CA, Sobel, AH, Stainforth, DA, Tett, SFB, Trenberth, KE, van den Hurk, BJJM, Watkins, NW, Wilby, RL and Zenghelis, DA (2018) Storylines: An alternative approach to representing uncertainty in physical aspects of climate change. Climatic Change 151, 555571. https://doi.org/10.1007/s10584-018-2317-9.CrossRefGoogle ScholarPubMed
Sherman, LK (1932) Streamflow from rainfall by unit-graph method. Engineering News Record 108, 501505.Google Scholar
Simon, HA (1990) Bounded rationality. In Eatwell, J, Milgate, M and Newman, P (eds), Utility and Probability. London: Palgrave Macmillan, pp. 1518.CrossRefGoogle ScholarPubMed
Slater, L, Villarini, G, Archfield, S, Faulkner, D, Lamb, R, Khouakhi, A and Yin, J (2021) Global changes in 20-year, 50-year, and 100-year river floods. Geophysical Research Letters 48(6), e2020GL091824. https://doi.org/10.1029/2020GL091824.CrossRefGoogle Scholar
Slovic, P, Finucane, ML, Peters, E and MacGregor, DG (2004) Risk as analysis and risk as feelings: Some thoughts about affect, reason, risk, and rationality. Risk Analysis 24(2), 311322. https://doi.org/10.1111/j.0272-4332.2004.00433.x.CrossRefGoogle ScholarPubMed
Smits, M (2006) Taming monsters: The cultural domestication of new technology. Technology in Society 28, 489504. https://doi.org/10.1016/j.techsoc.2006.09.008.CrossRefGoogle Scholar
Stein, S and Stein, JL (2013) Shallow versus deep uncertainties in natural hazard assessments. Eos, Transactions American Geophysical Union 94(14), 133134. https://doi.org/10.1002/2013EO140001.CrossRefGoogle Scholar
Turnhout, E, Hisschemöller, M and Eijsackers, H (2007) Ecological indicators: Between the two fires of science and policy. Ecological Indicators 7(2), 215228. https://doi.org/10.1016/j.ecolind.2005.12.003.CrossRefGoogle Scholar
Turnhout, E, Hisschemöller, M and Eijsackers, H (2008) Science in wadden sea policy: From accomodation to advocacy. Environmental Science & Policy 11(3), 227239. https://doi.org/10.1016/j.envsci.2007.07.004.CrossRefGoogle Scholar
US Army Corps of Engineers (2018 ) Floods and Nonstationarity: A Review. Technical report 2018-01. Available at https://usace.contentdm.oclc.org/digital/collection/p266001coll1/id/6036 (accessed 2 August 2023).Google Scholar
Van Asselt, MBA,Mesman, J and Van‘t Klooster, SA (2007) Dealing with prognostic uncertainty. Futures 39(6), 669684. https://doi.org/10.1016/j.futures.2006.11.011.CrossRefGoogle Scholar
Van der Bles, AM, Van der Linden, S, Freeman, ALJ, Mitchell, J, Galvao, AB, Zaval, L and Spiegelhalter, DJ (2019) Communicating uncertainty about facts, numbers and science. Royal Society Open Science 6(5), 181870. https://doi.org/10.1098/rsos.181870.CrossRefGoogle ScholarPubMed
Van der Sluijs, J (2005) Uncertainty as a monster in the science-policy interface: Four coping strategies. Water Science & Technology 52(6), 8792. https://doi.org/10.2166/wst.2005.0155.CrossRefGoogle ScholarPubMed
Vogel, RM, McMahon, TA and Francis, HSC (1993a) Floodflow frequency model selection in Australia. Journal of Hydrology 146, 421449. https://doi.org/10.1016/0022-1694(93)90288-K.CrossRefGoogle Scholar
Vogel, RM, Thomas, WO and McMahon, TA (1993b) Flood-flow frequency model selection in southwestern United States. Journal of Water Resources Planning and Management 119(3), 353366. https://doi.org/10.1061/(ASCE)0733-9496(1993)119:3(353).CrossRefGoogle Scholar
Wagener, T and Pianosi, F (2019 ) What has dlobal sensitivity analysis ever done for us? A systematic review to support scientific advancement and to inform policy-making in earth system modelling. Earth-Science Reviews 194, 118. https://doi.org/10.1016/j.earscirev.2019.04.006.Google Scholar
Westerberg, IK, Di Baldassarre, G, Beven, KJ, Coxon, G and Krueger, T (2017) Perceptual models of uncertainty for socio-hydrological systems: A flood risk change example. Hydrological Sciences Journal 62(11), 17051713. https://doi.org/10.1080/02626667.2017.1356926.CrossRefGoogle Scholar
Figure 0

Figure 1. Decision problems categorized into levels of complexity and structure, as well as strategies to cope with uncertainty.

Figure 1

Figure 2. Schematic of flood risk management (FRM) decision simulation by JBA Consulting (2022). Economic relationships for the scheme costs and flood damages are combined with models for the extreme value distribution of peak river flows and the hydraulic model outputs relating flows and flood depths. The choice between a stationary or a nonstationary flood peak model is represented as an epistemic uncertainty, as is the effect of artificially introducing errors to the gauged flows. Parameters of the peak flow model are sampled randomly in a Monte Carlo simulation to allow the epistemic uncertainties to be compared with aleatory uncertainty related to the sampling of the gauged flows.

Figure 2

Figure 3. Inputs to the flood risk management (FRM) decision simulation shown in Figure 2 as epistemic uncertainties. The curves are generalized logistic distributions, which are adopted as extreme value models for the peak flows. The choices available to the analyst are a stationary model fitted to gauged peak flows, a stationary model fitted after errors were added to the gauged flow data, and a nonstationary model fitted to gauged flows (evaluated for 2016, taken to be the year of the decision analysis).

Figure 3

Figure 4. Results of the flood risk management (FRM) decision simulation outlined in Figure 2, showing the economically optimum defense height, with uncertainties estimated by drawing 1,000 samples from the covariance matrices of generalized logistic distribution parameters fitted to the peak river flows. Panels show the results for different combinations of input factors. Comparison of panels (a) and (b) reveals epistemic uncertainty about the choice between a stationary and nonstationary model for the peak flows. Panel (c) simulates the effect of adding data errors to the stationary model for comparison. Plotted using R v4.2.0 boxplot function with default options: shaded boxes represent interquartile range (IQR), interior thick line is median, interior dot is mean, open circles are outliers and whiskers extend to a maximum of 1.5xIQR beyond the box (see function documentation for further details and Krzywinski and Altman, 2014 for interpretation).

Figure 4

Figure 5. Hydrograph of a simulated 150 years return-period design flood-event of High Beck, displaying discharge $ Q(t) $ versus time $ t $ with $ 5\% $ error bars indicated as dotted lines. The integrated discharge above the flooding threshold $ {Q}_T=0.245{\mathrm{m}}^3/\mathrm{s} $ constitutes the flood-excess volume, here $ FEV\approx 9600{\mathrm{m}}^3 $, causing the flood damage.

Figure 5

Figure 6. Square-lake cost-effectiveness graphs of five flood-mitigation scenarios to prevent High Beck surface flooding for the $ 1:50\mathrm{yr} $ design flood. These involve possible combinations of storage into canal ($ C1 $, purple), upstream bunds ($ B2 $, red) and/or downstream flood-plain storage ($ FP3 $, green). Base costs $ {q}_1,{q}_2,{q}_3 $ plus costs with uncertainty $ {p}_1{q}_{p_1},{p}_2{q}_{p_2},{p}_3{q}_{p_3} $ have been superimposed using the double-sided arrows. Each square lake with a lateral depth of 1 m (out of the page) and side lengths of 98 m represents the FEV ($ FEV\approx 9600{\mathrm{m}}^3\approx 98\mathrm{m}\times 98\mathrm{m}\times 1\mathrm{m} $) to be reduced to zero by the combinations of mitigation measures. The canal measure $ C1 $ can provide extra mitigation (as indicated) by diverting less flood water to the downstream fields, thus reducing $ FP3 $, and some to the canal $ C1 $. In those partial cases, uncertain costs may be lower. Diverting flood waters into the canal does not affect the upstream measure $ B2 $.

Author comment: How to cope with uncertainty monsters in flood risk management? — R0/PR1

Comments

Dear Madam, Sir,

We are happy to submit our manuscript entitled “How to cope with uncertainty monsters in flood risk management”. We look forward to you decision on publication. We added an Impact Statement. The LaTeX template nor the submission system do mention an Impact Statement, however. We now submitted it as a PDF with “title page” as designation, we hope that this is to your convenience.

On behalf of all authors, Martin Knotters

Review: How to cope with uncertainty monsters in flood risk management? — R0/PR2

Conflict of interest statement

Reviewer declares none.

Comments

This manuscript uses the monster metaphor to advance strategies to recognize and (if possible) statistically quantify multiple sources of uncertainty (both epistemic and aleatory) with the final goal to best inform the decision-making process. The topic is timely, as water-related disasters are increasingly complex and multifaceted. The paper is well written, and the flood risk example nicely illustrated the proposed strategies: exorcism, adaptation, assimilation and embracement, as well as denial and anaesthesia. Yet, I have a number of comments/suggestions that might help the authors improve the quality of the paper.

1. Key literature is well considered, but some elements are missing. In introducing and discussing the monsters, the paper would highly benefit from clarifying how they differ from/complement perceptual models of uncertainty. Beven (Recent advances in the modelling of hydrologic systems, 1991) describes them as qualitative (and evolving) summaries of our knowledge about a system and its complexities. It is important to note that Westerberg et al. (Hydrological Sciences Journal, 2017) developed a perceptual model of uncertainty with an example application to flood risk. Moreover, I also suggest looking at the work by Brown (Progress in Physical Geography, 2010) discussing how to openly treat uncertainty in environmental research.

2. The paper states that “The question is also what characteristics define “good”, i.e. decisions need to be rational, cost-effective/efficient, have minimum regret and maximum political support, etc.”. This is an important aspect, which I think to be not sufficiently discussed in the paper. In the planning and design of water infrastructure, we see often that what might be considered “rational” for addressing one specific problem (e.g. flood risk), might: a) generate new problems (e.g. losses of ecological functions; Auerswald et al., HESS, 2019); b) exacerbate the same problem in the long-term (e.g. unintended consequences, Gohari et al., Journal of Hydrology, 2013; levee effect, Di Baldassarre et al., HESS 2013; or safe-development paradox, Kates et al. PNAS 2006); and/or c) solve the problem only for some sectors (tourisms vs. agriculture) or social groups with uneven distribution of costs and benefits (Savelli et al., Journal of Hydrology, 2021). Clearly this is not the focus of this manuscript, but a critical paragraph about these potential issues in determining the temporal (and social) distribution of costs and benefits would enrich the paper.

3. Figures are informative, but their quality is sometimes suboptimal. This might be caused by PDF conversion, but I suggest to double check. Furthermore, some minor (if not trivial) suggestions about the figures: Fig. 1 Make sure the text has punctuation –e.g. missing a “.” after …qualitative and that the text is not partly covered by the graphic. Fig. 4 Need to add brackets before and after “m” –Design depth (m) –consistently with the other Figs 3 and 6. Fig. 5 squared brackets are used for the units, while Figs. 3 and 6 use round brackets –I suggest consistency.

Review: How to cope with uncertainty monsters in flood risk management? — R0/PR3

Conflict of interest statement

Not applicable.

Comments

The paper is well written and theoretically sound. It will prove very useful in flood risk management.

Recommendation: How to cope with uncertainty monsters in flood risk management? — R0/PR4

Comments

The manuscript creatively employs a monster metaphor to address the recognition and quantification of uncertainties in water-related disasters. However, there are few concerns with the present form of the manuscript. First, the paper could benefit from a clearer differentiation between the monster metaphor and perceptual models of uncertainty (see reviewers' comments). Secondly, improvements in figure quality could enhance the overall presentation. Address these specific points, incorporating additional insights provided by the reviewers.

Decision: How to cope with uncertainty monsters in flood risk management? — R0/PR5

Comments

No accompanying comment.

Author comment: How to cope with uncertainty monsters in flood risk management? — R1/PR6

Comments

Reponse to reviewers

We thank both reviewers for their constructive reviews. All changes in the revised manuscript have been highlighted in red-coloured text, for ease of continued review. A point-by-point discussion thereon follows below.

Reviewer: 1

Comments to the Author

This manuscript uses the monster metaphor to advance strategies to recognize and (if possible) statistically quantify multiple sources of uncertainty (both epistemic and aleatory) with the final goal to best inform the decision-making process. The topic is timely, as water-related disasters are increasingly complex and multifaceted. The paper is well written, and the flood risk example nicely illustrated the proposed strategies: exorcism, adaptation, assimilation and embracement, as well as denial and anaesthesia. Yet, I have a number of comments/suggestions that might help the authors improve the quality of the paper.

Reply:

Thank for your comments and thorough review. Below you will find our point-by-point response.

1. Key literature is well considered, but some elements are missing. In introducing and discussing the monsters, the paper would highly benefit from clarifying how they differ from/complement perceptual models of uncertainty. Beven (Recent advances in the modelling of hydrologic systems, 1991) describes them as qualitative (and evolving) summaries of our knowledge about a system and its complexities. It is important to note that Westerberg et al. (Hydrological Sciences Journal, 2017) developed a perceptual model of uncertainty with an example application to flood risk. Moreover, I also suggest looking at the work by Brown (Progress in Physical Geography, 2010) discussing how to openly treat uncertainty in environmental research.

Reply:

• The references to the work of Beven (1991) and Westerberg et al. (2017) appeared to be very useful and were incorporated in the end of the first paragraph of “5. Preferred coping strategies: monster adaptation and monster assimilation”:

"Monster adaptation is possible if uncertainties can be quantified, i.e. bounded

uncertainties with all probabilities known (Brown 2010). If some or all uncertainties

can be described qualitatively only, we prefer monster assimilation as a coping strategy in decision making. The perceptual model of uncertainty as described by Westerberg et al. (2017) can be helpful in monster adaptation and assimilation. Westerberg et al. (2017) illustrated the three-step procedure to construct a perceptual uncertainty model with an example on flood risk change. The three steps include (1) identifying uncertainty in the framing of the studied system and problem, (2) identifying the uncertainty sources in the socio-hydrological system, and (3) defining the nature, interactions and relative importance of the uncertainty sources."

• Westerberg et al. (2017) pointed our attention to a discussion on the distinction between aleatory and epistemic uncertainty in Nearing et al. (2016), which we found relevant to include in the second paragraph of “1. Origins and guises of uncertainty monsters”:

“ However, aleatory and epistemic uncertainty can be blurred, e.g. Nearing et al. (2016) argue that most aleatory uncertainty at the scale of watersheds is also epistemic.”

• Besides this, Westerberg et al. (2017) brought our attention to the work of Brown (2004) about uncertainty as a state of confidence in knowledge, and to Merz et al., 2015) regarding surprises. We included these references in the second paragraph of “1. Origins and guises of uncertainty monsters” and added a third paragraph un uncertainty as a state of confidence in knowledge:

"... or surprises (Brown 2004; Merz et al. 2015).

Brown (2004) defines uncertainty as a state of confidence in knowledge, varying

between being certain and accepting that we cannot know, i.e. indeterminacy. In this

definition confidence is a state of awareness of imperfect knowledge. Ignorance is defined as lack of awareness of imperfect knowledge. Further, Brown (2004) distinguishes “bounded” and “unbounded” uncertainty. “Bounded” means that all possible outcomes are known, but not necessarily all corresponding probabilities. Uncertainty is “unbounded” when some possible outcomes are known, possibly with corresponding probabilities, or no possible outcomes are known."

2. The paper states that “The question is also what characteristics define “good”, i.e. decisions need to be rational, cost-effective/efficient, have minimum regret and maximum political support, etc.”. This is an important aspect, which I think to be not sufficiently discussed in the paper. In the planning and design of water infrastructure, we see often that what might be considered “rational” for addressing one specific problem (e.g. flood risk), might: a) generate new problems (e.g. losses of ecological functions; Auerswald et al., HESS, 2019); b) exacerbate the same problem in the long-term (e.g. unintended consequences, Gohari et al., Journal of Hydrology, 2013; levee effect, Di Baldassarre et al., HESS 2013; or safe-development paradox, Kates et al. PNAS 2006); and/or c) solve the problem only for some sectors (tourisms vs. agriculture) or social groups with uneven distribution of costs and benefits (Savelli et al., Journal of Hydrology, 2021). Clearly this is not the focus of this manuscript, but a critical paragraph about these potential issues in determining the temporal (and social) distribution of costs and benefits would enrich the paper.

Reply:

We suggested and have included the following paragraph in the revised text, in which we ask for permission to use the comments of the reviewer as a starting point. See also the acknowledgement.

“The importance of what could characterise and qualify a “good decision” in FRM can be illustrated by considering what can cause suboptimal decisions. Addressing only one dimension of flood-mitigation problems, albeit rationally, may adversely affect other aspects in that the chosen solution taken:

a) may lead to new problems (e.g. loss of ecological functions) (Auerswald et al., 2019);

b) has unintended long-term consequences (e.g. a dependence on higher flood-defence walls to contain river levels for 1-in-200yrs protection in a narrow channel could lead to a false sense of security, especially as return periods reduce due to climate change, causing future overtopping or breaches) (Gohari et al., 2013; Di Baldassarre et al., 2013a,b; Kates et al., 2006); and,

c) has an uneven distribution of costs and benefits when other sectors and social groups are taken into account (e.g. if optimism bias about the extrapolation of NFM benefits were to cause reduced investment in other, more predictable, flood risk mitigations for vulnerable communities) (Savelli et al., 2021).

Morgan and Henrion (1990) comprehensively discuss decision-taking criteria in their section 3.4. In a nutshell, which does insufficient justice to their writing: they distinguish utility-based, rights-based, technology-based and hybrid criteria. In particular, maximisation of a multi-attribute utility function would address the points above. Various relevant aspects are then brought together in one utility function, without assigning monetary values to relevant aspects. While that sounds simple, an apparent drawback can be that the as-such defined function often becomes complex and difficult to understand for the decision-makers. Transparency thereon and on the general decision-process can be achieved by defining the relevant decision-criteria and associated functionality at the beginning of the process with all relevant actors, including communication experts, in order to clearly define and accept the chosen criteria. Moreover, also in FRM, it is important to make the decision-process adaptive such that it can be revisited in the future, when new technology, observational data and information become available. Most organisations might find it difficult to adopt such adaptivity, but it should be adopted as long as the process is primarily geared to focus on improved decision-making and not on assigning blame for taking past wrong or suboptimal decisions. Finally, Morgan and Henrion discuss an ``approved process’’ as decision criterion and declare that to be a widely-used approach, in which a decision is considered acceptable when a specified set of procedures is followed. They point out that the language of decision analysis is inappropriate for such a social as opposed to analysis-based process.”

3. Figures are informative, but their quality is sometimes suboptimal. This might be caused by PDF conversion, but I suggest to double check. Furthermore, some minor (if not trivial) suggestions about the figures: Fig. 1 Make sure the text has punctuation –e.g. missing a “.” after …qualitative and that the text is not partly covered by the graphic. Fig. 4 Need to add brackets before and after “m” –Design depth (m) –consistently with the other Figs 3 and 6. Fig. 5 squared brackets are used for the units, while Figs. 3 and 6 use round brackets –I suggest consistency.

Reply:

• Thank you for these astute observations. We have used round brackets throughout.

• The requested punctuation has been added to the texts in Figure 1. Furthermore, we further improved Figure 1 by adding a textbox in the right upper part (a simple decision problem, but poorly structured). We added a brief explanation about what we consider as “structure” in this context to the first paragraph of “4. Levels of complexity and structure in decision making”.

Reviewer: 2

Comments to the Author

The paper is well written and theoretically sound. It will prove very useful in flood risk management.

Reply: Thank you for your review and comment.

Review: How to cope with uncertainty monsters in flood risk management? — R1/PR7

Conflict of interest statement

Reviewer declares none.

Comments

All comments were carefully addressed.

Recommendation: How to cope with uncertainty monsters in flood risk management? — R1/PR8

Comments

The authors have addressed all the review comments. The paper may be accepted now.

Decision: How to cope with uncertainty monsters in flood risk management? — R1/PR9

Comments

No accompanying comment.