In a fascinating exploration into the minds of pilots, a recent study has unearthed that the outcomes of past decisions, whether good or bad, significantly sway how pilots evaluate the quality of those decisions. This phenomenon, known as outcome bias, was observed across various simulated flight scenarios, revealing that even experienced pilots are more likely to judge a decision negatively if it leads to a poor result, regardless of the decision-making process itself.
The findings, published in Applied Cognitive Psychology, underscore the complex nature of human judgment and highlight the need for aviation training programs to address cognitive biases more thoroughly.
Why embark on this study? The motivation is rooted in the critical nature of aviation decisions. While pilots often rely on standardized procedures, checklists, and operating manuals for decision-making, they also face scenarios that demand rapid judgment calls in the absence of complete information and under the pressure of several competing alternatives. This type of decision-making is inherently more complex and fraught with the potential for error.
Previous research has highlighted that a significant portion of aviation accidents are due to human error, with a considerable number of these errors tied to decision-making under pressure. Given these stakes, the researchers aimed to delve deeper into the cognitive processes underpinning pilot decision-making, particularly the role of outcome bias — a psychological phenomenon where the results of a decision influence how we view the quality of that decision in hindsight.
The researchers recruited 60 pilots who were qualified to fly under instrument flight rules (IFR), dividing them into two categories based on their experience. Expertise was determined by the number of hours each pilot had logged as pilot-in-command (PIC), with those accumulating more than 2,000 hours classified as experts, and those with fewer as novices.
Participants were presented with four carefully crafted scenarios through an online survey. These scenarios simulated real-world decisions pilots might face while flying under IFR. The scenarios were developed with input from seasoned pilots to ensure realism and relevance. Each scenario concluded with either a positive or negative outcome, designed to test the impact of outcome knowledge on the pilots’ evaluations.
The scenarios were as follows:
- A flight with minimum fuel expecting clear weather, which either lands safely or requires a go-around due to unanticipated bad weather.
- A decision to fly above clouds to save fuel, leading either to an uneventful flight or ice crystal icing causing technical issues.
- Continuing an approach despite a red cell (heavy rain) on the weather radar, which ends either with a safe landing or a downdraft necessitating a windshear escape maneuver.
- Landing in freezing rain with no reported braking action value, resulting in either a safe stop or an overshoot of the runway.
Participants rated each scenario on three aspects: the decision’s quality, the perceived risk, and their likelihood of making the same decision.
The study’s findings revealed a significant presence of outcome bias across all measures. Decisions that led to positive outcomes were rated more favorably in terms of decision quality, perceived risk, and the likelihood of making the same choice, compared to those with negative outcomes. This trend persisted regardless of the pilots’ experience, indicating that both novices and experts were equally influenced by the outcomes when evaluating past decisions.
These findings underscore the significant role of outcome bias in the decision-making processes of pilots, challenging the assumption that experience alone can mitigate the influence of cognitive biases.
The study’s insights into how pilots evaluate past decisions based on outcomes rather than the information available at the time have important implications for aviation safety and training. By recognizing the impact of outcome bias, training programs can be better designed to address these cognitive biases, potentially leading to improved decision-making processes and enhancing overall flight safety.
The findings open up several avenues for future research. There’s a need to explore other cognitive heuristics that pilots may rely on during decision-making and to investigate whether these biases affect judgment in real-life flight situations as strongly as they do in simulated scenarios. Moreover, comparing the decision-making processes in aviation with those in other high-stakes fields, like medicine, could offer deeper insights into how professionals manage risk and uncertainty.
The study, “All’s well that ends well? Outcome bias in pilots during instrument flight rules“, was authored by Ana P. G. Martins, Moritz V. Köbrich, Nils Carstengerdes, and Marcus Biella.