Skip to content

Shifting decision thresholds can undermine the probative value and legal utility of forensic pattern-matching evidence

Journal: Proceedings of the National Academy of Sciences
Published: 2023
Primary Author: William Thompson

Forensic pattern analysis requires examiners to compare the patterns of items such as fingerprints or tool marks to assess whether they have a common source. This article uses signal detection theory to model examiners’ reported conclusions (e.g., identification, inconclusive, or exclusion), focusing on the connection between the examiner’s decision threshold and the probative value of the forensic evidence. It uses a Bayesian network model to explore how shifts in decision thresholds may affect rates and ratios of true and false convictions in a hypothetical legal system. It demonstrates that small shifts in decision thresholds, which may arise from contextual bias, can dramatically affect the value of forensic pattern-matching evidence and its utility in the legal system.

Related Resources

Score-based Likelihood Ratios Using Stylometric Text Embeddings

Score-based Likelihood Ratios Using Stylometric Text Embeddings

We consider the problem setting in which we have two sets of texts in digital form and would like to quantify our beliefs that the two sets of texts were…
How do Labs Ensure Quality? A Nationwide Review of SOPs for Latent Print Examination

How do Labs Ensure Quality? A Nationwide Review of SOPs for Latent Print Examination

This presentation is from the 108th International Association for Identification (IAI) Annual Educational Conference, Reno, Nevada, August 11-17, 2024. Posted with permission of CSAFE.
Statistics and its Applications in Forensic Science and the Criminal Justice System

Statistics and its Applications in Forensic Science and the Criminal Justice System

This presentation is from the 2024 Joint Statistical Meetings (JSM), Portland, Oregon, August 3-8, 2024.
Algorithmic matching of striated tool marks

Algorithmic matching of striated tool marks

Automatic matching algorithms for assessing the similarity between striation marks have been investigated for bullet lands and some tool marks, such as screwdrivers. We are interested in the investigation of…