Skip to content

Studying Reproducibility and Repeatability for Pattern Evidence Comparisons

Conference/Workshop:
International Association for Identification (IAI)
Published: 2022
Primary Author: Hina Arora
Secondary Authors: Naomi Kaplan-Damary and Hal Stern

The forensics community has recently conducted black-box studies to establish the accuracy and reliability of subjective forensic examination decisions. We have developed a statistical framework to assess the reliability of such subjective decisions that may be on different scales, for example, binary (match/ non-match) or ordered categories. Our methodology also enables inference for interactions between examiners and forensic samples. We also extend our approach to identify groups of examiners that might share decision making abilities or thresholds for decisions for the purpose of understanding reliability within these subgroups.

Related Resources

The q–q Boxplot

The q–q Boxplot

Boxplots have become an extremely popular display of distribution summaries for collections of data, especially when we need to visualize summaries for several collections simultaneously. The whiskers in the boxplot…
A Study in Reproducibility: The Congruent Matching Cells Algorithm and cmcR Package

A Study in Reproducibility: The Congruent Matching Cells Algorithm and cmcR Package

Scientific research is driven by our ability to use methods, procedures, and materials from previous studies and further research by adding to it. As the need for computationally-intensive methods to…
Forensic Science in Legal Education

Forensic Science in Legal Education

In criminal cases, forensic science reports and expert testimony play an increasingly important role in adjudication. More states now follow a federal reliability standard, following Daubert v. Merrell Dow Pharmaceuticals…
The Contribution of Forensic and Expert Evidence to DNA Exoneration Cases: An Interim Report

The Contribution of Forensic and Expert Evidence to DNA Exoneration Cases: An Interim Report

This report is from Simon A. Cole, Vanessa Meterko, Sarah Chu, Glinda Cooper, Jessica Weinstock Paredes, Maurice Possley, and Ken Otterbourg (2022), The Contribution of Forensic and Expert Evidence to…