The forensics community has recently conducted black-box studies to establish the accuracy and reliability of subjective forensic examination decisions. We have developed a statistical framework to assess the reliability of such subjective decisions that may be on different scales, for example, binary (match/ non-match) or ordered categories. Our methodology also enables inference for interactions between examiners and forensic samples. We also extend our approach to identify groups of examiners that might share decision making abilities or thresholds for decisions for the purpose of understanding reliability within these subgroups.
Studying Reproducibility and Repeatability for Pattern Evidence Comparisons

Conference/Workshop:
International Association for Identification (IAI)
International Association for Identification (IAI)
Published: 2022
Primary Author: Hina Arora
Secondary Authors: Naomi Kaplan-Damary and Hal Stern
Type: Presentation Slides
Related Resources
The q–q Boxplot
Boxplots have become an extremely popular display of distribution summaries for collections of data, especially when we need to visualize summaries for several collections simultaneously. The whiskers in the boxplot…
A Study in Reproducibility: The Congruent Matching Cells Algorithm and cmcR Package
Scientific research is driven by our ability to use methods, procedures, and materials from previous studies and further research by adding to it. As the need for computationally-intensive methods to…
Forensic Science in Legal Education
In criminal cases, forensic science reports and expert testimony play an increasingly important role in adjudication. More states now follow a federal reliability standard, following Daubert v. Merrell Dow Pharmaceuticals…
The Contribution of Forensic and Expert Evidence to DNA Exoneration Cases: An Interim Report
This report is from Simon A. Cole, Vanessa Meterko, Sarah Chu, Glinda Cooper, Jessica Weinstock Paredes, Maurice Possley, and Ken Otterbourg (2022), The Contribution of Forensic and Expert Evidence to…