The forensics community has recently conducted black-box studies to establish the accuracy and reliability of subjective forensic examination decisions. We have developed a statistical framework to assess the reliability of such subjective decisions that may be on different scales, for example, binary (match/ non-match) or ordered categories. Our methodology also enables inference for interactions between examiners and forensic samples. We also extend our approach to identify groups of examiners that might share decision making abilities or thresholds for decisions for the purpose of understanding reliability within these subgroups.
Studying Reproducibility and Repeatability for Pattern Evidence Comparisons

Conference/Workshop:
International Association for Identification (IAI)
International Association for Identification (IAI)
Published: 2022
Primary Author: Hina Arora
Secondary Authors: Naomi Kaplan-Damary and Hal Stern
Type: Presentation Slides
Related Resources
Towards a likelihood ratio approach for bloodstain pattern analysis
In this work, we explore the application of likelihood ratio as a forensic evidence assessment tool to evaluate the causal mechanism of a bloodstain pattern. It is assumed that there…
Does image editing improve the quality of latent prints? An analysis of image-editing techniques in one crime laboratory
Field research within latent print comparison has remained sparse in the context of an otherwise growing body of literature examining the discipline. Studies examining how ACE-V procedures are implemented within…
An Open-Source Implementation of the CMPS Algorithm for Assessing Similarity of Bullets
In this paper, we introduce the R package cmpsR, an open-source implementation of the Congruent Matching Profile Segments (CMPS) method developed at the National Institute of Standards and Technology (NIST)…
A Data-Driven Approach to Model the Generation Process of Bloodstain Patterns
This poster was presented at the 106th International Association for Identification