Forensic science often involves the comparison of crime-scene evidence to a known-source sample to determine if the evidence and the reference sample came from the same source. Even as forensic analysis tools become increasingly objective and automated, final source identifications are often left to individual examiners’ interpretation of the evidence. Each source identification relies on judgements about the features and quality of the crime-scene evidence that may vary from one examiner to the next. The current approach to characterizing uncertainty in examiners’ decision-making has largely centered around the calculation of error rates aggregated across examiners and identification tasks, without taking into account these variations in behavior. We propose a new approach using IRT and IRT-like models to account for differences among examiners and additionally account for the varying difficulty among source identification tasks. In particular, we survey some recent advances (Luby 2019a) in the application of Bayesian psychometric models, including simple Rasch models as well as more elaborate decision tree models, to fingerprint examiner behavior.
Psychometric analysis of forensic examiner behavior

Journal: Behaviormetrika
Published: 2020
Primary Author: Amanda Luby
Secondary Authors: Anjali Mazumber, Brian Junker
Type: Publication
Research Area: Latent Print
Related Resources
Does image editing improve the quality of latent prints? An analysis of image-editing techniques in one crime laboratory
Field research within latent print comparison has remained sparse in the context of an otherwise growing body of literature examining the discipline. Studies examining how ACE-V procedures are implemented within…
Modeling Covarying Responses in Complex Tasks
In testing situations, participants are often asked for supplementary re- sponses in addition to the primary response of interest, which may in- clude quantities like confidence or reported difficulty. These…
Analyzing spatial responses: A comparison of IRT- based approaches, Conference Presentation
We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse…
Characterizing Variability in Forensic Decision-Making with Item Response Theory
This presentation is from the 2022 Joint Statistical Meetings