Skip to content

Proficiency Testing of Forensic Fingerprint Examiners with Bayesian Item Response Theory

Journal: Law, Probability and Risk
Published: 2018
Primary Author: Amanda S. Luby
Secondary Authors: Joseph B. Kadane
Research Area: Latent Print

In recent years, the forensic community has pushed to increase the scientific basis of forensic evidence, which has included proficiency testing for fingerprint analysts. We used proficiency testing data collected by Collaborative Testing Services in which 431 fingerprint analysts were asked to identify the source of latent prints. The data were analysed using a Rasch model with a Bayesian estimation approach. Although these data provide valuable information about the relative proficiency of the examiners and the relative difficulty of the questions, it does not necessarily extrapolate onto general performance of examiners or difficulty in casework, which we show through sensitivity analysis and simulation. We show that a Bayesian Item Response Theory (IRT) analysis provides a deeper understanding of analysts’ proficiency and question difficulty than other forms of analysis. A large-scale adoption of IRT in this area would provide both more precise estimates of proficiency and quantitative evidence for the relative difficulty of different questions.

Related Resources

CSAFE 2021 Field Update

CSAFE 2021 Field Update

The 2021 Field Update was held June 14, 2021, and served as the closing to the first year of CSAFE 2.0. CSAFE brought together researchers, forensic science partners and interested…
Mt. Everest—we are going to lose many: a survey of fingerprint examiners’ attitudes towards probabilistic reporting

Mt. Everest—we are going to lose many: a survey of fingerprint examiners’ attitudes towards probabilistic reporting

Over the past decade, with increasing scientific scrutiny on forensic reporting practices, there have been several efforts to introduce statistical thinking and probabilistic reasoning into forensic practice. These efforts have…
IRT for Forensics

IRT for Forensics

This CSAFE webinar was held on April 8, 2021. Presenter: Amanda Luby Assistant Professor of Statistics, Swarthmore College Presentation Description: In this webinar, Amanda Luby explored how Item Response Theory…
Latent print comparison and examiner conclusions: A field analysis of case processing in one crime laboratory

Latent print comparison and examiner conclusions: A field analysis of case processing in one crime laboratory

Scholarship on the latent print comparison process has expanded in recent years, responsive to the call for rigorous research by scholarly groups (e.g., National Academy of Sciences, 2009; President’s Council…