Skip to content

Proficiency Testing of Forensic Fingerprint Examiners with Bayesian Item Response Theory

Journal: Law, Probability and Risk
Published: 2018
Primary Author: Amanda S. Luby
Secondary Authors: Joseph B. Kadane
Research Area: Latent Print

In recent years, the forensic community has pushed to increase the scientific basis of forensic evidence, which has included proficiency testing for fingerprint analysts. We used proficiency testing data collected by Collaborative Testing Services in which 431 fingerprint analysts were asked to identify the source of latent prints. The data were analysed using a Rasch model with a Bayesian estimation approach. Although these data provide valuable information about the relative proficiency of the examiners and the relative difficulty of the questions, it does not necessarily extrapolate onto general performance of examiners or difficulty in casework, which we show through sensitivity analysis and simulation. We show that a Bayesian Item Response Theory (IRT) analysis provides a deeper understanding of analysts’ proficiency and question difficulty than other forms of analysis. A large-scale adoption of IRT in this area would provide both more precise estimates of proficiency and quantitative evidence for the relative difficulty of different questions.

Related Resources

Implementation of a Blind Quality Control Program in a Forensic Laboratory

Implementation of a Blind Quality Control Program in a Forensic Laboratory

A blind quality control (QC) program was successfully developed and implemented in the Toxicology, Seized Drugs, Firearms, Latent Prints (Processing and Comparison), Forensic Biology, and Multimedia (Digital and Audio/Video) sections…
CSAFE 2020 All Hands Meeting

CSAFE 2020 All Hands Meeting

The 2020 All Hands Meeting was held May 12 and 13, 2020 and served as the closing to the last 5 years of CSAFE research and focused on kicking off…
How do latent print examiners perceive proficiency testing? An analysis of examiner perceptions, performance, and print quality

How do latent print examiners perceive proficiency testing? An analysis of examiner perceptions, performance, and print quality

Proficiency testing has the potential to serve several important purposes for crime laboratories and forensic science disciplines. Scholars and other stakeholders, however, have criticized standard proficiency testing procedures since their…
Crime Lab Proficiency Testing and Quality Management

Crime Lab Proficiency Testing and Quality Management

In the wake of recent reports documenting the vulnerability of forensic science methodologies to human error (e.g., NAS, 2009; PCAST, 2016), the field has sometimes pointed to proficiency testing as…
Do you have 44.03 seconds?

44.3 Seconds. That is the average amount of time it takes for a visitor to provide site feedback.
Test it yourself by taking the survey.


A scientist/researcherA member of the forensic science communityA journalist/publicationA studentOther. Please indicate.


Learn more about CSAFE overall.Discover research CSAFE is undertaking.Explore collaboration opportunities.Find tools and education opportunities.Other. Please indicate.


YesNo