Skip to content

Psychometric analysis of forensic examiner behavior

Journal: Behaviormetrika
Published: 2020
Primary Author: Amanda Luby
Secondary Authors: Anjali Mazumber, Brian Junker
Research Area: Latent Print

Forensic science often involves the comparison of crime-scene evidence to a known-source sample to determine if the evidence and the reference sample came from the same source. Even as forensic analysis tools become increasingly objective and automated, final source identifications are often left to individual examiners’ interpretation of the evidence. Each source identification relies on judgements about the features and quality of the crime-scene evidence that may vary from one examiner to the next. The current approach to characterizing uncertainty in examiners’ decision-making has largely centered around the calculation of error rates aggregated across examiners and identification tasks, without taking into account these variations in behavior. We propose a new approach using IRT and IRT-like models to account for differences among examiners and additionally account for the varying difficulty among source identification tasks. In particular, we survey some recent advances (Luby 2019a) in the application of Bayesian psychometric models, including simple Rasch models as well as more elaborate decision tree models, to fingerprint examiner behavior.

Related Resources

Implementing blind proficiency testing in forensic laboratories: Motivation, obstacles, and recommendations

Implementing blind proficiency testing in forensic laboratories: Motivation, obstacles, and recommendations

Regular proficiency testing of forensic examiners is required at accredited laboratories and widely accepted as an important component of a functioning quality assurance program. Yet, unlike in other testing industries,…
Implementation of a Blind Quality Control Program in a Forensic Laboratory

Implementation of a Blind Quality Control Program in a Forensic Laboratory

A blind quality control (QC) program was successfully developed and implemented in the Toxicology, Seized Drugs, Firearms, Latent Prints (Processing and Comparison), Forensic Biology, and Multimedia (Digital and Audio/Video) sections…
CSAFE 2020 All Hands Meeting

CSAFE 2020 All Hands Meeting

The 2020 All Hands Meeting was held May 12 and 13, 2020 and served as the closing to the last 5 years of CSAFE research and focused on kicking off…
How do latent print examiners perceive proficiency testing? An analysis of examiner perceptions, performance, and print quality

How do latent print examiners perceive proficiency testing? An analysis of examiner perceptions, performance, and print quality

Proficiency testing has the potential to serve several important purposes for crime laboratories and forensic science disciplines. Scholars and other stakeholders, however, have criticized standard proficiency testing procedures since their…