Skip to content

Psychometric Analysis of Forensic Examiner Behavior

Journal: Journal Behaviormetrika
Published: 2019
Primary Author: Amanda Luby
Secondary Authors: Anjali Mazumder, Brian Junker

Forensic science often involves the comparison of crime-scene evidence to a known-source sample to determine if the evidence and the reference sample came from the same source. Even as forensic analysis tools become increasingly objective and automated, final source identifications are often left to individual examiners’ interpretation of the evidence. Each source identification relies on judgements about the features and quality of the crime-scene evidence that may vary from one examiner to the next. The current approach to characterizing uncertainty in examiners’ decision-making has largely centered around the calculation of error rates aggregated across examiners and identification tasks, without taking into account these variations in behavior. We propose a new approach using IRT and IRT-like models to account for differences among examiners and additionally account for the varying difficulty among source identification tasks. In particular, we survey some recent advances (Luby 2019a) in the application of Bayesian psychometric models, including simple Rasch models as well as more elaborate decision tree models, to fingerprint examiner behavior.

Related Resources

Juror appraisals of forensic evidence: Effects of blind proficiency and cross-examination

Juror appraisals of forensic evidence: Effects of blind proficiency and cross-examination

Forensic testimony plays a crucial role in many criminal cases, with requests to crime laboratories steadily increasing. As part of efforts to improve the reliability of forensic evidence, scientific and…
Mock Jurors’ Evaluation of Firearm Examiner Testimony

Mock Jurors’ Evaluation of Firearm Examiner Testimony

Objectives: Firearms experts traditionally have testified that a weapon leaves “unique” toolmarks, so bullets or cartridge casings can be visually examined and conclusively matched to a particular firearm. Recently, due…
Mock Juror Perceptions of Forensics

Mock Juror Perceptions of Forensics

This CSAFE Center Wide webinar was presented on December 8, 2020 by: Brandon Garrett – L. Neil Williams Professor of Law, Faculty Director at the Wilson Center for Science and…
A Pioneer in Forensic Science Reform: The Work of Paul Giannelli

A Pioneer in Forensic Science Reform: The Work of Paul Giannelli

Few can say, “I told you so,” to our entire criminal justice system. Being right about what is wrong with the use of evidence in criminal cases is not a…