Skip to content

Modeling Covarying Responses in Complex Tasks

Conference/Workshop:
Quantitative Psychology: The 86th Annual International Meeting of the Psychometric Society
Published: 2022
Primary Author: Amanda Luby
Research Area: Latent Print

In testing situations, participants are often asked for supplementary re- sponses in addition to the primary response of interest, which may in- clude quantities like confidence or reported difficulty. These additional responses can be incorporated into a psychometric model either as a predictor of the main response or as a secondary response. In this paper we explore both of these approaches for incorporating participant’s re- ported difficulty into a psychometric model using an error rate study of fingerprint examiners. Participants were asked to analyze print pairs and make determinations about the source, which can be scored as correct or incorrect decisions. Additionally, participants were asked to report the difficulty of the print pair on a five point scale. In this paper, we model (a) the responses of individual examiners without incorporating reported difficulty using a Rasch model, (b) the responses using their reported dif- ficulty as a predictor, and (c) the responses and their reported difficulty as a multivariate response variable. We find that approach (c) results in more balanced classification errors, but incorporating reported difficulty using either approach does not lead to substantive changes in proficiency or difficulty estimates. These results suggest that, while there are indi- vidual differences in reported difficulty, these differences appear to be unrelated to examiners’ proficiency in correctly distinguishing matched from non-matched fingerprints.

Related Resources

Does image editing improve the quality of latent prints? An analysis of image-editing techniques in one crime laboratory

Does image editing improve the quality of latent prints? An analysis of image-editing techniques in one crime laboratory

Field research within latent print comparison has remained sparse in the context of an otherwise growing body of literature examining the discipline. Studies examining how ACE-V procedures are implemented within…
Analyzing spatial responses: A comparison of IRT- based approaches, Conference Presentation

Analyzing spatial responses: A comparison of IRT- based approaches, Conference Presentation

We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse…
Measuring Proficiency among Latent Print Examiners: A Statistical Approach from Standardized Testing

Measuring Proficiency among Latent Print Examiners: A Statistical Approach from Standardized Testing

This presentation is from the 74th Annual Scientific Conference of the American Academy of Forensic Sciences