We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse matrix using the spatial information and then apply standard IRT techniques to estimate proficiency and item parameters. In the second approach, we introduce the Spatial Error Model and use the spatial coordinates directly to infer information about the true locations and participant precision. As a motivating example, we use a study from forensic science designed to measure how fingerprint examiners use minutiae (small details in the fingerprint that form the basis for uniqueness) to come to an identification decision. The study found substantial participant variability, as different participants tend to focus on different areas of the image and some participants mark more minutiae than others. Using simulated data, we illustrate the relative strengths and weaknesses of each modeling approach, and demonstrate the advantages of modeling the spatial coordinates directly in the Spatial Error Model.
Analyzing spatial responses: A comparison of IRT- based approaches, Conference Presentation

Conference/Workshop:
International Meeting of the Psychometric Society (IMPS)
International Meeting of the Psychometric Society (IMPS)
Published: 2022
Primary Author: Amanda Luby
Type: Presentation Slides
Research Area: Latent Print
Related Resources
Does image editing improve the quality of latent prints? An analysis of image-editing techniques in one crime laboratory
Field research within latent print comparison has remained sparse in the context of an otherwise growing body of literature examining the discipline. Studies examining how ACE-V procedures are implemented within…
Modeling Covarying Responses in Complex Tasks
In testing situations, participants are often asked for supplementary re- sponses in addition to the primary response of interest, which may in- clude quantities like confidence or reported difficulty. These…
Characterizing Variability in Forensic Decision-Making with Item Response Theory
This presentation is from the 2022 Joint Statistical Meetings
Measuring Proficiency among Latent Print Examiners: A Statistical Approach from Standardized Testing
This presentation is from the 74th Annual Scientific Conference of the American Academy of Forensic Sciences