We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse matrix using the spatial information and then apply standard IRT techniques to estimate proficiency and item parameters. In the second approach, we introduce the Spatial Error Model and use the spatial coordinates directly to infer information about the true locations and participant precision. As a motivating example, we use a study from forensic science designed to measure how fingerprint examiners use minutiae (small details in the fingerprint that form the basis for uniqueness) to come to an identification decision. The study found substantial participant variability, as different participants tend to focus on different areas of the image and some participants mark more minutiae than others. Using simulated data, we illustrate the relative strengths and weaknesses of each modeling approach, and demonstrate the advantages of modeling the spatial coordinates directly in the Spatial Error Model.
Analyzing spatial responses: A comparison of IRT- based approaches
Conference/Workshop:
Annual Meeting of the Psychometric Society
Annual Meeting of the Psychometric Society
Journal: Springer Proceedings in Mathematics & Statistics
Published: 2023
Primary Author: Amanda Luby
Secondary Authors: Thomas Daillak, Sherry Huang
Type: Publication
Related Resources
Source Camera Identification with Multi-Camera Smartphones
An overview of source camera identification on multi-camera smartphones, and introduction to the new CSAFE multi-camera smartphone image database, and a summary of recent results on the iPhone 14 Pro’s.
What’s in a Name? Consistency in Latent Print Examiners’ Naming Conventions and Perceptions of Minutiae Frequency
Fingerprint minutia types influence LPEs’ decision-making processes during analysis and evaluation, with features perceived to be rarer generally given more weight. However, no large-scale studies comparing examiner perceptions of minutiae…
An alternative statistical framework for measuring proficiency
Item Response Theory, a class of statistical methods used prominently in educational testing, can be used to measure LPE proficiency in annual tests or research studies, while simultaneously accounting for…
Examiner variability in pattern evidence: proficiency, inconclusive tendency, and reporting styles
The current approach to characterizing uncertainty in pattern evidence disciplines has focused on error rate studies, which provide aggregated error rates over many examiners and pieces of evidence. However, decisions…