Skip to content

Analyzing spatial responses: A comparison of IRT- based approaches

Conference/Workshop:
Annual Meeting of the Psychometric Society
Journal: Springer Proceedings in Mathematics & Statistics
Published: 2023
Primary Author: Amanda Luby
Secondary Authors: Thomas Daillak, Sherry Huang

We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse matrix using the spatial information and then apply standard IRT techniques to estimate proficiency and item parameters. In the second approach, we introduce the Spatial Error Model and use the spatial coordinates directly to infer information about the true locations and participant precision. As a motivating example, we use a study from forensic science designed to measure how fingerprint examiners use minutiae (small details in the fingerprint that form the basis for uniqueness) to come to an identification decision. The study found substantial participant variability, as different participants tend to focus on different areas of the image and some participants mark more minutiae than others. Using simulated data, we illustrate the relative strengths and weaknesses of each modeling approach, and demonstrate the advantages of modeling the spatial coordinates directly in the Spatial Error Model.

Related Resources

Score-based Likelihood Ratios Using Stylometric Text Embeddings

Score-based Likelihood Ratios Using Stylometric Text Embeddings

We consider the problem setting in which we have two sets of texts in digital form and would like to quantify our beliefs that the two sets of texts were…
How do Labs Ensure Quality? A Nationwide Review of SOPs for Latent Print Examination

How do Labs Ensure Quality? A Nationwide Review of SOPs for Latent Print Examination

This presentation is from the 108th International Association for Identification (IAI) Annual Educational Conference, Reno, Nevada, August 11-17, 2024. Posted with permission of CSAFE.
Statistics and its Applications in Forensic Science and the Criminal Justice System

Statistics and its Applications in Forensic Science and the Criminal Justice System

This presentation is from the 2024 Joint Statistical Meetings (JSM), Portland, Oregon, August 3-8, 2024.
Algorithmic matching of striated tool marks

Algorithmic matching of striated tool marks

Automatic matching algorithms for assessing the similarity between striation marks have been investigated for bullet lands and some tool marks, such as screwdrivers. We are interested in the investigation of…