Skip to content

Comparison of three similarity scores for bullet LEA matching

Journal: Forensic Science International
Published: 2020
Primary Author: Susan VanderPlas
Secondary Authors: Melissa Nally, Tyler Klep, Cristina Cadevall, Heike Hofmann
Research Area: Firearms and Toolmarks

Recent advances in microscopy have made it possible to collect 3D topographic data, enabling more precise virtual comparisons based on the collected 3D data as a supplement to traditional comparison microscopy and 2D photography. Automatic comparison algorithms have been introduced for various scenarios, such as matching cartridge cases[1],[2] or matching bullet striae[3],[4],[5]. One key aspect of validating these automatic comparison algorithms is to evaluate the performance of the algorithm on external tests, that is, using data which were not used to train the algorithm. Here, we present a discussion of the performance of the matching algorithm[6] in three studies conducted using different Ruger weapons. We consider the performance of three scoring measures: random forest score, cross correlation, and consecutive matching striae (CMS) at the land-to-land level and, using Sequential Average Maxima scores, also at the bullet-to bullet level. Cross correlation and random forest scores both result in perfect discrimination of same-source and different-source bullets. At the land-to-land level, discrimination for both cross correlation and random forest scores (based on area under the curve, AUC) is excellent (≥0.90).

Related Resources

Advancing the Understanding of 3D Imaging for Firearms Identification

Advancing the Understanding of 3D Imaging for Firearms Identification

Houston Forensic Science Center, in collaboration with CSAFE, has been awarded an NIJ grant to conduct a study focused on comparability of images acquired by 3D instruments manufactured by different…
Algorithmic matching of striated tool marks

Algorithmic matching of striated tool marks

Automatic matching algorithms for assessing the similarity between striation marks have been investigated for bullet lands and some tool marks, such as screwdrivers. We are interested in the investigation of…
A reproducible pipeline for extracting representative signals from wire cuts

A reproducible pipeline for extracting representative signals from wire cuts

We propose a reproducible pipeline for extracting representative signals from 2D topographic scans of the tips of cut wires. The process fully addresses many potential problems in the quality of…
An algorithm for forensic toolmark comparisons

An algorithm for forensic toolmark comparisons

Forensic toolmark analysis traditionally relies on subjective human judgment, leading to inconsistencies and lack of transparency. The multitude of variables, including angles and directions of mark generation, further complicates comparisons.…