Skip to content

Comparison of three similarity scores for bullet LEA matching

Journal: Forensic Science International
Published: 2020
Primary Author: Susan VanderPlas
Secondary Authors: Melissa Nally, Tyler Klep, Cristina Cadevall, Heike Hofmann
Research Area: Firearms and Toolmarks

Recent advances in microscopy have made it possible to collect 3D topographic data, enabling more precise virtual comparisons based on the collected 3D data as a supplement to traditional comparison microscopy and 2D photography. Automatic comparison algorithms have been introduced for various scenarios, such as matching cartridge cases[1],[2] or matching bullet striae[3],[4],[5]. One key aspect of validating these automatic comparison algorithms is to evaluate the performance of the algorithm on external tests, that is, using data which were not used to train the algorithm. Here, we present a discussion of the performance of the matching algorithm[6] in three studies conducted using different Ruger weapons. We consider the performance of three scoring measures: random forest score, cross correlation, and consecutive matching striae (CMS) at the land-to-land level and, using Sequential Average Maxima scores, also at the bullet-to bullet level. Cross correlation and random forest scores both result in perfect discrimination of same-source and different-source bullets. At the land-to-land level, discrimination for both cross correlation and random forest scores (based on area under the curve, AUC) is excellent (≥0.90).

Related Resources

CSAFE 2020 All Hands Meeting

CSAFE 2020 All Hands Meeting

The 2020 All Hands Meeting was held May 12 and 13, 2020 and served as the closing to the last 5 years of CSAFE research and focused on kicking off…
A Robust Approach to Automatically Locating Grooves in 3D Bullet Land Scans

A Robust Approach to Automatically Locating Grooves in 3D Bullet Land Scans

Land engraved areas (LEAs) provide evidence to address the same source–different source problem in forensic firearms examination. Collecting 3D images of bullet LEAs requires capturing portions of the neighboring groove…
Pattern Evidence Research in CSAFE-An Update

Pattern Evidence Research in CSAFE-An Update

CSAFE is a NIST Center of Excellence in Forensic Science. A large portion of CSAFE’s research portfolio is on what is known as pattern evidence, which encompasses any evidence that…
Reproducibility of Automated Bullet Matching Scores Using High-Resolution 3D LEA Scans

Reproducibility of Automated Bullet Matching Scores Using High-Resolution 3D LEA Scans

Development of automated bullet matching algorithms based on 3D scans of land engraved areas (LEAs) has become a prominent area of research in recent years. However, automated methods rely heavily…
Do you have 44.03 seconds?

44.3 Seconds. That is the average amount of time it takes for a visitor to provide site feedback.
Test it yourself by taking the survey.


A scientist/researcherA member of the forensic science communityA journalist/publicationA studentOther. Please indicate.


Learn more about CSAFE overall.Discover research CSAFE is undertaking.Explore collaboration opportunities.Find tools and education opportunities.Other. Please indicate.


YesNo