Skip to content

Silencing the Defense Expert

Conference/Workshop:
Association of Firearm and Tool Mark Examiners (AFTE)
Published: 2024
Primary Author: Jeff Salyards

In the wake of the 2009 NRC and 2016 PCAST Reports, the Firearms and Toolmark (FATM) discipline has come under increasing scrutiny. Validation studies like AMES I, Keisler, AMES II, Best & Gardner, and Guyll have provided important information about the validity (i.e., accuracy and reliability) of FATM examinations. However, judicial rulings like Tibbs, Ross, Shipp, Winfield, and Abruquah might not be aberrations; these cases could be the tip of the iceberg. In the past few years, I have had the opportunity to participate in judicial hearings with and against several thought leaders in the FATM community. I’m struck by three thoughts. First, each one did a very nice job. They were ethical, consistent, clear, and professional. Second, I believe we agree in many more areas than we disagree. Third, I do not believe that FATM examinations are junk science. However, there are legitimate concerns about the quantity and quality of the current validation studies. Treatment of inconclusive responses, a lack of understanding about how much of a questioned sample is needed to reach an accurate result, and treatment of missing data (e.g., participant dropout), all need to be addressed.

This talk will focus on strategies to silence the defense expert by taking the words out of their mouths. We will explore the current strengths and weaknesses of points that are raised in admissibility hearings. Hopefully, we will answer four questions: 1) What should the FATM expert say first, 2) What should the FATM expert avoid saying, 3) How do we keep from skating onto thin ice with our expert testimony, and 4) What are the strongest arguments in favor of FATM admissibility. Finally, we will review resources for FATM examiners and forensic science service providers to deepen their knowledge of mathematics, statistics, probability and physical science.

Related Resources

Score-based Likelihood Ratios Using Stylometric Text Embeddings

Score-based Likelihood Ratios Using Stylometric Text Embeddings

We consider the problem setting in which we have two sets of texts in digital form and would like to quantify our beliefs that the two sets of texts were…
How do Labs Ensure Quality? A Nationwide Review of SOPs for Latent Print Examination

How do Labs Ensure Quality? A Nationwide Review of SOPs for Latent Print Examination

This presentation is from the 108th International Association for Identification (IAI) Annual Educational Conference, Reno, Nevada, August 11-17, 2024. Posted with permission of CSAFE.
Statistics and its Applications in Forensic Science and the Criminal Justice System

Statistics and its Applications in Forensic Science and the Criminal Justice System

This presentation is from the 2024 Joint Statistical Meetings (JSM), Portland, Oregon, August 3-8, 2024.
Algorithmic matching of striated tool marks

Algorithmic matching of striated tool marks

Automatic matching algorithms for assessing the similarity between striation marks have been investigated for bullet lands and some tool marks, such as screwdrivers. We are interested in the investigation of…