Skip to content

Bloodstain Pattern Analysis Black Box Study

This CSAFE webinar was held on October 14, 2021.

Presenters:

Austin Hicklin
Noblis Forensic Science Group, Director

Paul Kish
Forensic Consultant, Paul Erwin Kish Forensic Consultant and Associates

Kevin Winer
Director, Kansas City Police Crime Laboratory

Presentation Description:

This study was conducted to assess the accuracy and reproducibility of BPA conclusions. Although the analysis of bloodstain pattern evidence left at crime scenes relies on the expert opinions of bloodstain pattern analysts, the accuracy and reproducibility of these conclusions have never been rigorously evaluated at a large scale. We investigated conclusions made by 75 practicing bloodstain pattern analysts on 192 bloodstain patterns selected to be broadly representative of operational casework, resulting in 33,005 responses to prompts and 1,760 short text responses. Our results show that conclusions were often erroneous and often contradicted other analysts. On samples with known causes, 11.2% of responses were erroneous. The results show limited reproducibility of conclusions: 7.8% of responses contradicted other analysts. The disagreements with respect to the meaning and usage of BPA terminology and classifications suggest a need for improved standards. Both semantic differences and contradictory interpretations contributed to errors and disagreements, which could have serious implications if they occurred in casework. Paul Kish, Kevin Winer, and Noblis conducted the study under a grant from the U.S. National Institute of Justice (NIJ).

Additional resources can be found by emailing bloodstain@noblis.org.

Related Resources

A Data-Driven Approach to Model the Generation Process of Bloodstain Patterns

A Data-Driven Approach to Model the Generation Process of Bloodstain Patterns

This poster was presented at the 106th International Association for Identification
The ASCLD Forensic Research Committee and You: A Collaboration Worth Investigating

The ASCLD Forensic Research Committee and You: A Collaboration Worth Investigating

This CSAFE webinar was held on November 17, 2022. Presenter: Henry Maynard Committee Chair, ASCLD Forensic Research Committee Chief Scientist in the Office of the Chief Scientist, Defense Forensic Science…
handwriter: a Demonstration and Update on CSAFE Handwriting Analysis

handwriter: a Demonstration and Update on CSAFE Handwriting Analysis

This CSAFE webinar was held on October 18, 2022. Presenters: Alicia Carriquiry Director, CSAFE Distinguished Professor and President’s Chair, Department of Statistics – Iowa State University Stephanie Reinders Research Scientist,…
Tutorial on Likelihood Ratios with Applications in Digital Forensics

Tutorial on Likelihood Ratios with Applications in Digital Forensics

This CSAFE webinar was held on September 15, 2022. Presenters: Rachel Longjohn PhD Student – Department of Statistics, University of California, Irvine Dr. Padhraic Smyth Chancellor’s Professor – Departments of…