Skip to content

Bloodstain Pattern Analysis Black Box Study

This CSAFE webinar was held on October 14, 2021.

Presenters:

Austin Hicklin
Noblis Forensic Science Group, Director

Paul Kish
Forensic Consultant, Paul Erwin Kish Forensic Consultant and Associates

Kevin Winer
Director, Kansas City Police Crime Laboratory

Presentation Description:

This study was conducted to assess the accuracy and reproducibility of BPA conclusions. Although the analysis of bloodstain pattern evidence left at crime scenes relies on the expert opinions of bloodstain pattern analysts, the accuracy and reproducibility of these conclusions have never been rigorously evaluated at a large scale. We investigated conclusions made by 75 practicing bloodstain pattern analysts on 192 bloodstain patterns selected to be broadly representative of operational casework, resulting in 33,005 responses to prompts and 1,760 short text responses. Our results show that conclusions were often erroneous and often contradicted other analysts. On samples with known causes, 11.2% of responses were erroneous. The results show limited reproducibility of conclusions: 7.8% of responses contradicted other analysts. The disagreements with respect to the meaning and usage of BPA terminology and classifications suggest a need for improved standards. Both semantic differences and contradictory interpretations contributed to errors and disagreements, which could have serious implications if they occurred in casework. Paul Kish, Kevin Winer, and Noblis conducted the study under a grant from the U.S. National Institute of Justice (NIJ).

Additional resources can be found by emailing bloodstain@noblis.org.

Related Resources

Assessing the resources and requirements of statistics education in forensic science

Assessing the resources and requirements of statistics education in forensic science

With the increasing ability to easily collect and analyze data, statistics plays a more critical role in scientific research activities, such as designing experiments, controlling processes, and understanding or validating…
Sampling for Forensic Practitioners Short Course

Sampling for Forensic Practitioners Short Course

The first session of this two-session short course took place on September 30, 2021. The second session took place on October 7, 2021. Recordings of both sessions can be found…
A Survey of Fingerprint Examiners' Attitudes towards Probabilistic Reporting

A Survey of Fingerprint Examiners' Attitudes towards Probabilistic Reporting

This CSAFE webinar was held on September 22, 2021. Presenter: Simon Cole University of California, Irvine Presentation Description: Over the past decade, with increasing scientific scrutiny on forensic reporting practices,…
Recognition of Overlapping Elliptical Objects in a Binary Image

Recognition of Overlapping Elliptical Objects in a Binary Image

Recognition of overlapping objects is required in many applications in the field of computer vision. Examples include cell segmentation, bubble detection and bloodstain pattern analysis. This paper presents a method…