Skip to content

Implementing blind proficiency testing in forensic laboratories: Motivation, obstacles, and recommendations

Journal: Forensic Science International: Synergy
Published: 2020
Primary Author: Robin Meija
Secondary Authors: Maria Cuellar, Jeff Salyards
Research Area: Latent Print

Regular proficiency testing of forensic examiners is required at accredited laboratories and widely accepted as an important component of a functioning quality assurance program. Yet, unlike in other testing industries, the majority of forensic laboratories testing programs rely entirely on declared proficiency tests. Some laboratories, primarily federal forensic facilities, have adopted blind proficiency tests, which are also used in the medical and drug testing industries. Blind tests offer advantages. They must resemble actual cases, can test the entire laboratory pipeline, avoid changes in behavior from an examiner knowing they are being tested, and are one of the only methods that can detect misconduct. However, the forensic context present both logistical and cultural obstacles to the implementation of blind proficiency tests. In November 2018, we convened a meeting of directors and quality assurance managers of local and state laboratories to discuss obstacles to the adoption of blind testing and assess successful and potential strategies to overcome them. Here, we compare the situation in forensic science to other testing disciplines, identifying obstacles to the implementation of blind proficiency testing in forensic contexts, and proposing ways to address those issues and increase the ecological validity of proficiency tests at forensic laboratories.

Related Resources

How Minutiae Frequency is Perceived and Used by Fingerprint Analysts in the Evaluation of Fingerprint Evidence

How Minutiae Frequency is Perceived and Used by Fingerprint Analysts in the Evaluation of Fingerprint Evidence

Analysts consider the appearance, placement, and number of features within a fingerprint pattern (called minutiae) that correspond when deciding whether two fingerprints originated from the same person. Little is known…
Analyzing spatial responses: A comparison of IRT- based approaches

Analyzing spatial responses: A comparison of IRT- based approaches

We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse…
Perceptions of blind proficiency testing among latent print examiners

Perceptions of blind proficiency testing among latent print examiners

In recent years, scholars have levied multiple criticisms against traditional proficiency testing procedures in forensic laboratories. Consequently, on several occasions, authorities have formally recommended that laboratories implement blind proficiency testing…
What types of information can and do latent print examiners review? A survey of practicing examiners

What types of information can and do latent print examiners review? A survey of practicing examiners

Understanding typical work practices is important to understanding the decision-making process underlying latent print comparison and improving the reliability of the discipline. Despite efforts to standardize work practices, a growing…