Skip to content

Implementing Blind Proficiency Testing

Type: Webinar
Research Area: Latent Print

This CSAFE Center Wide webinar was presented on July 18, 2019 by Dr. Robin Mejia, CSAFE researcher at Carnegie Mellon University. Dr. Mejia provided presentation slides.

Presentation Description:

Blind proficiency testing is a norm or requirement in many scientific fields. However, forensic laboratories primarily rely on open proficiency tests from vendors such as Collaborative Testing Services, Inc. or Forensic Assurance. In open proficiency tests, examiners know they are being tested, and the test targets a specific step in the evidence handling and analysis pipeline.  In blind proficiency tests, examiners are unaware they are being tested and, as the sample moves through the laboratory’s evidence handling and management pipeline, it can provide data on the entire process from evidence submission to analyst report.  Studies in other fields have shown that laboratories often perform differently on open and blind proficiency tests. A growing number of voices within the community of forensic quality managers and some laboratory directors have expressed interest in implementing blind testing in addition to open proficiency tests.  However, implementing blind proficiency testing is logistically challenging, and takes both time and money, neither of which tend to be in surplus at forensic laboratories. This webinar will report on the CSAFE 2018 Blinding Workshop, highlighting experiences, issues, and best practices for laboratories implementing blinding.

 

Related Resources

How Minutiae Frequency is Perceived and Used by Fingerprint Analysts in the Evaluation of Fingerprint Evidence

How Minutiae Frequency is Perceived and Used by Fingerprint Analysts in the Evaluation of Fingerprint Evidence

Analysts consider the appearance, placement, and number of features within a fingerprint pattern (called minutiae) that correspond when deciding whether two fingerprints originated from the same person. Little is known…
Analyzing spatial responses: A comparison of IRT- based approaches

Analyzing spatial responses: A comparison of IRT- based approaches

We investigate two approaches for analyzing spatial coordinate responses using models inspired by Item Response Theory (IRT). In the first, we use a two-stage approach to first construct a pseudoresponse…
Perceptions of blind proficiency testing among latent print examiners

Perceptions of blind proficiency testing among latent print examiners

In recent years, scholars have levied multiple criticisms against traditional proficiency testing procedures in forensic laboratories. Consequently, on several occasions, authorities have formally recommended that laboratories implement blind proficiency testing…
What types of information can and do latent print examiners review? A survey of practicing examiners

What types of information can and do latent print examiners review? A survey of practicing examiners

Understanding typical work practices is important to understanding the decision-making process underlying latent print comparison and improving the reliability of the discipline. Despite efforts to standardize work practices, a growing…