Skip to content

Implementing Blind Proficiency Testing

Type: Webinar
Research Area: Latent Print

This CSAFE Center Wide webinar was presented on July 18, 2019 by Dr. Robin Mejia, CSAFE researcher at Carnegie Mellon University. Dr. Mejia provided presentation slides.

Presentation Description:

Blind proficiency testing is a norm or requirement in many scientific fields. However, forensic laboratories primarily rely on open proficiency tests from vendors such as Collaborative Testing Services, Inc. or Forensic Assurance. In open proficiency tests, examiners know they are being tested, and the test targets a specific step in the evidence handling and analysis pipeline.  In blind proficiency tests, examiners are unaware they are being tested and, as the sample moves through the laboratory’s evidence handling and management pipeline, it can provide data on the entire process from evidence submission to analyst report.  Studies in other fields have shown that laboratories often perform differently on open and blind proficiency tests. A growing number of voices within the community of forensic quality managers and some laboratory directors have expressed interest in implementing blind testing in addition to open proficiency tests.  However, implementing blind proficiency testing is logistically challenging, and takes both time and money, neither of which tend to be in surplus at forensic laboratories. This webinar will report on the CSAFE 2018 Blinding Workshop, highlighting experiences, issues, and best practices for laboratories implementing blinding.

 

Related Resources

What’s in a Name? Consistency in Latent Print Examiners’ Naming Conventions and Perceptions of Minutiae Frequency

What’s in a Name? Consistency in Latent Print Examiners’ Naming Conventions and Perceptions of Minutiae Frequency

Fingerprint minutia types influence LPEs’ decision-making processes during analysis and evaluation, with features perceived to be rarer generally given more weight. However, no large-scale studies comparing examiner perceptions of minutiae…
An alternative statistical framework for measuring proficiency

An alternative statistical framework for measuring proficiency

Item Response Theory, a class of statistical methods used prominently in educational testing, can be used to measure LPE proficiency in annual tests or research studies, while simultaneously accounting for…
Examiner variability in pattern evidence: proficiency, inconclusive tendency, and reporting styles

Examiner variability in pattern evidence: proficiency, inconclusive tendency, and reporting styles

The current approach to characterizing uncertainty in pattern evidence disciplines has focused on error rate studies, which provide aggregated error rates over many examiners and pieces of evidence. However, decisions…
Statistical Interpretation and Reporting of Fingerprint Evidence: FRStat Introduction and Overview

Statistical Interpretation and Reporting of Fingerprint Evidence: FRStat Introduction and Overview

The FRStat is a tool designed to help quantify the strength of fingerprint evidence. Following lengthy development and validation with assistance from CSAFE and NIST, in 2017 the FRStat was…