Skip to content

Implementing Blind Proficiency Testing

Type: Webinar
Research Area: Latent Print

This CSAFE Center Wide webinar was presented on July 18, 2019 by Dr. Robin Mejia, CSAFE researcher at Carnegie Mellon University. Dr. Mejia provided presentation slides.

Presentation Description:

Blind proficiency testing is a norm or requirement in many scientific fields. However, forensic laboratories primarily rely on open proficiency tests from vendors such as Collaborative Testing Services, Inc. or Forensic Assurance. In open proficiency tests, examiners know they are being tested, and the test targets a specific step in the evidence handling and analysis pipeline.  In blind proficiency tests, examiners are unaware they are being tested and, as the sample moves through the laboratory’s evidence handling and management pipeline, it can provide data on the entire process from evidence submission to analyst report.  Studies in other fields have shown that laboratories often perform differently on open and blind proficiency tests. A growing number of voices within the community of forensic quality managers and some laboratory directors have expressed interest in implementing blind testing in addition to open proficiency tests.  However, implementing blind proficiency testing is logistically challenging, and takes both time and money, neither of which tend to be in surplus at forensic laboratories. This webinar will report on the CSAFE 2018 Blinding Workshop, highlighting experiences, issues, and best practices for laboratories implementing blinding.

 

Related Resources

CSAFE 2021 Field Update

CSAFE 2021 Field Update

The 2021 Field Update was held June 14, 2021, and served as the closing to the first year of CSAFE 2.0. CSAFE brought together researchers, forensic science partners and interested…
Mt. Everest—we are going to lose many: a survey of fingerprint examiners’ attitudes towards probabilistic reporting

Mt. Everest—we are going to lose many: a survey of fingerprint examiners’ attitudes towards probabilistic reporting

Over the past decade, with increasing scientific scrutiny on forensic reporting practices, there have been several efforts to introduce statistical thinking and probabilistic reasoning into forensic practice. These efforts have…
IRT for Forensics

IRT for Forensics

This CSAFE webinar was held on April 8, 2021. Presenter: Amanda Luby Assistant Professor of Statistics, Swarthmore College Presentation Description: In this webinar, Amanda Luby explored how Item Response Theory…
Latent print comparison and examiner conclusions: A field analysis of case processing in one crime laboratory

Latent print comparison and examiner conclusions: A field analysis of case processing in one crime laboratory

Scholarship on the latent print comparison process has expanded in recent years, responsive to the call for rigorous research by scholarly groups (e.g., National Academy of Sciences, 2009; President’s Council…