{"id":16246,"date":"2023-07-14T15:32:12","date_gmt":"2023-07-14T20:32:12","guid":{"rendered":"https:\/\/forensicstats.org\/?post_type=portfolio&#038;p=16246"},"modified":"2023-07-14T15:32:12","modified_gmt":"2023-07-14T20:32:12","slug":"reliability-for-binary-and-ordinal-data-in-forensics-2","status":"publish","type":"portfolio","link":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/","title":{"rendered":"Reliability for Binary and Ordinal Data in Forensics"},"content":{"rendered":"<p>Black-box studies are a crucial part of assessing the accuracy and reliability of subjective decisions in forensics. The extant black-box studies have generally had two components. In the first study, examiners are asked to assess forensic samples (typically questioned and known samples with ground truth known by the study designers) just like they would in real casework and report decisions on a scale that is pre-defined. That addresses reproducibility (consistency) and validity (accuracy) of examiner decisions. In the second study, examiners are asked to re-assess a small subset of the samples that they observed in the first study. This allows researchers to assess repeatability or within-examiner consistency.<\/p>\n<p>Motivated by these studies, this project explores statistical methods for the analysis of black box studies. In particular, we have used these examples to demonstrate a statistical approach to inferences for reliability that combines the reproducibility and repeatability studies while allowing for inference regarding examiner-sample interactions.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Black-box studies are a crucial part of assessing the accuracy and reliability of subjective decisions in forensics. The extant black-box studies have generally had two components. In the first study, [&hellip;]<\/p>\n","protected":false},"author":5,"featured_media":13264,"menu_order":0,"comment_status":"open","ping_status":"open","template":"","portfolio_category":[63],"portfolio_tag":[58],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v22.6 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Reliability for Binary and Ordinal Data in Forensics - Center for Statistics and Applications in Forensic Evidence<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"1 minute\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/\",\"url\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/\",\"name\":\"Reliability for Binary and Ordinal Data in Forensics - Center for Statistics and Applications in Forensic Evidence\",\"isPartOf\":{\"@id\":\"https:\/\/forensicstats.org\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/forensicstats.org\/wp-content\/uploads\/2022\/03\/CategoryIcons_Statistics-e1648568754268.png\",\"datePublished\":\"2023-07-14T20:32:12+00:00\",\"dateModified\":\"2023-07-14T20:32:12+00:00\",\"breadcrumb\":{\"@id\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#primaryimage\",\"url\":\"https:\/\/forensicstats.org\/wp-content\/uploads\/2022\/03\/CategoryIcons_Statistics-e1648568754268.png\",\"contentUrl\":\"https:\/\/forensicstats.org\/wp-content\/uploads\/2022\/03\/CategoryIcons_Statistics-e1648568754268.png\",\"width\":201,\"height\":200},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/forensicstats.org\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Portfolios\",\"item\":\"https:\/\/forensicstats.org\/blog\/portfolio\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Reliability for Binary and Ordinal Data in Forensics\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/forensicstats.org\/#website\",\"url\":\"https:\/\/forensicstats.org\/\",\"name\":\"Center for Statistics and Applications in Forensic Evidence\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/forensicstats.org\/#organization\"},\"alternateName\":\"CSAFE\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/forensicstats.org\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/forensicstats.org\/#organization\",\"name\":\"Center for Statistics and Applications in Forensic Evidence\",\"alternateName\":\"CSAFE\",\"url\":\"https:\/\/forensicstats.org\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/forensicstats.org\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/forensicstats.org\/wp-content\/uploads\/2017\/06\/csafe-logo.jpg\",\"contentUrl\":\"https:\/\/forensicstats.org\/wp-content\/uploads\/2017\/06\/csafe-logo.jpg\",\"width\":576,\"height\":360,\"caption\":\"Center for Statistics and Applications in Forensic Evidence\"},\"image\":{\"@id\":\"https:\/\/forensicstats.org\/#\/schema\/logo\/image\/\"}}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Reliability for Binary and Ordinal Data in Forensics - Center for Statistics and Applications in Forensic Evidence","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/","twitter_misc":{"Est. reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/","url":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/","name":"Reliability for Binary and Ordinal Data in Forensics - Center for Statistics and Applications in Forensic Evidence","isPartOf":{"@id":"https:\/\/forensicstats.org\/#website"},"primaryImageOfPage":{"@id":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#primaryimage"},"image":{"@id":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#primaryimage"},"thumbnailUrl":"https:\/\/forensicstats.org\/wp-content\/uploads\/2022\/03\/CategoryIcons_Statistics-e1648568754268.png","datePublished":"2023-07-14T20:32:12+00:00","dateModified":"2023-07-14T20:32:12+00:00","breadcrumb":{"@id":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#primaryimage","url":"https:\/\/forensicstats.org\/wp-content\/uploads\/2022\/03\/CategoryIcons_Statistics-e1648568754268.png","contentUrl":"https:\/\/forensicstats.org\/wp-content\/uploads\/2022\/03\/CategoryIcons_Statistics-e1648568754268.png","width":201,"height":200},{"@type":"BreadcrumbList","@id":"https:\/\/forensicstats.org\/blog\/portfolio\/reliability-for-binary-and-ordinal-data-in-forensics-2\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/forensicstats.org\/"},{"@type":"ListItem","position":2,"name":"Portfolios","item":"https:\/\/forensicstats.org\/blog\/portfolio\/"},{"@type":"ListItem","position":3,"name":"Reliability for Binary and Ordinal Data in Forensics"}]},{"@type":"WebSite","@id":"https:\/\/forensicstats.org\/#website","url":"https:\/\/forensicstats.org\/","name":"Center for Statistics and Applications in Forensic Evidence","description":"","publisher":{"@id":"https:\/\/forensicstats.org\/#organization"},"alternateName":"CSAFE","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/forensicstats.org\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/forensicstats.org\/#organization","name":"Center for Statistics and Applications in Forensic Evidence","alternateName":"CSAFE","url":"https:\/\/forensicstats.org\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/forensicstats.org\/#\/schema\/logo\/image\/","url":"https:\/\/forensicstats.org\/wp-content\/uploads\/2017\/06\/csafe-logo.jpg","contentUrl":"https:\/\/forensicstats.org\/wp-content\/uploads\/2017\/06\/csafe-logo.jpg","width":576,"height":360,"caption":"Center for Statistics and Applications in Forensic Evidence"},"image":{"@id":"https:\/\/forensicstats.org\/#\/schema\/logo\/image\/"}}]}},"_links":{"self":[{"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/portfolio\/16246"}],"collection":[{"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/portfolio"}],"about":[{"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/types\/portfolio"}],"author":[{"embeddable":true,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/comments?post=16246"}],"version-history":[{"count":2,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/portfolio\/16246\/revisions"}],"predecessor-version":[{"id":16248,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/portfolio\/16246\/revisions\/16248"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/media\/13264"}],"wp:attachment":[{"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/media?parent=16246"}],"wp:term":[{"taxonomy":"portfolio_category","embeddable":true,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/portfolio_category?post=16246"},{"taxonomy":"portfolio_tag","embeddable":true,"href":"https:\/\/forensicstats.org\/wp-json\/wp\/v2\/portfolio_tag?post=16246"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}