Skip to content

Footwear
Impression Analysis

Overarching GOALS

Developing new methods for assessing the strength of association between a crime scene print and a suspect’s shoe remains a priority for CSAFE researchers. Projects focus on gathering and analyzing information to create a score-based likelihood ratio framework for footwear examination. During the initial funding period, CSAFE teams at ISU, CMU and UCI advanced these efforts. Footwear research continues with CSAFE 2.0, led by researchers at ISU, UCI and WVU.

Hal Stern

Hal S. Stern

Provost and Executive Vice Chancellor and Chancellor's Professor, Co-Director of CSAFE

University of California, Irvine

CharlessFowlkes_web

Charless Fowlkes

Professor and Chancellor's Fellow

University of California, Irvine

kaplan-damary-naomi

Naomi Kaplan-Damary

Lecturer

Hebrew University of Jerusalem

SusanVanderplasColor

Susan Vanderplas

Assistant Professor

University of Nebraska, Lincoln

Alicia Carriquiry

Alicia Carriquiry

Distinguished Professor and President’s Chair, Director of CSAFE

Iowa State University

JacquelineSpeir1_web

Jacqueline Speir

Associate Professor

West Virginia University

Additional Team Members

Soyoung Park  sypark@iastate.edu

Richard Stone  rstone@iastate.edu

Steve Lund (NIST)  steven.lund@nist.gov

Martin Herman (NIST) martin.herman@nist.gov

focus Areas

It is believed that randomly acquired characteristics (RACs) are among the most discriminating features of shoeprints. Existing models to understand the spatial distribution of RACs rely on simplifying assumptions. One goal of our research is to develop and validate models that are more realistic for RACS. This project will also study the persistence of RACs over time (as the shoe is worn) and the repeatability and reproducibility of RAC detection by examiners.

Footwear comparison is conducted by experts in two broad stages. First, general properties such as the pattern, size and wear of the shoe sole are compared to the crime scene impression. If these do not fit, then the analysis is stopped and the pair is classified as a non-match. If the general properties fit, the forensic expert looks for randomly acquired characteristics (RACs) on the shoe sole and determines if they match RACs on the trace from the crime scene. Some CSAFE researchers are considering novel image-based approaches to footwear evidence. This project is focused on providing support for existing footwear analysis approaches through further study of RACs.

There is limited data available about the occurrence and persistence of RACs. This includes questions associated with whether RACs can be reliably annotated, whether RACs persist over time as the shoe is worn, and the relationship between RACs on a shoe and RACs found in crime scene impressions. Data from a recent study in Israel in which shoes were worn by individuals over the course of a year and repeated impressions were taken can be used to study these issues. Several individuals marked impressions made at different points in time by the same shoe. These data also include several instances of an individual marking the same impression at two points in time. The individuals in question were students trained by professional examiners. Though not themselves examiners we believe this unique data set is critical for developing approaches to analyzing the reproducibility (different examiner) and repeatability (same examiner) of RACs.

The goal of this project is to develop statistical and computational models to aid the interpretation of impression evidence left by shoe outsoles. We are developing statistical models that support robust reasoning about partial or obscured impression evidence and computational implementations of these models that can perform matching and retrieval for category-level (brand, size) identification from partial prints.

The goal of this project is to develop statistical and computational models to aid the interpretation of impression evidence left by shoe outsoles. Interpreting impression evidence requires reasoning about whether class-level and acquired characteristics of a candidate source are likely to have produced a given impression relative to other potential sources. We propose to develop statistical models that support robust reasoning about partial or obscured impression evidence and computational implementations of these models that can perform matching and retrieval for category-level (brand, size) identification from partial prints. Existing research in this area, including our own, has focused on matching test impressions with crime-scene evidence but has largely ignored forensic practice, which typically involves examination of the candidate source shoe itself and matching of physical features of the tread to evidence. To address this in a quantitative experimental framework, we propose to utilize high-resolution 3D scans of treads and develop methods that match features of these models to impression evidence and make predictions about the impressions a given tread might leave.

Footwear analysis is currently limited by the absence of reliable, publicly available databases that characterize the distribution of footwear characteristics and patterns. One approach to addressing this limitation is through the development of an instrument that can be deployed in public areas to passively collect images of outsoles of shoes. These data can enable estimation of the frequency of footwear patterns in a given region and thereby facilitate the transition to a likelihood ratio or Bayes Factor approach to the evaluation of footwear evidence. This is a novel project with the potential to have a large impact.

One of the biggest obstacles to development of quantitative and probabilistic methods for footwear impression evidence is that gathering data on the reference population or populations is incredibly difficult – the footwear used changes as new shoes are released, but also due to weather, geography, and other factors. This obstacle grows more complex when we consider the correct reference population: Should statistics be computed based on the general population, or based on a more difficult to measure population of “criminals”?

Project FWIII addresses these problems, leveraging a scanning device currently under development through an NIJ grant to acquire data from distinct geographic populations. We will develop relationships with local law enforcement in Iowa and Nebraska, eventually partnering with interested organizations to collect footwear data from populations which interact with law enforcement; during the same time period, we will collect data from public locations in the same region, facilitating comparison of the two reference populations. The collected data and associated metadata will be made available to the public in an online database which will serve as a resource for researchers and practitioners.

During the data collection period, we will manually annotate the collected images, identifying different class characteristics which may be of interest to examiners and researchers. These annotated images will be used to train more accurate feature recognition models, increasing the ability to automatically identify features in new images. Annotated images will also be made publicly available, serving as a resource for additional machine learning research in footwear class characteristics.

We will also work to characterize the main components of variability in class characteristic frequency from among options such as weather, time of day, weekday, population, and location. Leveraging this information, we will develop sampling guidelines to assist practitioners and other researchers who wish to collect data in their own geographic area.

The primary long-term goal of this project is to empower practitioners to collect footwear frequency data in their own jurisdictions, and to provide the hardware and software tools to support the use of the collected data in forensic applications. By providing open-access databases, we facilitate the development of additional tools for analyzing this type of data at the same time as we improve our own software and build up the body of literature relating to class characteristic frequency variation.

Researchers at ISU have developed and carried out limited testing of an algorithm called MC-COMP to quantify the similarity between two outsole impressions with the same class characteristics (Park and Carriquiry, 2020). The algorithm has a small error rate in identifying same/different source pairs (4%-5%); however, more testing on degraded images is needed. In addition, with our new partners at West Virginia University, we will use data from the application of this algorithm to identify features of shoeprint images that are associated with more difficult cases, with the goal of developing a quality metric for footwear images. This can enable automatic identification of image quality that can help interpret footwear evidence. 

Footwear impressions are commonly found in crime scenes, but until now footwear examiners have lacked the tools to objectively quantify the similarity between a crime scene impression to one or more test impressions. The task is challenging because crime scene impressions are often smudged or otherwise degraded. The ISU team has developed an algorithm called MC-COMP that produces a similarity score between two 2D outsole impressions that shows good performance (~96% accuracy) even when one of the images is degraded in a certain way. While promising, the algorithm has only been used on two shoe models and only on images degraded in the lab. 

Two-dimensional images consist of thousands of pixels, each with a certain gray intensity (in gray scale images).  MC-COMP uses a subset of interesting pixels selected using SURF (speeded-up robust features). To align two images, MC-COMP relies on the geometric arrangement of the selected pixels in local regions of the outsole that the examiner selects.  In this light, the algorithm we proposed is semi-automated and requires input by the examiner. We note that MC-COMP is a “whole outsole” method in that pixels of interest can correspond to the pattern of the outsole or to RACs (randomly acquired characteristics).

We propose to pursue the following research objectives:

  • Continue improving MC-COMP.  Now, the similarity score is produced by a random forest that combines three features.  We propose to explore the use of additional features and the possibility of stacking, by using the scores themselves as features in a different learning algorithm.
  • Greatly expand the type of outsoles on which we apply MC-COMP.  In particular, in collaboration with footwear examiners, NIST and the FBI, create a large database of realistic crime scene impressions with known ground truth to validate the algorithm and ensure that it will perform well in real casework. 
  • Explore the use of high-resolution instruments to collect both crime scene and test impressions. 
  • Assess the relationship between footwear impression quality and automated image comparison methods by developing a footwear image quality model based on independent image features/factors.  Resulting image quality predictors will be regressed against algorithm performance (match rank and ground truth) and expert predictions of quality in order to develop an independent quality model that can be used to inform weight of evidence estimates. 
  • In collaboration with practitioners, explore the steps needed to transition the new technologies to laboratories for use in real casework.

Knowledge Transfer

  • Type

Found 41 Results
Page 2 of 3

Open Forensic Science in R

Type: Research Area(s):

Published: 2019 | By: Samantha Tyner

This book is for anyone looking to do forensic science analysis in a data-driven and open way. Whether you are a student, teacher, or scientist, this book is for you. We take the latest research, primarily from the Center for Statistics and…

View on Digital Repository


Quantifying the similarity of 2D images using edge pixels: An application to the forensic comparison of footwear impressions

Type: Research Area(s):

Published: 2020 | By: Soyoung Park

We propose a novel method to quantify the similarity between an impression (Q) from an unknown source and a test impression (K) from a known source. Using the property of geometrical congruence in the impressions, the degree of correspondence is…

View on Digital Repository


Quantifying the similarity of 2D images using edge pixels: An application to the forensic comparison of footwear impressions

Type: Research Area(s):

Published: 2020 | By: Soyoung Park

We propose a novel method to quantify the similarity between an impression (Q) from an unknown source and a test impression (K) from a known source. Using the property of geometrical congruence in the impressions, the degree of correspondence is…

View on Digital Repository


A database of two-dimensional images of footwear outsole impressions

Type: Research Area(s):

Published: 2020 | By: Soyoung Park

Footwear outsole images were obtained from 150 pairs of used shoes. The motivation for constructing the database was to enable a statistical analysis of two-dimensional (2D) images of shoe outsoles, to understand within shoe (between replicate images of the same…


CSAFE 2020 All Hands Meeting

Type: Research Area(s): ,,,,,,,,

The 2020 All Hands Meeting was held May 12 and 13, 2020 and served as the closing to the last 5 years of CSAFE research and focused on kicking off new initiatives for the next phase of the center, CSAFE…


An algorithm to compare two‐dimensional footwear outsole images using maximum cliques and speeded‐up robust feature

Type: Research Area(s):

Published: 2020 | By: Soyoung Park

Footwear examiners are tasked with comparing an outsole impression (Q) left at a crime scene with an impression (K) from a database or from the suspect's shoe. We propose a method for comparing two shoe outsole impressions that relies on…

View on Digital Repository


Statistical Learning Algorithms for Forensic Scientists

Type: Research Area(s):

Published: 2020 | By: Alicia L. Carriquiry

The goals of this workshop are to: (1) introduce attendees to the basics of supervised learning algorithms in the context of forensic applications, including firearms and footwear examination and trace evidence, while placing emphasis on classification trees, random forests, and,…

View on Digital Repository


Similarity between outsole impressions using SURF

Type: Research Area(s):

Published: 2020 | By: Soyoung Park

The learning objectives of this presentation include the following: Introduce an objective method to quantify the similarity between two outsole impressions, show that this algorithm is accurate and reliable even when outsoles share class characteristics and degree of wear, and…

View on Digital Repository


Applications of a CNN for Automatics Classification of Outsole Features

Type: Research Area(s):

Published: 2020 | By: Miranda R. Tilton

After attending this presentation, attendees will be familiar with the ways that CNNs can be applied to classify forensic pattern evidence, specifically with shoe outsole features.

View on Digital Repository


An Overview of CSAFE’s Publically Available Datasets

Type: Research Area(s): ,

Forensic scientists and researchers can now directly implement CSAFE data into their laboratory work. CSAFE forensic databases are publically available and can be utilized to test current analysis techniques, design new methods, and increase confidence in forensic evidence conclusions. This…


A convolutional neural network for outsole recognition

Type: Research Area(s):

Published: 2019 | By: Miranda Tilton

A common goal of forensic shoeprint analysis is to identify shoe models or designs that are similar to that of a given print, such as a print found at a crime scene. Quantifying similarity between shoe outsole patterns is difficult…

View on Digital Repository


Pattern Evidence Research in CSAFE-An Update

Type: Research Area(s): ,,,,

CSAFE is a NIST Center of Excellence in Forensic Science. A large portion of CSAFE’s research portfolio is on what is known as pattern evidence, which encompasses any evidence that can be represented as an image. Examples of pattern evidence…


A semi-automated algorithm to quantify similarity between outsole impressions using SURF

Type: Research Area(s):

Published: 2019 | By: Alicia Carriquiry

Footwear examiners are tasked with comparing an outsole impression (Q) left at a crime scene with an impression (K) from a database or from the suspect's shoe. We propose semi-automated algorithm, MC-COMP-SURF, for comparing two shoe outsole impressions, that relies…

View on Digital Repository


A Bayesian Hierarchical Model for Evaluating Forensic Footwear Evidence

Type: Research Area(s):

Published: 2020 | By: Neil Spencer

When a latent shoeprint is discovered at a crime scene, forensic analysts inspect it for distinctive patterns of wear such as scratches and holes (known as accidentals) on the source shoe's sole. If its accidentals correspond to those of a…

View on Digital Repository


Similarity of Two-Dimensional Images: An application to the forensic comparison of shoe outsole impressions

Type: Research Area(s):

This CSAFE Center Wide webinar was presented on March 11, 2019 by Dr. Soyoung Park, CSAFE Post Doctoral researcher at Iowa State University. Dr. Park has provided presentation slides.   Presentation Description: Shoe outsole prints are often found in crime…


Cross-Domain Image Matching with Deep Feature Maps

Type: Research Area(s):

Published: 2019 | By: Bailey Kong

We investigate the problem of automatically determining what type of shoe left an impression found at a crime scene. This recognition problem is made difficult by the variability in types of crime scene evidence (ranging from traces of dust or…

View on Digital Repository


Statistical and Computational Tools for Automated Matching of Footwear Class Characteristics

Type: Research Area(s):

This CSAFE Center Wide webinar was presented on April 27, 2018 by Dr. Charless Fowlkes, CSAFE researcher and associate professor of computer science at University of California, Irvine. Presentation Description: We investigate the problem of automatically determining shoe outsole class…


Footwear Impression Evidence Examination: Overview, challenges, research and the future

Type: Research Area(s):

This CSAFE Center Wide Webinar was presented on March 5, 2018 by Lesley Hammer, (MA, MSc) forensic consultant at Hammer Forensics. Presentation description: This presentation will provide an overview of footwear impression examination, explore directions that research in this discipline has…


Dependence among Randomly Acquired Characteristics on Shoeprints and their Features

Type: Research Area(s):

Published: 2018 | By: Naomi Kaplan

Randomly acquired characteristics (RACs), also known as accidental marks, are random markings on a shoe sole, such as scratches or holes, that are used by forensic experts to compare a suspect's shoe with a print found at the crime scene.…

View on Digital Repository


Cross-Domain Forensic Shoeprint Matching

Type: Research Area(s):

Published: 2017 | By: Bailey Kong

We investigate the problem of automatically determining what type of shoe left an impression found at a crime scene. This recognition problem is made difficult by the variability in types of crime scene evidence (ranging from traces of dust or…

View on Digital Repository


Page 2 of 3

COMMUNITY CALL-TO-ACTION

Want to collaborate with CSAFE on a project? Contact us to share your idea.