2019 | The Year in Review – SCIENCE OF BIOMETRICS – NOVEL BIOMETRICS – MULTISPECTRAL BIOMETRICS – BEHAVIORAL BIOMETRICS – TRUST & PRIVACY – VIDEO ANALYTICS – CYBERSECURITY – MOBILE & COMPUTING – FUSION & PERFORMANCE
A NATIONAL SCIENCE FOUNDATION INDUSTRY/UNIVERSITY COOPERATIVE RESEARCH CENTER
C I Te R |
A YEAR IN REVIEW
With our interdisciplinary group of faculty, researchers and students, CITeR is the only National Science Foundation (NSF) Industry/University Cooperative Research Center (I/UCRC) focusing on serving its affiliates in the rapidly growing areas of identity and biometrics.
CITeR Affiliates ACV Auctions Aetna Health Inc. Army Futures Command — Combat Capabilities Development Command — Armaments Center (CCDC — Armaments)
29
Athena Sciences
master’s and PhD students currently engaged in CITeR research
AWARE Inc. Defence Research and Development Canada (DRDC) Defense Forensic Science Center (DFSC)
26
undergraduates currently engaged in CITeR research
Department of Defense — Defense Forensics and Biometrics Agency (DFBA) Department of Homeland Security — Office of Biometric Identity Management (OBIM) Department of Homeland Security — Science and Technology
23
faculty engaged in research and teaching biometrics
Directorate (S&T) Federal Bureau of Investigation (FBI) HID Global IDEMIA InCadence Strategic Solutions
16
webinars featuring results from recently completed CITeR projects
Integrated Biometrics Northrop Grumman Corporation Precise Biometrics Qualcomm Incorporated SICPA
4
new affiliates added in 2019
c i t e r. c l a r k s o n . e d u
Veridium ZOLOZ
OUTREACH | WORKSHOPS CHALLENGE PROBLEM
Challenge Problem Workshops CITeR Challenge Problem Workshops have been held in conjunction with CITeR Program Reviews since 2016. The workshops were created to explore specific biometric challenge problems, examine the current state of biometrics, identify gaps and brainstorm potential solutions. In many cases, the events have been hosted by a CITeR affiliate and held on-site at their facility. A workshop typically includes an operational tour followed by interactive dialogue that provides an opportunity to focus on affiliate-specific challenges. The workshops allow the CITeR community to continue to nurture thought leadership in identification technology.
Children learn about biometrics as part of the Biometric Aging Study led by Clarkson graduate student Priyanka Das.
Fall 2019 Event — Hosted by the FBI’s Criminal Justice Information Services (CJIS) Division and Department of Defense/ Defense Forensics and Biometrics Agency (DFBA) in Clarksburg, West Virginia In addition to opening remarks from FBI and DFBA leadership, CITeR Challenge Problem Workshop attendees heard talks on academic efforts, FBI iris and latent print operations, and global initiatives, as well as presentations on DOD operational perspectives and near real-time identity operations. The event culminated with a panel discussion on the use of biometrics and identification technology. Spring 2019 Event — Hosted by the Department of Homeland Security (DHS) Maryland Test Facility The Maryland Test Facility (MdTF) provides a controlled environment and conditions for laboratory evaluation and operational scenario-based testing of various biometric technologies. In this Challenge Problem Workshop, guests toured the MdTF and received an overview of what an MdTF Biometric Test Rally Event entails. The Test Rally is a DHS event designed to enhance industry innovation and advance technologies that support DHS and Homeland Security Enterprise operations.
CITeR Director Stephanie Schuckers presents at the FBI Challenge Problem Workshop as part of the CITeR Fall 2019 Challenge Event.
CITeR community tours the Maryland Test Facility during the CITeR Spring 2019 Challenge Event.
C I Te R | 1
Research Highlights - WEST VIRGINIA UNIVERSITY - SUNY AT BUFFALO
Contactless Fingerprint Interoperability Nasser Nasrabadi, Jeremy Dawson (West Virginia University)
Finger images with perspective distortion
Match unrolled 2D non-contact fingerprints against legacy rolled fingerprints with distortion removal
  GAN Restoration of perspective distorted points
DCGAN trained to remove elastic distortion
This project has resulted in the submission of two patent applications.
Researchers at WVU have developed a novel way to improve the match rate between fingerprint images that are captured via contactless and contact-based methods. Most existing fingerprint databases used by law enforcement and defense agencies are contact-based. This technology Fingerprints with elastic distortion bridges the gap when fingerprints obtained by one method must be matched against those obtained by the other to confirm a person’s identity. Contact-based fingerprint methods create an elastic distortion of the fingerprint that is not present when using contactless methods. The approach is based on two jointly optimized neural networks that work together to improve the probability of obtaining a fingerprint match, using estimates of warp parameters to perform geometric mapping of a contactless fingerprint image. The technology could be licensed to companies currently implementing both contactless and contact-based fingerprint technologies.
Wardrobe Models for Person Re-Identification Nils Napp, Srirangaraj Setlur (SUNY at Buffalo) Recently, most of the person re-identification (re-ID) work has focused on distance metric learning and feature learning. While clothing has been used as a soft biometric for tracking and re-ID, both implicitly and explicitly through color/texture appearance models, it has not been explored in long-term video surveillance scenarios spanning a large number of days. By modeling a wardrobe (collection of clothes worn by an individual), better re-ID performance could be obtained over much longer time scales. We developed a reliable pipeline for person and clothing detection and a wardrobe model based on the detected clothing attributes. Results demonstrated that using wardrobe models in conjunction with any traditional appearance-based classification methods can produce appreciable improvements in long-term re-ID performance. This work enables capture of novel mid-level feature representation for individuals that can be applied to many applications, such as long-term video-based surveillance and multicamera person tracking, and can be incorporated into products in this space. c i t e r. c l a r k s o n . e d u
Research Highlights
GROWTH
- CLARKSON UNIVERSITY
- ADDITIONAL SITES
Machine Learning Assisted Face Quality Assessment: Reduction in Computing Demand for Face in Video Recognition
CITeR Expands With Two New Sites:
Chen Liu, Stephanie Schuckers (Clarkson University) Face in video recognition (FiVR) is widely applied nowadays. However, FiVR involves challenges such as high-volume data and real-time processing, as well as unsatisfactory face recognition (FR) accuracy. To overcome these challenges, this project focused on developing a machine learning assisted approach for predicting the face quality to improve the FR accuracy. This innovative approach for face quality evaluation is a key enabler for deploying FiVR in real-world scenarios, effectively reducing the amount of video data needed to be transmitted over a network. The technique introduces a face qualify assessment (FQA) module, after the face detection stage, but before the FR stage. A convolutional neural network model predicts the quality of the face image and selects the best quality face to be sent to the FR engine. The new approach reduces the amount of data sent to the back end for FR by 90%, and this in turn will improve the overall FR accuracy. The FQA tool is essential for achieving practical usage of FiVR by meeting the real-time processing requirements and high-accuracy demand for the deployment in real-world applications.
Michigan State University Led by Dr. Arun Ross as site director, Michigan State University has been approved by the National Science Foundation as a CITeR University site. Researchers at MSU specialize in privacy, security, natural language processing, genomics and forensics. MSU has been a strong contributor to CITeR since its founding; we look forward to the continued collaboration.
Idiap Research Institute
Key-Frame Extraction Engine Video Frames
Face Detection & Tracking Module
Detected Faces
CNN-based Face Quality Assessment Module
Extracted Key-Frame
Led by Dr. Sebastien Marcel as CITeR site director, the Idiap Research Institute has joined CITeR, becoming its first international site. Its Biometrics Security and Privacy (BSP) group conducts research on face/speaker/vein recognition, presentation attack detection and template security.
GPU Accelerated
C I Te R | 3
STUDENT HIGHLIGHTS | AWARDS
West Virginia University Min Jiang, PhD in Electrical Engineering, 2020. Hired by KLA Tencor as a Software Engineer.
Min Jiang
“During my PhD study, I worked on several CITeR projects, one of which was exploring the feasibility of analyzing body weight from twodimensional (2D) frontal-view human body images. My colleagues and I developed a computational method, which consists of feature detection and computation, for estimating body weight from body images. Our method outperforms two state-of-the-art facial image-based weight analysis approaches. Working on these CITeR projects enabled me to obtain knowledge of machine learning, computer vision and biometrics.”
SUNY Buffalo Ye Zhan, PhD in Biomedical Engineering (expected June 2020), SUNY Buffalo. Hired by Qualcomm to work on biometrics health monitoring technologies on wearable devices.
Ye Zhan
“I started to work on CITeR-funded projects in 2017. My first project, ‘Liveness Detection: Photoacoustic Imaging of a Mechanically Accurate Test Phantom Finger,’ led me to the field of photoacoustic-based biometrics. Later, my CITeR research project scope was broadened to include other optics and ultrasoundbased biosensing and biometric technologies. CITeR gave me an excellent opportunity to learn advances in the field through meetings and workshops. I am glad that my research experience helped me to secure a position at Qualcomm.”
Clarkson University Morgan Johnson, BS in Electrical Engineering, minors in Environmental Policy and Mathematics, 2019. Fulbright U.S. Student Program awardee; Slovak Republic, 2020-21 academic year. “When I was with CITeR, I published two papers: a first-author, peer-reviewed paper on a longitudinal study of the performance of iris recognition in children as they age; and a paper on using toe prints for biometric recognition. Each paper was among the first in the field focused on longitudinal analyses for children. I am looking forward to teaching English in Tisovec, Slovak Republic, in a technical secondary school during the Fulbright program. My hope is to empower students and help them determine their career paths.” Morgan Johnson
c i t e r. c l a r k s o n . e d u
FINANCIALS | OUTCOMES CITeR Income Summary 2015-19
NSF I/UCRC
$1,400,000
Affiliate $
$1,200,000
CITeR Fall 2018 Projects
$1,000,000
– Cross-Quality Face Matching, $40K.
$800,000
– Deep Virtual Facial Line-Up Using Soft Biometrics, $35K.
$600,000
– Developing a Benchmark Dataset for Automatic Detection of Facial Expressions, $40K. – Enabling Identity Assurance and Anti-Spoofing Capabilities for Non Person Entities in a Mobile Mesh Network via an Information Centric Approach, $40K. – Evaluating the Use of the M-VAC® Wet-Vacuum System to Recover DNA From Fabric, $45K. – Investigating the Advantages and Disadvantages of Near Infrared Light for Spoof Mitigation and Liveness Detection, $40K. – Online Learning for Face in Video Recognition, $43K. – Quantifying Benefits of 500 PPI vs. 1000 PPI for Fingerprint Matching, $40K. – Usage Scenario Oriented, Continuous User Authentication on Mobile Devices, 50K.
CITeR Spring 2019 Projects – Human Age Estimation Using Genomic Data, $40K. – Biometric Aging in Children Phase III, $40K.
$400,000 $200,000 $0
2015
2016
Year 2017
54
2018
57
2019
53
CITeR Citations
Year
total # of citations (all researchers)
2017
3242
2018
3245
2019
3529
Database Requests
Year
– Deep Profile-to-Frontal Face Verification in the Wild, $90K. – Estimation of Age of Children Based on Fingerprint Images, $50K. – Multimodal Data Collection to Support DoD Testing and Evaluation Projects (Special Project), $50K.
$50K
affiliate membership gains access to the community and a portfolio of in projects
$798K
2019
total # of publications (all researchers)
– Leveraging Biometrics and Smart Contracts to Control Access to Internet of Things, $35K.
– Adaptive Template Pooling for Set Based Face Recognition, $40K.
2018
CITeR Publications
– An End-to-End Deep Super-Resolution Face Recognition System in the Wild, $40K.
– Investigating A Hardness-Sensitive Tactile Fingerprint Scanner for Fake Finger Detection, $40K.
2017
# fulfilled requests (all universities)
2017
55
2018
57
2019
88 Books Selfie Biometrics: Advances and Challenges, A Rattani, R Derakhshani, A Ross, Springer Nature, 2019.
C I Te R | 5
citer.clarkson.edu Contacts Clarkson University Dr. Stephanie Schuckers Director 315-268-6536 sschucke@clarkson.edu
Affiliate Advisory Board Chair Laura Holsopple Managing Director 315-268-2134 lholsopp@clarkson.edu
West Virginia University Dr. Matthew Valenti Site Director 304-293-9139 matthew.valenti@mail.wvu.edu
Dr. Nasser Nasrabadi Site Co-Director 304-293-4815 nasser.nasrabadi@mail.wvu.edu
University at Buffalo Dr. Venu Govindaraju Site Director 716-645-3321 venu@cubs.buffalo.edu
Srirangaraj Setlur Site Co-Director 716-645-1568 setlur@buffalo.edu
Michigan State University Dr. Arun Ross Site Director 517-353-9731 rossarun@cse.msu.edu Idiap Research Institute (international site) Dr. SĂŠbastien Marcel Site Director +41 27 721 77 27 marcel@idiap.ch
c i t e r. c l a r k s o n . e d u
Kody West Technical Fellow Northrop Grumman Corporation Affiliate Executive Committee Terry Riopka Director of Research AWARE Inc. Chris Chamberlin Project Manager Office of Biometric Identity Management) Department of Homeland Security Reza Derakhshani Chief Scientist ZOLOZ Abbie Barbir Senior Security Architect Aetna Health Company