Fingerprint Recognition

The backgrounds
Dr.ir. Asker M. Bazen

Contents
Introduction to fingerprint recognition Features and algorithms Fusion and search Spoofing, robust templates,

Biometric Market

New Applications
Large-scale fingerprint search systems for immigration and border control
Large databases (10M 500M persons), multiple prints Watch lists, no cooperation, FRR important Many searches, real-time, hardware restrictions Fully automatic (compare to forensic applications)

Examples
DHS / US-VISIT VIS-BMS Passport duplicate checks

Competitive Landscape
Four big AFIS vendors, 100 200 MEuro turnover each High entrance threshold for start-ups (trust & credibility) Cogent
US-VISIT, top-rated algorithm

NEC
Highly rated finger and palm algorithms Loosing market share

Sagem
EU-BMS, market leader Subsidiary to a struggling company

Motorola
Part of strong company, good contacts with government Product rates second tier

Uniqkey Biometrics
Provider of large scale fingerprint biometric database search technology Multi-stage fingerprint search system
Shape matching Minutiae matching Ridge line matching

Combine algorithms
Robustness, accuracy, speed

Differentiators
100x faster search (reduced hardware, real-time application) Scale from 1 10 prints Incremental accuracy increase (2x 5x)

Decisions and Errors

Biometric Essentials: Variations

Differences between persons
Information for recognition

Differences between samples

Perfect recognition impossible

Threshold
Sufficient similarity instead of identical

Error rates
FAR FRR FTE

Fingerprint Variations
Gray-scale variations (image quality)
pressure variation scratches dry or wet fingers

Shape variations
different part of finger translation, rotation, scaling elastic deformations

Error Rates in Practice

Face high-quality (FRVT 2006)
FRR = 1% at FAR = 0.1%

Face medium-quality (FRVT 2006)

FRR = 15% at FAR = 0.1%

Iris (ICE 2006)

FRR = 1% at FAR = 0.1%

Fingerprint 1-print (FpVTE 2003)

FRR = 0.6% at FAR = 0.01%

Fingerprint 4-print (FpVTE 2003)

FRR = 0.1% at FAR = 0.01%

Fingerprint Recognition Accuracy

FpVTE 2003
1-print: FRR = 0.5% at FAR = 0.01% 4-10 prints: FRR = 0.1% at FAR = 0.01%

UKPS 2005
FTE = 3%, FRR = 16%

BPR 2005
FRR = 7.2% (2 of 2), 2.9% (1 of 2) FTE = 3.2% (2 of 2), 1.9% (1 of 2)

Fingerprint Capturing

Acquisition of Fingerprints
Traditionally
paper en ink rolled Forensic

Present
sensor connected to computer dab commercial

Ink versus Scan

Scan

Inked

Atmel Sweepee

digitalPersona U.are.U

Polaroid

Fingerprint Recognition

Fingerprint Recognition
Curved lines
ridges en valleys

Global shape
Directional field,

Local details
minutiae

Minutiae versus Shape

Minutiae matching
Bifurcations and endpoints of ridge lines Traditional approach Mimic human comparison Complex matching process Slow (up to 50k matches per second)

Shape matching
Global direction of ridges etc New approach Computer oriented Simple matching process Fast (up to 10M matches per second)

Minutiae Matching

Minutiae Matching
Extract features
Minutiae: bifurcations and endpoints of ridge lines

Register (align) fingerprints

Based on minutiae

Count corresponding minutiae

Same location within a threshold

Determine matching score

E.g. ratio of corresponding versus total number of minutiae

Illustration of elastic distortions

Elastic Deformations
Cause
3D elastic finger surface is pressed on 2D flat sensor

Effects
distortions in the shape of the fingerprint prints of the same finger dont fit exactly decrease of matching performance

Effect of Elastic Distortions

Two fingerprints superimposed Registered as well as possible
Translation, rotation, scale

Corresponding minutiae displaced

Solutions
Traditional solution
Decrease required amount of similarity Larger tolerance at borders or only local matching Exchange FRR for FAR

Theoretic solution
Invert elastic deformations Un-deformed reference unavailable

Alternative solution
Estimate and compensate for relative deformations between fingerprints Feasible

Elastic Matching Principles

Compensate for relative deformations
True distortion inversion not possible

Problem:
Elastic model estimation Corresponding points needed But that is part of the matching

Solution: two stages

Local matching Global matching

Local Matching
Minutiae neighborhoods
multiple neighborhoods per minutia: tolerate false and missed minutiae

Match (Rotation, Translation, Scaling)

compare locations and orientations local neighborhoods hardly deformed

Result: list of local matches

including false local matches

Global Matching
Find cluster of local matches
Discard false local matches

Fit approximating elastic model to local matches

Iterative fit

Transform fingerprint
Better fit, lower threshold, better performance Elastic model: deformations Threshold: displaced minutiae

Elastic Matching Results

Elastic Registration Results

Elastic Registration Results

Shape Matching

Shape Matching
Compare global fingerprint shapes
Direction of ridges, etc.

Shape Matching
No discrete classes (compare to 5 Henry classes)
No classification errors, so lower false reject More discrimination, so lower false accept

Fixed-length feature vector

Computer oriented Fast algorithm (more than 1M matches / second)

Statistical shape models

Within-class variations Between-class variations

Directional Field

Gabor Response
Gabor filters different 4 orientations Determine local energy

Fingerprint Shape

FullShape

Fusion

Multi-Modal

Fusion Improves Error Rates

Minutiae

Fused threshold

Minutiae threshold

Shape

Multiple Fingers (n-Print)

Accuracy
Lower error rates Search larger databases

Robustness
Lower FRR for worn-out prints (low image quality) Especially then more info needed

Spoofing
Harder to spoof multiple fingers

Database Search

Requirements 1:n Systems

Large databases
100 million +

Low error rates

FAR1:n < 0.1%, FRR < 1%

High performance
T < 2 seconds (online), T < 1 hour (offline)

Acceptable costs
C < few $ per entry

Fast Fingerprint Search

Two algorithms
Shape matching (Uniqkey Biometrics) Minutiae matching (Any vendor)

Database search
Multi-step approach Each step eliminates part of database

Benefits
Faster More accurate

Uniqkey Search System

Query 10-print Integrated AFIS

Match Shapes If match Match Minutiae If match

Iterate database

S1, M1 S2, M2 Sx, Mx Shape and Minutiae database

MATCH

Uniqkey Search Example

Minutiae Shape [CPU sec] Minutiae [CPU sec] Total [CPU sec] Speed Improvement 10M ten-print database, 40k minutiae matches per second, 5M shape matches per second, 1 /1000 filter efficiency. Average numbers on desktop environment. Exact numbers depend on image quality and architecture. Shape template size 200 600 bytes. 2 500 2 500 Shape / Minutiae 20 3 23 100

Robust templates

Motivation
Construct reliable template from multiple unreliable prints
Enrolment Operational use

Effect
Higher robustness and lower error rates Track changes in appearance of fingerprint image

Variations
Partial overlap Image quality Elastic deformations Etc

Approach 1: Multiple Templates

Store multiple templates per fingerprint Match with all individual templates Simple, robust, may be sub-optimal Template selection to reduce number of templates
Storage and speed

FRR decreases by factor of 2

Approach 2: Feature Combination

Extract features from individual fingerprints Then combine feature vectors Fixed length vectors (shape, wavelets, Gabor, etc.)
Averaging

Minutiae
Minutiae matching approach Select reliable minutiae

Approach 3: Image Mosaicking

Combine fingerprint images Then (re-)extract features Requirement
Extremely accurate registration (minutiae, gray scale) Compensation for elastic deformations

Effect
Larger fingerprint area Higher image quality

Typical application: passports

Images required

Spoofing

Spoofing
Relatively simple
Die + paint / gel Ton van der Putte

With cooperation
10 minutes 10 Euro

Without cooperation
30 minutes 25 Euro

Anti Spoofing
Detection by scanner
Most scanners easily mislead Race between spoofing and anti spoofing

Software
Transpiration patterns Still being developed

Supervision / awareness
Effective Contact needed Multiple fingers

Contact Information
Dr.ir. Asker M. Bazen Uniqkey Biometrics Graafvorkhoek 22 7546 KK Enschede The Netherlands Phone: Fax: Email: +31 6 4411 8554 +31 8 4220 2067 a.m.bazen@uniqkey.com