Assessing Face and Iris Acquisition

1. Assessing Face and Iris Acquisition Ross Micheals Charles Sheppard

2. Tasks • Component of 10-print study • One image each of participant face, left iris, right iris • Two iris cameras • Sensor A—Participant looked straight ahead, minimized amount of proprietary filtering • Sensor B—Participant interacted with camera (lined self up with mirror)

3. Context • Minimum instructions (demo & basic documentation given to operators) • Representative of applications lacking strict control • Goal was qualitative assessment of data • Effectiveness • Efficiency • User Satisfaction

4. Effectiveness • Goal is to measure image “quality” • Ill-posed problem—depends on application • No generally accepted definition (i.e., sample? Metadata? • Therefore, we considered a wide variety of factors

5. Face • Source: ANSI INCITS 385-2004 • Tools • Face Alignment Overlay • Transformed each factor into … • Simple categories (yes, no, N/A) OR • Counts OR • Standard five-point Lichert Scale

6. Face Alignment Overlay * *Images have been altered for privacy reasons

7. Measurable Qualitative Attributes for Face Images • Eye color • Hair color • Pose • Expression • Assistance in positioning face • Shoulders • Background • Subject and scene lighting • Shadows over the face • Shadows in eye-sockets • Hot spots • Eye glasses • Eye patches • Radical distortion of the camera lens • Horizontally centered face • Vertical position of the face • Width of head • Length of head • Facial hairs* • Obstruction*

8. Face Statistics

9. Pose • Not full frontal (wearing head gear, top of head chopped off) • Not full frontal (completely chopping off of a shoulder) • Not full frontal (head turn at angle) • Full frontal (not centered) • Full frontal (centered) *Images have been altered for privacy reasons

10. Expression Eyes looking away from camera and/or squinting A smile were mouth opened and teeth exposedNot full frontal (head turn at angle) A closed jaw smile (no teeth showing) Neutral (non-smiling) with both eyes open and mouth closed *Images have been altered for privacy reasons

11. Shoulders Indeterminate squaring (excessive chopping) of shoulder Indeterminate squaring (not enough shoulder shown) Square shoulders (uneven chopping of shoulders) Square shoulders (almost even chopping of shoulders) Square shoulders (even chopping of shoulders) *Images have been altered for privacy reasons

12. Background Poor segmentation and lack of uniformity (several visible objects in background) Poor segmentation and lack of uniformity (three or four objects in background) Poor segmentation and lack of uniformity (two or three objects in background) Poor segmentation and lack of uniformity (one object in background) *Images have been altered for privacy reasons

13. Subject and Scene Lighting Lighting not distributed equally on face (excessive shadows caused by head gear) Lighting not distributed equally on face (excessive shadows caused by poor lighting) Lighting not distributed equally on face (fewer shadows) Lighting is distributed almost equally on face *Images have been altered for privacy reasons

14. Shadows over the Face Excessive shadows caused by head gear Large areas of shadows caused by poor lighting Fewer shadow areas caused by better lighting Only in the eye-sockets No shadows *Images have been altered for privacy reasons

15. Shadows in Eye-sockets Shadows in both eye-sockets (caused by head gear) Shadows in both eye-sockets (caused by poor sighting) Shadows in only one eye-socket Very little shadow in either eye-socket No shadows in eye-sockets *Images have been altered for privacy reasons

16. Hot Spots There are multiple areas of hot spots (three or more) There are one or two hot spots Only one softly lighted hot spot No hot spots *Images have been altered for privacy reasons

17. Eye Glasses There is glare from the lenses and shadow casting by the rims There is a small amount of glare No glasses *Images have been altered for privacy reasons

18. Horizontally Centered Face Severe chopping of image or excess amount of space on one side There is a larger amount of space on one side than the other There is a small amount of difference in the spacing on one side versus the other There is a very small amount of difference in the spacing on one side versus the other There is perfect centering *Images have been altered for privacy reasons

19. Vertical Position of Face A large amount of head tilting A small amount of head tilting (eyes are off the horizontal) A very small amount of head tilting (eyes slightly off the horizontal) No head tilting (eyes are perfectly on the horizontal) *Images have been altered for privacy reasons

20. Width of Head Part of the head is chopped off The image is chopped too close to the head Part of the person's hair is chopped off The head is turned slightly causing an ear to be out of sight There is adequate head width *Images have been altered for privacy reasons

21. Length of Head There is head gear or the chopping off of the top the head The image is chopped very close to the top of the head There are sunglasses on top of the head or part of the hair on top of head is chopped off There is adequate head length *Images have been altered for privacy reasons

22. Obstruction Some form of head gear (hat, cap,….) Sun glasses on top of head or head band Eye glasses on top of head There are no obstructions *Images have been altered for privacy reasons

23. Iris • Source: ANSI INCITS 379-2004 • Tools • Iris Overlay • Transformed each factor into … • Simple categories (yes, no, N/A) OR • Counts OR • Standard five-point Lichert Scale

24. Iris Overlay Example

25. Measurable Qualitative Attributes for Iris Images • Location of reflections • Glasses • Focus • Visible Iris • Image scale • Noise • Image Orientation • Camera type

26. Iris Statistics

27. More Iris Statistics

28. More Iris Statistics

29. Segue • Before moving on, consider the following. “When does 5315?” • Answer is, “when we talk about…” • Efficiency!

30. Efficiency • Deceptively ill-posed • Example: “How long does a photo take?” • Average camera shutter speed is .001 second • Implies we can take photos of 1,000 people in 1 second • Despite this obviously flawed leap in logic, we continue to make this mistake

31. Efficiency • 10-Print Working Group RFI—Intended requirement is five seconds from placement of hand to capture • Therefore, must a 4-4-2 sequence happen in under 15 seconds? (i.e., 5315) • Just as on the fingerprint side, our approach was to timestamp at a variety events—allows more flexible reporting • However, there is a compromise between what you would like to measure for each participant, and what you can measure

32. Pictureand Iris Scan Process Sit Down Picture Taken Picture Process Done with Picture Moves to Iris Scanner Start of Iris Scan Finish with Eye 1 (Scanner B Only) Start of Eye 2 (Scanner B Only) Iris Scanning Process Finished Time

33. Scanner-A Timing

34. Scanner-A Timing

35. Scanner-B Timing

36. Scanner-B Timing

37. Face Picture Timing

38. Large-scale Biometric System Data

39. User-satisfaction