1 / 24

NATURAL COLOR CONSTANCY

NATURAL COLOR CONSTANCY. Qasim Zaidi SUNY College of Optometry Hannah Smithson University College London Byung-Geun Khang Utrecht University. COLOR CONSTANCY [L ichtenberg , Letter to Goethe on “Farbige Schatten” , 1793]

davesm
Télécharger la présentation

NATURAL COLOR CONSTANCY

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. NATURAL COLOR CONSTANCY Qasim Zaidi SUNY College of Optometry Hannah Smithson University College London Byung-Geun Khang Utrecht University

  2. COLOR CONSTANCY • [Lichtenberg, Letter to Goethe on “Farbige Schatten” , 1793] • The objects we call white are the ones we infer would be colorless if they were illuminated by a colorless light. In reality all illuminants are spectrally selective, especially inter-reflected light. • Dueling definitions: • Constancy of subjective appearance • Inference of physical invariants • Identification strategies: • Under limited conditions, appearance is constant. 1st-order similarity (between colors) is useful for identification of materials/objects. • In general, appearance is not constant. Observers use 2nd-order similarity (between color differences) to identify materials. • If neither similarity is applicable, accurate identification is not possible

  3. Physical basis of color constancy? For natural reflectance spectra, the “color conversion” (Helson) between two illuminant conditions is simply multiplicative when expressed in terms of cone-coordinates, hence rank-orders are preserved (Dannemiller; Nascimento & Foster; Zaidi, Spehar & DeBonet).

  4. Requirements for 1st-order similarity based color constancy To achieve a constant color of an object despite changes in the spectrum of the light reflected from that object, reverse the color conversion to “transform” (Helson) the perceived colors of objects under a test illuminant towards the colors of objects under a reference illuminant: Adaptation to illuminant coordinates (Ives) Rank orders anchored across a reference material (Helson)

  5. In post-receptoral cordinates, the “color conversion” is translational for L/(L+M), and multiplicative for S/(L+M). For identification based on 1st-order similarity: Adaptation to illuminant coordinates Rank orders anchored across the mean Will be as effective at a post-receptoral level as at receptors.

  6. Is there constancy of color appearance under adaptation to single illuminants? Observer’s task: Session 1: Classify the appearance of square patch (3 deg) as red or green Session 2: Classify the appearance of square patch as yellow or blue

  7. EXPERIMENT 1 Tests (circles) Chromatically balanced background (plusses) 0.04 0.04 0.02 0.02 0.60 0.65 0.70 0.60 0.65 0.70 Sunlight illuminant S/(L+M) L/(L+M) Skylight illuminant S/(L+M) L/(L+M)

  8. Time Trials continue until a response has been collected for all materials Fixed trial duration 1.5 seconds Initial adaptation period 80 trials, no response Procedure for each illuminant and background set:

  9. 0.04 0.02 0.60 0.65 0.70 0.60 0.65 0.70 EXPERIMENT 1 Single-trial classifications obtained from one observer “Red / Green” judgement “Blue / Yellow” judgement S/(L+M) L/(L+M) L/(L+M)

  10. EXPERIMENT 1 Classification boundaries in chromaticity & reflectance spaces Red lines: boundaries under sunlight Blue lines: boundaries under skylight. Circles: corresponding illuminants Chromaticities Reflectances S/(L+M) HES HES 0.04 • Illuminant has a large effect on the location of color boundaries in chromaticity space, but similar reflectances fall on color boundaries under both illuminants. • Constancy indices 0.87, 0.68, 0.93 for the three observers. • Appearance-based color constancy could result from spatially extended adaptation, or illuminant estimation using the mean. 0.02 S/(L+M) HS HS 0.04 0.02 S/(L+M) JEM JEM 0.04 0.02 0.60 0.65 0.70 0.60 0.65 0.70 L/(L+M) L/(L+M)

  11. 0.04 0.04 0.02 0.02 0.60 0.65 0.70 0.60 0.65 0.70 EXPERIMENT 2 Single illuminants on chromatically biased backgrounds Sunlight illuminant Red-blue bias Green-yellow bias S/(L+M) L/(L+M) Skylight illuminant S/(L+M) Red-blue bias Green-yellow bias L/(L+M)

  12. EXPERIMENT 2 Classification boundaries with red-blue backgrounds Red lines: boundaries under sunlight Blue lines: boundaries under skylight. Circles: corresponding illuminants Chromaticities Reflectances S/(L+M) HES HES 0.04 • Illuminant has a large effect on the location of color boundaries in chromaticity space, but similar reflectances fall on color boundaries under both illuminants. • Constancy indices 0.87, 0.81, and 0.95 for the three observers. • Appearance-based color constancy could not be a result of spatially extended adaptation, or illuminant estimation using the mean. 0.02 S/(L+M) HS HS 0.04 0.02 S/(L+M) JEM JEM 0.04 0.02 0.60 0.65 0.70 0.60 0.65 0.70 L/(L+M) L/(L+M)

  13. EXPERIMENT 2 Classification boundaries with yellow-green backgrounds Red lines: boundaries under sunlight Blue lines: boundaries under skylight. Circles: corresponding illuminants Chromaticities Reflectances S/(L+M) HES HES 0.04 • Illuminant has a large effect on the location of color boundaries in chromaticity space, but similar reflectances fall on color boundaries under both illuminants. • Constancy indices 0.87, 0.81, and 0.95 for the three observers. • Appearance-based color constancy could not be a result of spatially extended adaptation, or illuminant estimation using the mean. 0.02 S/(L+M) HS HS 0.04 0.02 S/(L+M) JEM JEM 0.04 0.02 0.60 0.65 0.70 0.60 0.65 0.70 L/(L+M) L/(L+M)

  14. Comparison of Experiments 1 and 2 Effect of mean background chromaticity Chromaticities Reflectances BACKGROUNDS Balanced (black lines) Red-blue (purple lines) Green-yellow (lime lines) Pluses: mean chromaticities S/(L+M) HES HES 0.04 0.02 S/(L+M) HS HS The chromaticity of the background has little effect on the location of color boundaries in chromaticity space, indicating that the constancy process is unlikely to be spatially extended. 0.04 0.02 S/(L+M) JEM JEM 0.04 0.02 0.60 0.65 0.70 0.60 0.65 0.70 L/(L+M) L/(L+M)

  15. Experiment 3 Conflicting illuminants on test and balanced background Test: Skylight Background: Sunlight Test: Sunlight Background: Skylight

  16. EXPERIMENT 3 vs 1 Classification boundaries with conflicting illuminant Red lines: boundaries under sunlight Blue lines: boundaries under skylight Circles: corresponding illuminants Dashed lines: consistent illuminant Chromaticities S/(L+M) HES 0.04 0.02 • Appearance constancy is a result of a spatially local but temporally extended process: • Local adaptation with either long time constants or gated by attention to the test. • Illuminant estimation using spatially local statistics collated over time. • Test appearance anchored on test mean. S/(L+M) HS 0.04 0.02 S/(L+M) JEM 0.04 0.02 0.60 0.65 0.70 L/(L+M) Constancy indices 0.70, 0.45, and 0.82 for the three observers.

  17. Lichtenberg’s game: Color identification without appearance constancy Can you identify trees of similar foliage across sun and shade? How do you know which parts are sunny or shady?

  18. Three patches are from the same material while one is different. • Illumination on the right is skylight, on the left is sunlight. Which is the odd material?

  19. % SIDE CORRECT: Discrimination within each illuminant % OBJECT CORRECT: Identification across illuminants • Mean color of standards: red, green, yellow, blue, magenta, cyan. • 6 standards x 5 distractors x 2 daylights x 6 deltas x 10 reps, • Method of constant stimuli • DELTA is distance between standard and distractor.

  20. MATERIALS IDENTIFICATION VS DISCRIMINATION In most cases, observers can identify materials across illuminants almost as well as they can discriminate materials within the same illuminant. Cases where identification is considerably worse provide cues to judgment strategies.

  21. ACCURATE IDENTIFICATION PERFORMANCE IN THE ABSENCE OF APPEARANCE CONSTANCY • Color conversions contain information about object invariances and illuminant color shifts. • This information can be used for material and illuminant identification: • Affine-heuristic (translation & multiplication) based algorithms • Second-order color similarities: similarity between color differences. • Rank orders will give correct identification only if material statistics are constant across illuminants.

  22. Affine heuristic based algorithm L/(L+M) Solve correspondence problem for a subset of reflectances under equal-energy light with the superset under skylight. Errors should reflect divergence from affine transform.

  23. IDENTIFICATION BASED ON 2ND-ORDER SIMILARITY Color differences between tests vs differences between backgrounds Means of Material Chromaticities Errors will depend on the nature of judging 2nd-order similarities: RED and BLUE will be confused if observers judge deviations from directions of color vectors better than lengths of color vectors?

  24. JUDGMENT STRATEGIES FOR COLOR IDENTIFICATION As a result of spatially local processes, material identification within single-illuminant conditions can be based on first-order similarity. Material identification across multiple illuminants is based on second order similarities. Even if the spatially local process underlying appearance constancy is retinal adaptation, inferences about color invariants of natural objects require 2nd-order judgments that are probably cortical.

More Related