URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR

1. URBAN AREA PRODUCT SIMULATION FOR THE ENMAP HYPERSPECTRAL SENSOR P.Gamba, A. Villa, A. Plaza, J. Chanussot, J. A. Benediktsson

2. OUTLINE • Introduction • The EnMap sensor • Experimental test • Conclusions and perspectives

3. INTRODUCTION Urban remote sensing is a crucial task : • Monitoring cities development • Infrastructure extraction • Land cover mapping • Satellites provide cheap and timely data Main challenges : • Urban land cover classes not well distinct • Heterogeneous areas lead to mixed pixels Can hyperspectral data be helpul for such a task?

4. INTRODUCTION Can hyperspectral data be helpul for urban monitoring? • Pro: very detailed spectral information of the scene • Con: tradeoff between spectral and spatial resolution (~tens of meters) A number of hyperspectral missions already planned: • PRISMA – ASI, 2014 (spatial res: 30 m) • EnMap – DLR, 2014 (spatial res: 30 m) • Hyper-J (JAXA) and HyspIRI (NASA) in the next future.. Need to assess the effectiveness of hyperspectral data for urban monitoring!

5. AIM OF THE WORK • Preliminary investigation of hyperspectral sensors potentialities: - Can urban structures be monitored with hyperspectral sensors? - Is the rich spectral information of hyperspectral data useful for such a task? • Two main issues addressed: 1) Creation of realistic urban scenes by considering EnMap PSF 2) Comparison with classical and advanced methods

6. OUTLINE • Introduction • The EnMap sensor • Experimental test • Conclusions and perspectives

7. EnMapmission • Dedicated imaging pushbroom hyperspectral sensor mainly based on modified existing or pre-developed technology • Broad spectral range from 420 nm to 1000 nm (VNIR) and from 900 nm to 2450 nm (SWIR) with high radiometric resolution and stability in both spectral ranges • Swath width 30km at high spatial resolution of 30 m x 30 m and off-nadir (30°) pointing feature for fast target revisit (4 days) • Sufficient on-board memory to acquire 1.000 km swath length per orbit and a total of 5.000 km per day. S. Kaiser , B. Sang , J. Schubert , S. Hofer and T. Stuffler: "Compact prism spectrometer of pushbroom type for hyperspectral imaging",  Proc. SPIE Conf. Imaging Spectrometry XIII,  vol. 7100,  p.710001, 2008. 

8. SYNTHETIC REALISTIC IMAGES • Create realistic hyperspectral images by downscaling the spatial • resolution according to the EnMap PSF EnMap PSF (900 nm) Spatial resolution degradation Original image Low resolution image

9. CLASSIFICATION COMPARISON 2) Evaluate the performances of traditional methods and sub-pixel techniques in terms of land cover classification SVM Classification map SVM-SU1 Classification map at finer resolution Low resolution image • Villa et al., Spectral Unmixing to obtain classification maps at a finer resolution, Journal of Selected Topics in Signal Processing, 2011

10. SVM - SU SVM – Spectral Unmixing(*): 1) Probabilistic SVM determines which pixels can be considered as pure (if prob > treshold) 2) Spectral unmixing is used to retrieve class abundances within mixed pixels 3) Final spatial regularization (*)A. Villa, J. Chanussot, J.A. Benediktsson and C. Jutten., Spectral Unmixing to obtain classification maps at a finer resolution, Journal of Selected Topics in Signal Processing, vol. 5, n. 3, May  2011

11. SVM - SU SVM – Spectral Unmixing: 1) Probabilistic SVM determines which pixels can be considered as pure (if prob > treshold) • Spectral unmixing is used to retrieve class abundances within mixed pixels and to fill “upsampled” sub-pixels 3) Final spatial regularization

12. SVM - SU SVM – Spectral Unmixing: 1) Probabilistic SVM determines which pixels can be considered as pure (if prob > threshold) 2) Spectral unmixing is used to retrieve class abundances within mixed pixels and to fill “upsampled” sub-pixels 3) Final spatial regularization is performed (Cost function to be minimized: total perimeter of the connected areas ) The results is a thematic map at a finer resolution useful to assess possibilities offered by HSI at low-medium spatial resolution.

13. OUTLINE • Introduction • The EnMap sensor • Experimental test • Conclusions and perspectives

14. DATA SET • ROSIS Center data set: • 1096 x 712 pixels, 102 spectral bands • Spatial resolution: 1.3 meters • Spatial resolution decreased of a factor 3 and 5 • Classification with SVM and SVM-SU, 100 samples per class.

15. EXPERIMENTS

16. THEMATIC MAPS SVM on LR data 70.97% SVM on original HR data (ground truth) Finer Classification 74.32%

17. THEMATIC MAPS SVM on LR data 70.97% SVM on original HR data (ground truth) Finer Classification 74.32%

18. EXPERIMENTS • Preliminary conclusions • - Evenslightspatialresolutiondegradationleadsto a significantclassification • accuracydecrease • --Sub-pixel information of HSI ishelpful to improveclassificationaccuracy • -- Potentialities of hyperspectral data dependon the desiredapplication

19. OUTLINE • Introduction • The EnMap sensor • Experimental test • Conclusions and perspectives

20. CONCLUSIONS • Conclusions • - Low spatial resolution is a major challenge in urban environment • → Hard to perform urban monitoring with hyperspectral sensors • --Additional spectral information useful if properly exploited • → Need for advanced techniques to study sub-pixel information • Perspectives • Consider more realistic models (more PSFs, geometric distortions..) • - Investigate lower spatial resolution (comparable to HSI) • - Further investigations of the possibilities offered by sub-pixel methods