Vision Transformers, a new approach for high-resolution and large-scale mapping of canopy heights
FAYAD, Ibrahim
Kayrros
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
Kayrros
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
SCHWARTZ, Martin
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
Voir plus >
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
FAYAD, Ibrahim
Kayrros
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
Kayrros
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
SCHWARTZ, Martin
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
Laboratoire des Sciences du Climat et de l'Environnement [Gif-sur-Yvette] [LSCE]
Modélisation des Surfaces et Interfaces Continentales [MOSAIC]
D'ASPREMONT, Alexandre
Laboratoire d'informatique de l'école normale supérieure [LIENS]
Centre National de la Recherche Scientifique [CNRS]
Statistical Machine Learning and Parsimony [SIERRA]
Université Paris Sciences et Lettres [PSL]
Laboratoire d'informatique de l'école normale supérieure [LIENS]
Centre National de la Recherche Scientifique [CNRS]
Statistical Machine Learning and Parsimony [SIERRA]
Université Paris Sciences et Lettres [PSL]
PELLISSIER-TANON, Agnes
Processus d'Activation Sélective par Transfert d'Energie Uni-électronique ou Radiatif (UMR 8640) [PASTEUR]
< Réduire
Processus d'Activation Sélective par Transfert d'Energie Uni-électronique ou Radiatif (UMR 8640) [PASTEUR]
Langue
en
Document de travail - Pré-publication
Ce document a été publié dans
2023-04-22
Résumé en anglais
Accurate and timely monitoring of forest canopy heights is critical for assessing forest dynamics, biodiversity, carbon sequestration as well as forest degradation and deforestation. Recent advances in deep learning ...Lire la suite >
Accurate and timely monitoring of forest canopy heights is critical for assessing forest dynamics, biodiversity, carbon sequestration as well as forest degradation and deforestation. Recent advances in deep learning techniques, coupled with the vast amount of spaceborne remote sensing data offer an unprecedented opportunity to map canopy height at high spatial and temporal resolutions. Current techniques for wall-to-wall canopy height mapping correlate remotely sensed 2D information from optical and radar sensors to the vertical structure of trees using LiDAR measurements. While studies using deep learning algorithms have shown promising performances for the accurate mapping of canopy heights, they have limitations due to the type of architectures and loss functions employed. Moreover, mapping canopy heights over tropical forests remains poorly studied, and the accurate height estimation of tall canopies is a challenge due to signal saturation from optical and radar sensors, persistent cloud covers and sometimes the limited penetration capabilities of LiDARs. Here, we map heights at 10 m resolution across the diverse landscape of Ghana with a new vision transformer (ViT) model optimized concurrently with a classification (discrete) and a regression (continuous) loss function. This model achieves better accuracy than previously used convolutional based approaches (ConvNets) optimized with only a continuous loss function. The ViT model results show that our proposed discrete/continuous loss significantly increases the sensitivity for very tall trees (i.e., > 35m), for which other approaches show saturation effects. The height maps generated by the ViT also have better ground sampling distance and better sensitivity to sparse vegetation in comparison to a convolutional model. Our ViT model has a RMSE of 3.12m in comparison to a reference dataset while the ConvNet model has a RMSE of 4.3m.< Réduire
Mots clés en anglais
canopy height
GEDI
Sentinel 1
Sentinel 2
Vision Transformers
Deep learning
Knowledge distillation
Project ANR
PaRis Artificial Intelligence Research InstitutE - ANR-19-P3IA-0001
Origine
Importé de halUnités de recherche