SELF-ATTENTION GENERATIVE ADVERSARIAL NETWORKS FOR TIMES SERIES VHR MULTISPECTRAL IMAGE GENERATION

Ferdaous Chaabane, Safa Réjichi, Florence Tupin

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Recently classical deep learning approaches are commonly used to perform spatial and temporal classification especially for Very High Resolution (VHR) images. They learn from existing low resolution or undersized datasets because of the availability and prices of VHR remote sensing images. Thus, they have witnessed a conspicuous success because it is quite challenging to classify high-dimensional multispectral time series data with few labeled samples. It is also difficult to simulate high quality samples having the same features as the real ones. It goes without saying that the introduction of GANs (Generative Adversarial Network) models as an unsupervised learning method, has allowed the extraction of accurate representations of the data via latent codes and back-propagation techniques. However, it is difficult to acquire high-quality samples with unwanted noises and uncontrolled divergences. To generate high-quality multispectral time series samples, a Self-Attention Generative Adversarial Network (SAGAN) is proposed in this work. SAGAN allows attention-driven, long-range dependency modeling for VHR Multispectral time series image generation tasks. Traditional convolutional GANs generate high-resolution details as a function of only points in lower-resolution feature maps. In SAGAN, details can be generated using cues from all feature locations which improves training dynamics. The proposed SAGAN performs better than traditional GANs, boosting the best inception score. The main contribution of this work is the use of one of the new generation of learning techniques, SAGAN, for Times Series VHR Multispectral Image Generation. SAGAN has been recently used only for single image generation.

Original languageEnglish
Title of host publicationIGARSS 2021 - 2021 IEEE International Geoscience and Remote Sensing Symposium, Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages4644-4647
Number of pages4
ISBN (Electronic)9781665403696
DOIs
Publication statusPublished - 1 Jan 2021
Event2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021 - Brussels, Belgium
Duration: 12 Jul 202116 Jul 2021

Publication series

NameInternational Geoscience and Remote Sensing Symposium (IGARSS)
Volume2021-July

Conference

Conference2021 IEEE International Geoscience and Remote Sensing Symposium, IGARSS 2021
Country/TerritoryBelgium
CityBrussels
Period12/07/2116/07/21

Keywords

  • Deep learning techniques
  • Etc
  • Multispectral VHR time series
  • Self-attention generative adversarial networks

Fingerprint

Dive into the research topics of 'SELF-ATTENTION GENERATIVE ADVERSARIAL NETWORKS FOR TIMES SERIES VHR MULTISPECTRAL IMAGE GENERATION'. Together they form a unique fingerprint.

Cite this