:::: MENU ::::

ESA SEOM-S2-4Sci Land and Water Multitemporal Analysis (MTA)

SEOM program

The “S2-4Sci Land and Water – Multitemporal Analysis” initiative was launched in the context of the “Scientific Exploitation of Operational Missions” (SEOM) program. The program aims at favouring: i) research and development studies, ii) development of toolboxes, iii) interaction between scientists and users; iv) training of new generation scientists in the field of Earth Observation (EO); and v) the outcomes of research in terms of data and results. These needs emerge because a very large number of images are now available to either the scientific and user communities from past/current EO missions (e.g., ERS, Landsat) and even more will be available due to the upcoming EO missions. Among those the Copernicus Sentinel program will contribute with an exponential growth of data of a large variety. This opens to an unpredictable wide range of possibilities. Among the various Sentinels, the “S2-4Sci Land and Water – Multitemporal Analysis” project focuses on the Sentinel-2 (S-2) family to perform advanced multitemporal analysis.

Multitemporal Analysis (MTA) Project

The intrinsic multitemporal nature of satellite Remote Sensing (RS) images is a high valuable property that can be used to perform accurate monitoring of the Earth’s surface and atmosphere. However, handling the time variable together with the spectral and spatial one is a complex task. For this reason, the development of advanced methods for the analysis of multitemporal data is one of the most important and complex task of the RS community.

Having 13 spectral bands, 10 to 60 m spatial resolution and a revisit time of 5 days upon complete constellation, S-2 guarantees an enhanced continuity to SPOT and Landsat missions. Due to the high temporal resolution, S-2 generates dense time series of images with a worldwide coverage. This increases the potential of analyzing dynamic phenomena and extracting multitemporal information, as well as to have a frequent coverage also in areas that maybe affected by cloud cover. With respect to previous similar missions (e.g., Spot and Landsat), S-2 provides optical images with higher spatial, temporal and spectral resolutions. In the domain of multitemporal information extraction this represents a great improvement with respect to the past, that opens to a wide range of new possibilities in the field of multitemporal analysis.

In this context, the MultiTemporal Analysis (MTA)  project is designed  to define techniques and algorithms tailored on the specific properties of S-2. The project aims at developing emerging methods for advancing the technical knowledge and capacity to analyse S-2 data and provides a series of tools to better exploit S-2 temporal information in the future.

For more information about S-2 mission and SEOM program please visit:

Application Areas

In the context of ESA S2-4Sci Land and Water  SEOM study, the MTA project investigates tree main application and methodological areas:

  • Time series analysis: the potential offered by the S-2 series, in terms of dense time series of data, opens the door to the development of new and advanced techniques for the joint analyses and classification of time series of data. The methods should aim at identifying and classifying temporal patterns and spatial/temporal land cover transitions in the S-2 multitemporal dataset.
  • Change detection and attribution: due to the increased revisit time of S-2 satellite, it is necessary to develop land cover change detection strategy suitable for S-2 data that may allow a systematic identification and attribution of changes in land cover at large scale.
  • Land cover maps updating : the regular generation of land cover classification maps (specially at global scale) is a complex and time consuming problem that if done independently (different maps computed independently in different times) may affect the temporal consistency of the land cover information and even the impossibility to compare them in time. The regular update of a reference map based on multitemporal analysis may overcome some of the methodological problems to be faced ad may enhance the temporal consistency of the obtained results.

According to the project requirements, the final methods should be automatic to require small interaction with the user. Moreover, the final implementation should be scalable to work easily on large images.

Project Planning

The project activities are split into three main task:

  • Methodology Development: is devoted to a comprehensive and detailed analysis of the state of the art and of the relevant projects. The test areas and the preliminary methodologies to be developed are investigated in this task.
  • Algorithm Implementation: is devoted to the implementation and testing of the algorithms identified by Task 1 and the validation of the resulting output products. To this end a cyclic workflow approach that includes a continual development-validation-feedback loop is considered in the implementation phase.
  • Result Analysis: documents and provides a critical analysis of the feedback from scientists and institutions collected through consultations in ESA and third party workshops, symposia, and conferences. On the basis of the feedback a Scientific Roadmap document will be developed that identifies the scientific priority areas and provides the guidelines for future scientific data exploitation projects.

Project Objectives

The overall science objectives of the MTA project are:

  • Time series analysis: to perform precise agricultural analysis to fully exploit the specific properties of S-2 images. Precision agriculture generally involves better management of farm inputs such as fertilizers, herbicides or seeds. Typically, large farm fields under conventional management receive uniform applications of fertilizers, irrigation or seeds. In the framework of the precision agriculture, these fields can be divided into zones receiving customized inputs based on varying soil types, landscape position, and management history.
  • Change detection and attribution: to perform binary detection of forest changes (disturbances) mainly related to deforestation (clear cuts and logging) in bi-temporal S-2 image pairs. The deforestation problem is gaining more and more attention because of its dramatic extension and many associations are working for providing specific information for monitoring purposes.
  • Land cover maps updating: to use S-2 images to update existing thematic land-cover maps without ground reference data (unsupervised case). In the considered application, the image used to generate the existing map is considered unknown. Due to the recent S-2 launch, few thematic maps obtained with these data are currently available. Thus, the team is also investigating the possibility of updating existing maps generated with different RS data.

Case Studies

Time series analysis

Dense time sampling increases the sensitivity to dynamic phenomena and provides a better description of them. With the increased revisit period of the complete S-2 constellation (return frequency up to 5 days), it is possible to perform accurate seasonal trend analysis. In this framework, specific applications regarding low cost precision agriculture is of great interest given that S-2 has specific bands in the Red-Edge spectral range dedicated to the study of vegetation that were not available in previous multispectral sensors (e.g., Landsat, SPOT). In the time series methodological area, the focus is set on the monitoring of irrigation of agricultural areas.

Change detection and Attribution

Change detection has been widely used to assess  land use/land-cover changes. Among them, one of the most interesting is the analysis of forest changes, where the introduction of new imagery from the S-2 satellite is expected to bring significant improvements with respect to the past. Indeed, changes can be now identified at time/spatial/spectral scales never considered before. In this context, for the change detection and attribution area the binary detection of forest changes (disturbances) mainly related to deforestation (clear cuts and logging) in bi-temporal S-2 image pairs is considered.

Land cover maps updating

Many techniques have been developed to update maps without ground reference data (unsupervised case). However, all these methods assume to have reference data or a thematic map for at least one image of the time series. Even though this is reasonable in many real applications, it is no longer affordable when considering the need of updating land-cover maps at national or global scale. For this reason, in the last methodological area the time series of S-2 images is employed in order to update an existing thematic land-cover map generated with different RS data by assuming that: i)  no reference data are available; ii) the origin of the thematic map to be updated is unknown.

Land Cover Map Update

Polygons do not necessarily correspond to spectrally homogeneous areas on the ground (i.e., parcel). Moreover, the vector polygon boundaries do not match perfectly the pixel grid. In this framework, there are a one-to-many and a many-to-one relations between polygons and pixels labels. In such complex and ill-posed problem, it is necessary to define a strategy for identifying pure pixels associated to a valid label (i.e., belonging to the predominant semantic class of the polygon).

Besides the spatial and pixel decomposition, the map legends usually present semantic-classes (e.g., the “crop” label is assigned to all pixels representing different cultivations, i.e., natural classes). This leads to a semantic gap between the map and the set of natural classes that can be discriminated by the spectral information provided by the RS images. To extract an informative and representative set of labeled samples from the thematic map, for each LC class it is necessary to perform a semantic decomposition of the legend map.


Project Team

The partnership of the MTA project supported by ESA is led by the Remote Sensing Laboratory (RSLab) at the Department of Information Engineering and Computer Science of the University of Trento (UoT) and involves the Remote Sensing for Digital Earth Unit at the Fondazione Bruno Kessler (FBK) research center.

The RSLab coordinated by Prof. Lorenzo Bruzzone has a huge know-how on the definition, implementation and application of techniques and algorithms for the analysis of multitemporal images. RSLab has a widely recognized leadership in multitemporal data analysis and processing of time series in terms of change detection, and analysis of long time series and updating of land-cover maps. This is demonstrated by the quantity of RSLab publications on these specific topics (and their quality proven by citations), by the projects/applications managed by the group, and by the many initiative related to the temporal variable in remote sensing RSLab has managed. RSLab is the Prime Contractor of this proposal and has the scientific responsibility of the analysis of the state-of-the art, of selecting/defining the most effective methods and algorithms to be implemented in order to satisfy the requirements of the call, and of defining the road map for future activities. RSLab will then contribute to the implementation and to the validation of the algorithms.

The RSDE is an application oriented research group developed within the internationally well-known FBK research center. This Unit is built around the large know of the leader (Dr. Francesca Bovolo) in RS, who is a top expert in the field of multitemporal data analysis. RSDE in the project will lead the implementation, testing and validation of the developed tools on S-2 multitemporal datasets taking into account the large expertise and computation infrastructure the center has on the processing of large quantity of data. Moreover RSDE will contribute to the selection and implementation of the algorithms and to the definition of the road map.