AVL news

Banner including a picture of swell waves

EarthConsole® Stories – Sentinel-6: potential of swell wave detection using FFSAR data

EarthConsole® Stories are experiences about how we helped universities, research centres or service developers to leverage earth observation data to extract valuable insights for their research, educational or pre-commercial projects.

The Project

In the context of the Space Flight MSc program at the faculty of Aerospace Engineering of the Delft University of Technology, this thesis project delved into the capabilities of the Sentinel-6 Michael Freilich satellite, the latest satellite altimetry mission, launched in November 2020 as part of the Copernicus programme.

The project aimed to compare two types of data, Level 1b Sentinel-6 Fully Focused Synthetic Aperture Radar (SAR) RAW and RMC data, to evaluate their differences in monitoring swell waves.

The project focused on the Channel Islands of California, where the presence of swells is dominant and especially evident in the winter period.

The Need

Recent research has shown that the performance of the RMC mode in unfocused SAR meets expectations. However, when it comes to fully focused SAR applications, there was still a need to evaluate the differences with RAW data.

That’s where EarthConsole® came into play. EarthConsole®’s Altimetry Virtual Lab provides the FF-SAR processor for Sentinel-6 developed by Aresys. This processor handles the entire journey of Sentinel-6 SAR data, starting from the raw FBR data and transforming it into FF-SAR Level1b products. This processor became indispensable since it provided FFSAR data required for extracting swell spectra information.

Why EarthConsole®

The research team chose to utilize the EarthConsole® P-PRO (parallel processing) service within the EarthConsole® Altimetry Virtual Lab to access the FFSAR (Fully Focused Synthetic Aperture Radar) for Sentinel-6.

In the course of the thesis project, creating an in-house FFSAR processor was simply beyond the project’s scope and the time constraints allocated for it. Consequently, we made the decision to leverage an external service, a choice that brought about several notable advantages. It afforded me access to a well-tested software solution and allowed me to fine-tune processing parameters to align with my specific requirements. Most notably, the substantial reduction in processing time, compared to running it on a local machine, emerged as a pivotal factor ensuring the project’s ultimate success.

The project impact

This performance analysis will be of great help to members of the scientific community who wish to use RAW data to analyze swells as it will highlight differences between RMC and RAW datasets thereby guiding a critical interpretation of the Sentinel-6 mission data.

 

This project has been supported via the ESA Network of Resources initiative.

Banner including a picture of coastal erosion

EarthConsole® Stories: HYDROCOASTAL project enhancing the understanding of river discharge-coastal sea levels interactions

EarthConsole® Stories are experiences about how we helped universities, research centres or service developers to leverage earth observation data to extract valuable insights for their research, educational or pre-commercial projects.

The Project

With funding from the European Space Agency (ESA), the Hydrocoastal project aims at making the most of SAR and SARin altimeter measurements in coastal areas and inland waters. To accomplish this goal, the project seeks to explore and implement novel methodologies for processing SAR and SARin data obtained from CryoSat-2, as well as SAR altimeter data gathered from Sentinel-3A and Sentinel-3B satellites.

An important focus of the project is to enhance the comprehension of the relationship between river discharge and coastal sea levels. To facilitate this understanding, the research team developed, implemented, and assessed new SAR and SARIn processing algorithms. From the results of this evaluation a processing scheme has been implemented to generate global coastal zone and river discharge data sets. The potential impact and benefits of these datasets will then be investigated through a series of impact assessment case studies.

Furthermore, as part of promoting collaboration and knowledge sharing, all generated datasets will be made available upon request to external researchers, fostering further exploration and analysis in related fields.

The Need

The Hydrocoastal project has developed a delay-doppler processor in Python. This processor can take Sentinel-3 SRAL L1A and Cryosat-2 FBR data and turn it into L1B data in a customised netCDF format. These data products were additionally extended to include data from Sentinel-3 and Cryosat-2 L2 files.

In the earlier phase of the project, the team developed different retracking tools that could work with these products. These tools were tested and compared with the goal of selecting a single retracking solution. Only the selected tool was to be applied to the data products created by the Python delay-doppler processor.

At this point the research team needed a suitable solution to perform these processing steps and generate the global coastal zone and river discharge datasets and resorted to GBOX (Integrated Algorithm and Execution Environment) available via the ESA Altimetry Virtual Lab hosted on EarthConsole®.

Why EarthConsole®

The Team resorted to EarthConsole® G-BOX as it offered the necessary computing resources to efficiently deliver the global validated coastal zone datasets and river discharge datasets.

The initial phase of the project, involving the definition of products and assessment of various algorithms, has been successfully completed internally. For the next phase involving the generation of the datasets, we selected EarthConsole® G-BOX for its potential to significantly expedite our data processing timeline compared to our in-house facilities. By leveraging G-BOX, we eliminated the lengthy process of downloading input data. This enabled us to deliver the global datasets in a much shorter time, meeting our project goals effectively.

The project impact

The ESA Hydrocoastal project has the ambition to utilize the global datasets to foster more effective management strategies for various coastal regions. These areas have common features such as flooding and erosion, sedimentation, the importance of accurate high resolution local modelling, the vulnerability of coastal habitats, the connection between river discharge and coastal sea levels.

Simultaneously, the project focuses on investigating the potential for operational hydrological forecasting in inland water systems, assessing the influence of lake size and riverbank configuration on water level retrieval accuracy, quantifying the freshwater inflow into the seas under examination, and developing a comprehensive global water level climatology.

This project has been supported via the ESA Network of Resources initiative.

Join the webinar on EarthConsole® organized by the ESA Network of Resources

Are you interested in EarthConsole® and exploring the opportunities offered by the ESA Network of Resources (NoR) initiative?

We are pleased to invite you to an informative webinar session on EarthConsole® next Friday June, 16 at 1 p.m. CEST organized by the ESA NoR initiative. In this webinar, you will:

  • gain a comprehensive overview of the EarthConsole® platform offer with a specific focus on its services:
    – G-BOX: Integrated Development and Execution Environment
    – I-APP: Application Integration Service
    – P-PRO and P-PRO ON DEMAND: Parallel Processing Service
  • explore the features, potential applications and real-world use cases of each service;
  • learn how to take advantage of the EarthConsole® Virtual Labs, the EarthConsole® virtual spaces tailored on the needs of specific Earth Observation communities. These spaces provide access to customized processing services and tools to facilitate collaboration and knowledge sharing.

Who can benefit from this webinar?

If you’re already familiar with EarthConsole® but still uncertain about how you can leverage the ESA Network of EO Resources, this webinar is for you.

If you’re new to EarthConsole® and eager to learn more, this webinar is for you too.

Whether you are a researcher, a professional in the industry or education field, a student working with earth observation data or just a non-practitioner with a passion for learning about Earth Observation (EO) cloud platforms, the webinar is open to all.

No matter your background, we encourage you to join us for this webinar.

How to register

Reserve your spot today by registering here.

We hope to see many of you there!

Banner including two pictures: one of polar ices and the other one of a coast

EarthConsole® selected as service provider for two OCRE funded research projects

EarthConsole® by Progressive Systems was chosen as the preferred service provider for two research projects awarded through the OCRE (Open Clouds for Research Environments) call for funding Earth Observation services. These projects required extensive processing campaigns for different objectives using processors from the SARvatore (SAR Versatile Altimetric TOolkit for Research & Exploitation) family of processors. These processors were integrated by Progressive Systems into the ESA Altimetry Virtual Lab on the EarthConsole® platform in 2021, following the previous ten-year experience as RSS G-POD operator at the European Space Agency.

With this long-term processing heritage, EarthConsole® was the clear choice for the research institutions leading the projects. In this blog post, we’ll delve into the details of these exciting projects and how EarthConsole® plans to contribute to their success.

The supported projects

Project: CryoSSARinSAM+
Research Institution: Technical University of Denmark – DTU SPACE (Denmark)

The Polar regions are important to study for a number of reasons. In an era of climate change, melting ice is expected to accelerate sea level change. In the past, various research groups have processed the first 9 years (2010.07-2020) of Cryosat radar altimetry for the Polar Oceans independently, using EarthConsole® or using the G-POD On Demand platform computing services. To continue this vital timeseries up through 2023 and also extend the Polar regions coverage to all regions outside the 50 degree parallel, this project was established.

CryoSSARinSAM+ aims at developing a common processing chain configuration to produce a single, open-access CryoSat-2 altimetry mission dataset that can support radar altimetry research of the polar oceans (both for the northern and southern hemisphere).

This dataset will have a wide range of potential applications, such as studying sea level, circulation, and trends in ice-covered polar seas; improving algorithms to monitor coastal sea level; estimating the thickness of summer sea ice; measuring significant wave height in polar oceans; and enhancing measurements of winter sea ice thickness in the Arctic and Antarctic, among other.

We want this dataset to become a reference standard for the radar altimetry research community, playing a pivotal role in advancing our knowledge of the polar oceans and ice cover, and the impact of climate change on them. A number of research institutions have been onboard designing this study and will directly ingest these data in their ongoing research

Ole B. Andersen
Professor, Department of Space Research and Technology
Geodesy and Earth Observation
DTU SPACE

Project: Assessment of renewable wave energy resources in the coastal zone using high-resolution altimetry products
Research Institution: CENTEC (Centre for Marine Technology and Ocean Engineering), Instituto Superior Tecnico , (Associação do Instituto Superior Técnico para a Investigação e Desenvolvimento) – IST-ID, (Portugal)

The project’s primary objective is to evaluate the potential of wave renewable energy sources in the Atlantic Ocean, with a particular emphasis on the coastal region, where the energy can be efficiently harnessed. To achieve this objective, the project is processing the whole CryoSat, Sentinel-3A, and Sentinel-3B missions data over specific coastal zones and using an improved geophysical retrieval algorithm: SAMOSA+ (Dinardo et al. 2018, Dinardo 2020).

The datasets generated through this project are expected to have a multitude of applications, ranging from evaluating renewable energy sources to gaining a better understanding of the impact of waves on the rise of sea levels. We want this project to benefit the whole altimetry research community, this is why the findings will be shared as we complete the project

Sonia Ponce de Leon A.
Assistant Researcher
CENTEC-IST-University of Lisbon

 

Why EarthConsole®

EarthConsole® has been selected as the optimal service provider to perform the processing activities requested by the projects.

With the ESA Altimetry Virtual Lab (AVL) hosted on the platform, EarthConsole® provides the necessary services and solutions to cater to the specific needs of the altimetry research community.

The ESA Altimetry Virtual Lab is hosting SARvatore for CryoSat-2, SARINvatore for CryoSat-2, and SARvatore for Sentinel-3 processors, among others. These processors will be used to reprocess CryoSat-2 altimetry mission data (CryoSSARinSAM+) and Sentinel-3A & Sentinel-3B data (Assessment of renewable wave energy resources in the coastal zone using high-resolution altimetry products) on specific areas and periods of interests indicated by the research institutions.

EarthConsole® utilizes flexible computing resources such as Worker Nodes, CPU, and RAM, in combination with a quick access to data on a Copernicus DIAS infrastructure. This minimises the impact of data transfer on processing time, enabling scalable processing campaigns to be completed within the projects’ time constraints.

In addition, EarthConsole® experts will oversee all processing activities, freeing up researchers from the task of managing the processing campaign and IT infrastructure, allowing them to focus on their research goals.

In conclusion, EarthConsole® has once again demonstrated its commitment to providing innovative solutions that add value to altimetry research. With the needed processors, flexible computing resources, the quick access to the Copernicus datasets, and the right expertise, researchers can confidently pursue their research objectives, knowing that they have a reliable partner to support their efforts.

 

The EarthConsole® Virtual Lab for the Altimetry community

The EarthConsole® Altimetry Virtual Lab, funded by ESA, aims at providing a virtual space to:

  • Support the Altimetry community in the development & operation of new Earth Observation applications;
  • Foster collaboration by leveraging on knowledge-sharing tools.

The Altimetry Virtual Lab has been developed on the new EarthConsole® platform and hosts the SARvatore (SAR Versatile Altimetric TOolkit for Research & Exploitation) family of processors which was previously available in the ESA Grid Processing On-Demand (G-POD) environment. The Altimetry Virtual Lab ensures service continuity following the recent termination of the G-POD environment.

The driving concept is to offer the same processing capabilities formerly available in ESA G-POD while improving the user experience by combining:

  • The access to innovative, fully customizable, altimetry data processing services from a single environment at the push of a button;
  • The availability of a set of tools to network with colleagues, keep up with the latest news and publications on radar altimetry, and share results to avoid duplication of efforts;
  • The flexibility of a virtual space which can be further reshaped following the future emerging needs of the community.

In particular, Altimetry Virtual Lab users can:

  1. Request & access, through the G-BOX service, a virtual machine for algorithm development, testing and post-processing analysis. Each virtual machine also includes software for altimetry data analysis & visualization: BRAT (http://www.altimetry.info/toolbox/), Panoply (https://www.giss.nasa.gov/tools/panoply/) and Python;
  2. Request to access and process data with the following processors which have been integrated and are ready for use:
    • ALES+ SAR Retracker – developed by the Technical University of Munich,
    • FF-SAR (Fully Focused SAR) for CryoSat-2 – developed by Aresys srl,
    • SARINvatore for CS-2, SARvatore for CS-2, SARvatore for S3 – developed by the ESA-ESRIN Altimetry Team
    • TUDaBO SAR-RDSAR – developed by the University of Bonn.
      All processors can be requested for both bulk (P-PRO service) or on-demand (P-PRO ON DEMAND service) processing;
  3. Request to integrate, through the I-APP service, additional processors;
  4. Access a set of tools to network and share information and results with colleagues: a forum, a datasets repository, and a knowledge-base with relevant altimetry publications and media for consultation;

Jérôme Benveniste, the initiator and coordinator of the GPOD/SARvatore service and its migration to the EarthConsole®, commented:

The GPOD/SARvatore Altimetry processing on-demand tool has been a great success fostering more than 25 peer-reviewed publications, 3 PhD thesis and tens of presentations to conferences in the past six years. Thanks to this SARvatore Family framework supported by ESA, several new and innovative altimetry retrackers were developed going beyond the standard Ground Segment algorithms, some by ESA, some donated by users, and were made accessible to worldwide Altimetry users, for breakthrough research in the oceanic coastal zone, inland water and the cryosphere domains. It was clear to ESA that, albeit the obsolescence of the GPOD, this adventure had to be continued and supported. I wish great success to the new EarthConsole® Altimetry Virtual Lab environment, which I’m sure will be a change of gears in efficiency and attractiveness to users.

The Altimetry Virtual Lab intends to lead the way for further virtual labs dedicated to other Earth observation communities and foster interdisciplinarity among them to advance collaboratively in the Earth observation sector.

Access to the Altimetry Virtual Lab web site is free of charge . If you are a former SARvatore G-POD data user or an altimetry data user, please visit this page for detailed instructions to join the EarthConsole® Altimetry Virtual Lab.

All the Altimetry Virtual Lab services are available via the ESA EO Network of Resources initiative. Users with a research, development, pre-commercial, or educational project, may be eligible to apply for an ESA sponsorship and receive a voucher to access these services free of charge or at very competitive prices.

Any request for information related to the Altimetry Virtual Lab should be sent to info@earthconsole.eu with support@earthconsole.eu and altimetry.info@esa.int in cc.

We look forward to welcoming you to the Lab!