G6.06 Provision of reference-quality measurements where technically feasible on a continuous basis, to maximise opportunities for the validation of satellite and derived products

Gap abstract: 

Many non-satellite reference measurements have the potential to be operated on a continuous basis, or can at least be made available to operate at any time, even if in practice they cannot take uninterrupted observations, e.g. because the measurement technique requires certain geophysical conditions. Providing continuous observations to the extent possible would maximise opportunities for the validation of satellite-based measurements, as well as higher level data products derived from them. For various reasons - including scientific, technical, operational, organisational, and financial reasons - this potential has not been fully realised to date as many reference observations are obtained only intermittently or are discontinuous because of the lack of funding. This gap sets out the general and overarching case for operationalising and sustaining key reference measurements. 

Part I Gap description

Primary gap type: 
  • Spatiotemporal coverage
Secondary gap type: 
  • Technical (missing tools, formats etc.)
ECVs impacted: 
  • Temperature,Water vapour, Ozone, Aerosols, Carbon Dioxide, Methane
User category/Application area impacted: 
  • Operational services and service development (meteorological services, environmental services, Copernicus Climate Change Service (C3S) and Atmospheric Monitoring Service (CAMS), operational data assimilation development, etc.)
  • International (collaborative) frameworks and bodies (space agencies, EU institutions, WMO programmes/frameworks etc.)
  • Climate research (research groups working on development, validation and improvement of ECV Climate Data Records)
Non-satellite instrument techniques involved: 
  • Lidar
  • Microwave Radiometer
  • FTIR
  • Brewer/Dobson
  • UV/VIS zenith DOAS
  • UV/VIS MAXDOAS
  • Pandora
  • GNSS-PW
  • Other non-GAIA-CLIM targeted instrument techniques, please specify:

 Sunphotometer

  • G6.03 to be addressed with G6.06.

    Argument: Operationalising and maintaining instruments that can possibly be operated 24/7 increases the number of dedicated observations to coincide with satellite overpass. 

    G5.11 to be addressed with G6.06.

    Argument: Provision of reference-quality streams to users in near-real-time increases their utility to numerous applications, including satellite cal/val

Detailed description: 

The ECVs addressed in the GAIA-CLIM project (temperature, water vapour, aerosols and atmospheric composition) are measurable by a diverse range of instruments. For some non-satellite instruments, there are geophysical limitations as to when measurements can be undertaken, e.g., FTIR requires direct line of sight to the sun under clear-sky conditions. However, other instruments (e.g., GNSS-PW and microwave radiometers) can, in principle, operate on a continuous basis.

The primary benefits of sustained and continuous operations are two-fold: Firstly, the opportunities to achieve spatiotemporal match-ups with satellite measurements - if this is the primary approach to validation - are maximised; and secondly the validation of higher level data products (spanning the full range from retrieved products, through gridded products, to global reanalysis-based products) is enhanced through the use of continuous, or almost continuous, datasets.

The measurement techniques potentially available to serve as reference measurements for the relevant ECVs include: ground-based microwave radiometry and infrared spectrometry; differential optical absorption spectroscopy (DOAS and Pandora), lidar (including Rayleigh, Raman, rotational Raman and differential absorption lidar), Brewer/Dobson spectrometers, and sunphotometers. There are a number of reasons why, in practice, many measurements are not made on a continuous basis:

  • Technical - instruments may require frequent maintenance, adjustment, calibration, or retuning requiring manual intervention, which may not be available on a continuous basis; data acquisition and analysis may still require too many manual interventions;
  • Scientific particular site-specific conditions may prevent measurements being made. For example, cloud conditions may preclude certain measurements (e.g., FTIR for composition measurements, or for passive measurements of temperature and humidity, also rotational Raman lidar for temperature).

  • Operations / logistics the site may not be manned continuously and instruments cannot, as yet, operate in an automated way; also, the data analysis may not be sufficiently automated.

  • Financial - funding authorities often neglect the importance of the non-satellite observing system, whereas it is indispensable for ca/val of the space segment of the observing system and as a transfer standard between successive satellites. 

Funding, clearly, plays a key role in determining the capacity for a given instrument to make (continuous) measurements and to rapidly deliver the data. Targeted funding support to meet multiple stakeholder needs including, but not limited to satellite cal/val, could ensure that a station/instrument is capable of more continuous operations and more rapid delivery of the data through higher levels of manning. Funding could also support technical development work to improve the degree of automation of the instrumentation across entire national or international networks and of subsequent data analysis, thereby lowering the cost for continued operations and rapid data delivery.

The purpose of this gap is to recognise this general deficiency in many observing networks, and to encourage support to rectify these deficiencies. A funding mechanism (or mechanisms) needs to be instigated that recognises the costs to be covered by those communities which shall benefit from such sustained operational capabilities (including but not only satellite applications). Such targeted support would ensure sustainability, recognising the substantial diversity of competing demands on resources of in-situ measurement assets.

Operational space missions or space instruments impacted: 
  • Independent of specific space mission or space instruments
Validation aspects addressed: 
  • Radiance (Level 1 product)
  • Geophysical product (Level 2 product)
  • Gridded product (Level 3)
  • Assimilated product (Level 4)
  • Time series and trends
  • Calibration (relative, absolute)
  • Auxiliary parameters (clouds, lightpath, surface albedo, emissivity)
Gap status after GAIA-CLIM: 
  • After GAIA-CLIM this gap remains unaddressed

Part II Benefits to resolution and risks to non-resolution

Identified benefitUser category/Application area benefittedProbability of benefit being realisedImpacts
Better intra-satellite and inter-satellite data characterization using the ground segment through increased pool of co-locations to common non-satellite tie-points.
  • Operational services and service development (meteorological services, environmental services, Copernicus services C3S & CAMS, operational data assimilation development, etc.)
  • Climate research (research groups working on development, validation and improvement of ECV Climate Data Records)
  • High
Better characterized satellite data will yield improved utilization in derived products, including reanalyses products and resulting services.
More robust funding support for ground-based observations continuity, recognizing that ground-based products may have unique value in, e.g., providing vertically resolved profiles,
serving cal/val purposes and being a transfer standard between successive satellites
  • International (collaboration) frameworks (SDGs, space agency, EU institutions, WMO programmes/frameworks etc.)
  • Climate research (research groups working on development, validation and improvement of ECV Climate Data Records)
  • Medium
Diversity of tools and data available to support service providers to develop bespoke products.
Identified riskUser category/Application area at riskProbability of risk being realisedImpacts
Insufficient number of high-quality co-locations in the future that meet co-location match-up criteria to meaningfully constrain (at least some) satellite missions.
  • Operational services and service development (meteorological services, environmental services, Copernicus services C3S & CAMS, operational data assimilation development, etc.)
  • Climate research (research groups working on development, validation and improvement of ECV Climate Data Records)
  • High
Reduced confidence in satellite measurements and products and services derived therefrom.
Inability to use non-satellite segment to effectively bridge across any unplanned gap in spaceborne EO capabilities.
  • Operational services and service development (meteorological services, environmental services, Copernicus services C3S & CAMS, operational data assimilation development, etc.)
  • Climate research (research groups working on development, validation and improvement of ECV Climate Data Records)
  • Medium
  • Low
Reduced co-locations reduces the opportunity to use the non-satellite series to bridge the effects of any gap and yield a homogeneous series. This reduces the value of the satellite record for monitoring long-term environmental changes.
Reduction in perceived utility and value of measurements leading to reduction in funding.
  • International (collaboration) frameworks (SDGs, space agency, EU institutions, WMO programmes/frameworks etc.)
  • Medium
  • Low
Diversifying the usage base of the high-quality measurements increases their intrinsic value and helps support widespread adoption.

Part III Gap remedies

Gap remedies: 

Remedy 1: Operationalize measurements to be 24/7 on an instrument-by-instrument and site-by-site basis.

Primary gap remedy type: 
Technical
Secondary gap remedy type: 
Laboratory
Proposed remedy description: 

The precise remedy will be specific to individual cases. But, in general, it requires an assessment on a per-instrument and per-site basis of the current impediments to continuous operation of the asset and to rapid data delivery. Once the reason(s) underlying are known, then work can be undertaken to address them. Generally, these reasons may fall into several categories:

 

  • Technical innovations or modifications to the instrumentation to enable continuous operations;

  • Modifications to instrument housing;

  • Modifications to data analysis system

  • Funding increases to maintain the instrumentation and operations (data acquisition and analysis) and to enable more continuous operation and more rapid data analysis and dissemination.

 

Automation of observations and data analysis are key to achieving an optimised non-satellite observing system. Another path to more rapid data delivery is centralisation of the data processing in a network, with the condition that the central facility has the required expertise, maintains contacts with the network partners to evolve as the state-of-the-art evolves, and has sustained funding support. Amongst others, resolution of these issues shall require the participation of instrument scientists, site operators, networks, and funding agencies. 

Relevance: 

Remedy will be specific to individual cases. But, in general, it requires an assessment on a per-instrument and per-site basis of the current impediments to continuous operation of the asset. 

Measurable outcome of success: 

Increased number of high-quality non-satellite data available, providing a sufficient number of co-locations with satellite measurements on a sustained and more continuous basis, and providing the possibility to bridge successive satellite missions

Expected viability for the outcome of success: 
  • High
Scale of work: 
  • Programmatic multi-year, multi-institution activity
Time bound to remedy: 
  • Less than 10 years
Indicative cost estimate (exploitation): 
  • Yes
Potential actors: 
  • National funding agencies
  • National Meteorological Services
  • WMO
  • ESA, EUMETSAT or other space agency
  • Academia, individual research institutes
  • SMEs/industry
  • National measurement institutes

Remedy 2: Ensuring sustained funding of the non-satellite observing system

Primary gap remedy type: 
Governance
Proposed remedy description: 

Providing the resources to enable operationalizing the non-satellite observing system is key to the viability of the above remedy 1. Currently several funding agencies do not sufficiently recognize the importance of sustaining the non-satellite long-term observing system. The stakeholder communities that benefit from the provision of non-satellite reference data should also take the responsibility to provide continued funding support that enables the operators of the system to maintain it to ensure compliance with state-of-the-art quality specifications, and to increase the benefit/cost ratio by proper automation and operationalisation. This could be achieved, e.g., by including the provision of support to the non-satellite observing system in the mandate of relevant funding agencies. Without the perspective of sustained support, the system operators cannot engage in system maintenance and optimization.

Relevance: 

Remedy 2 underpins remedy 1. 

Measurable outcome of success: 

Increased long-term availability of continuous (where technically feasible) high-quality non-satellite data series, providing appropriate sampling of the atmosphere, a sufficient number of co-locations with satellite measurements and providing the possibility to bridge successive satellite missions. 

Expected viability for the outcome of success: 
  • High
Scale of work: 
  • Programmatic multi-year, multi-institution activity
Time bound to remedy: 
  • Less than 10 years
Indicative cost estimate (exploitation): 
  • Yes
Potential actors: 
  • EU H2020 funding
  • Copernicus funding
  • National funding agencies
  • National Meteorological Services
  • WMO
  • ESA, EUMETSAT or other space agency
  • SMEs/industry
  • National measurement institutes