Maturity Matrix Assessment

Maturity Matrix Assessments (MMA), are tools  developed within GAIA-CLIM to assess various quantifiable facets of the maturity of a measurement system or network of measurement systems. They represent a semi-quantitative classification of certain non-satellite Earth Observation capabilities concentrating upon a subset of Essential Climate Variables.  Its use is primarily to assign networks into relevant use-categories using three tiers  of measurement capabilities as articulated in deliverable D1.3. GAIA-CLIM maturity matrices results are summarised in  deliverables D1.6 and D1.7 

GAIA-CLIM maturity assessments have been built based upon the approach to assess Climate Data Records (CDR) undertaken by CORE-CLIMAX  FP7 project which itself builds upon pioneering efforts at NOAA NCEI.  However, there are important distinctions between measurements  (GAIA-CLIM) and derived products (CORE-CLIMAX) which necessitate similar but non-identical assessments. There are seven major strands to GAIA-CLIM  MMA as shown in the image for NDACC below:

  • Metadata
  • Documentation
  • Uncertainty characterisation
  • Public access, feedback, and update
  • Usage
  • Sustainability 
  • Software

Each strand has two or more sub-categories. Guidance for completion of an assessment is available in D1.3.

The MMA can be used both to aid user decision making as to which measurement series are suitable for particular use cases and aid measurement system owners in improving the maturity of their measurements. Within GAIA-CLIM assessment the maturity has been assessed at the network level and thus scores are representative of the level of maturity of each network and not individual sites

It is important to stress that this constitutes the first attempt at systematically and consistently assessing the maturity of the networks outlined in the full table of assessed networks shown below. To assess sensitivity several experts were solicited to independently assess certain networks for which they had in-depth knowledge and this assessment suggested assessor-to-assessor uncertainty no smaller than 1 - score level ( out of six) in any case and for some categories much broader. Given this, although the intention of GAIA-CLIM through this assessment  is to support users' decision making in evaluating the suitability of a given network for specific tasks, they should not at this stage represent the primary or sole decision-making tool. Further development, consultation and experience is undoubtedly still required to refine the guidance, assessment process and tools to better support direct decision-making.

The image above shows an example of maturity matrix assessing NDACC (Network for the Detection of Atmospheric Composition Change). To access each maturity matrix , click on the name of the network on the table below that includes  all assessed networks . The full set of assessment results for all assessed networks is given in a cumulative table here

NETWORK WEBSITE ECV MEASUREMENT TYPE
 ACTRIS surface  www.actris.eu  AEROSOL, NO2  surface
ACTRIS profiles   www.actris.eu  AEROSOL  profile
ADNET   http://www-lidar.nies.go.jp/AD-Net/   AEROSOL  profile
AEROCAN   http://www.aerocanonline.com/  AEROSOL, WATER VAPOUR  column
AERONET_PHOTONS  http://aeronet.gsfc.nasa.gov/ http://loaphotons.univ-lille1.fr/  AEROSOL, WATER VAPOUR  column
AGSNET_CSIRO   http://www.csiro.au/en/Research/OandA/Areas/Assessing-our-climate/Aerosp...  AEROSOL, WATER VAPOUR  column
AMeDAS   www.jma.go.jp  TEMPERATURE  surface
ARGO   www.argo.org  TEMPERATURE, SALINITY  profile
BSRN   http://www.bsrn.awi.de/  AEROSOL, O3  column
EARLINET   www.earlinet.org  AEROSOL  profile
EMEP   www.emep.org  AEROSOL  surface
EPA   http://epa.gov/castnet/javaweb/index.html

 

 

 AEROSOL  surface  
EUREF   http://www.epncb.oma.be/ WATER VAPOUR   column
EUROSKYRAD   http://www.euroskyrad.net/

AEROSOL,WATER VAPOUR  column 
GAWPFR   http://www.pmodwrc.ch/worcc/ AEROSOL  column 
GPSMET   gpsmet.noaa.gov  WATER VAPOUR  column
GRUAN   www.gruan.org  TEMPERATURE, WATER VAPOUR  profile
GSN   www.wmo.int/pages/themes/climate/climate_data_management_exchange.php  TEMPERATURE  surface
GUAN   https://www1.ncdc.noaa.gov/pub/data/igra/  TEMPERATURE, WATER VAPOUR  profile
ICOS (including InGOS)   www.icos-ri.eu
www.ingos-infrastructure.eu
 CO, CO2, CH4  In situ & tower
 IGS  https://igscb.jpl.nasa.gov  WATER VAPOUR  column
IMPROVE   http://vista.cira.colostate.edu/improve/  AEROSOL  surface
MESONET   www.mesonet.org  TEMPERATURE, WATER VAPOUR  surface
MPLnet   http://mplnet.gsfc.nasa.gov/  AEROSOL  profile
MWRnet http://cetemps.aquila.infn.it/mwrnet/ TEMPERATURE,WATER VAPOUR profile, column
NDACC   www.ndsc.ncep.noaa.gov/  CO, CH4, NO2,O3,WATER VAPOUR  profile, column
NOAA ESRL WV profiles   http://www.esrl.noaa.gov/ WATER VAPOUR  profile
NOAA ESRL O3  profiles  http://www.esrl.noaa.gov/  O3  profile
 NOAA ESRL O3  dobson  http://www.esrl.noaa.gov/  O3  column
NOAA ESRL O3  in-situ  http://www.esrl.noaa.gov/  O3  surface
 NOAA ESRL O3  aircraft  http://www.esrl.noaa.gov/  O3  aircraft
RAOB  www.raob.com  TEMPERATURE, WATER VAPOUR  profile
RBSN  http://www.wmo.int/pages/prog/www/ois/monitor/agm/AGM2009A/datasets.html  TEMPERATURE  surface
SCRIPPS CO2  program  http://scrippsco2.ucsd.edu/  CO2  surface 
SHADOZ  http://croc.gsfc.nasa.gov/shadoz/Archive.html  O3  profile
SKYNET http://atmos2.cr.chiba-u.jp/skynet/  AEROSOL, NO2, O3, TEMPERATURE, WATER VAPOUR  column,profile,surface
SMEAR  http://avaa.tdata.fi/web/smart/smear  AEROSOL, CO2, CO, CH4, NO2,O3,TEMPERATURE,  WATER VAPOUR  surface, tower
SUOMINET  www.suominet.ucar.edu  WATER VAPOUR  column
SURFRAD  http://www.esrl.noaa.gov/gmd/grad/surfrad/sitepage.html  AEROSOL  column
TCCON  https://tccon-wiki.caltech.edu/Sites  CO2,CH4 column
TOLNET http://www-air.larc.nasa.gov/missions/TOLNet/  O3  profile
USCRN  https://www.ncdc.noaa.gov/crn/  TEMPERATURE, WATER VAPOUR  surface
WOUDC  http://woudc.org/home.php  O3  column, profile

 Table . Full list of networks assessed for which maturity matrices are available , the list above notes ECV and measurement type for each network.