Maturity Matrix Assessment

Maturity Matrix Assessments (MMA), are tools developed within GAIA-CLIM to assess various quantifiable facets of the maturity of a measurement system or network of measurement systems. They represent a semi-quantitative classification of certain non-satellite Earth Observation capabilities concentrating upon a subset of Essential Climate Variables. Its use is primarily to assign networks into relevant use-categories using three tiers of measurement capabilities as articulated in deliverable D1.3 [1]. GAIA-CLIM maturity matrices results are summarised in deliverables D1.6 [2] and D1.7 [3] .

GAIA-CLIM maturity assessments have been built based upon the approach to assess Climate Data Records (CDR) undertaken by CORE-CLIMAX [4] FP7 project which itself builds upon pioneering efforts at NOAA NCEI. However, there are important distinctions between measurements (GAIA-CLIM) and derived products (CORE-CLIMAX) which necessitate similar but non-identical assessments. There are seven major strands to GAIA-CLIM MMA as shown in the image for NDACC below:

Metadata
Documentation
Uncertainty characterisation
Public access, feedback, and update
Usage
Sustainability
Software

Each strand has two or more sub-categories. Guidance for completion of an assessment is available in D1.3.

The MMA can be used both to aid user decision making as to which measurement series are suitable for particular use cases and aid measurement system owners in improving the maturity of their measurements. Within GAIA-CLIM assessment the maturity has been assessed at the network level and thus scores are representative of the level of maturity of each network and not individual sites

It is important to stress that this constitutes the first attempt at systematically and consistently assessing the maturity of the networks outlined in the full table of assessed networks shown below. To assess sensitivity several experts were solicited to independently assess certain networks for which they had in-depth knowledge and this assessment suggested assessor-to-assessor uncertainty no smaller than 1 - score level ( out of six) in any case and for some categories much broader. Given this, although the intention of GAIA-CLIM through this assessment is to support users' decision making in evaluating the suitability of a given network for specific tasks, they should not at this stage represent the primary or sole decision-making tool. Further development, consultation and experience is undoubtedly still required to refine the guidance, assessment process and tools to better support direct decision-making.

ndacc.jpg [5]

The image above shows an example of maturity matrix assessing NDACC (Network for the Detection of Atmospheric Composition Change). To access each maturity matrix , click on the name of the network on the table below that includes all assessed networks . The full set of assessment results for all assessed networks is given in a cumulative table here [6]

NETWORK	WEBSITE	ECV	MEASUREMENT TYPE
ACTRIS surface [7]	www.actris.eu [8]	AEROSOL, NO₂	surface
ACTRIS profiles [9]	www.actris.eu [8]	AEROSOL	profile
ADNET [10]	http://www-lidar.nies.go.jp/AD-Net/ [11]	AEROSOL	profile
AEROCAN [12]	http://www.aerocanonline.com/ [13]	AEROSOL, WATER VAPOUR	column
AERONET_PHOTONS [14]	http://aeronet.gsfc.nasa.gov/ [15] / http://loaphotons.univ-lille1.fr/ [16]	AEROSOL, WATER VAPOUR	column
AGSNET_CSIRO [17]	http://www.csiro.au/en/Research/OandA/Areas/Assessing-our-climate/Aerosp... [18]	AEROSOL, WATER VAPOUR	column
AMeDAS [19]	www.jma.go.jp [20]	TEMPERATURE	surface
ARGO [21]	www.argo.org [22]	TEMPERATURE, SALINITY	profile
BSRN [23]	http://www.bsrn.awi.de/ [24]	AEROSOL, O₃	column
EARLINET [25]	www.earlinet.org [26]	AEROSOL	profile
EMEP [27]	www.emep.org [28]	AEROSOL	surface
EPA [29]	http://epa.gov/castnet/javaweb/index.html [30]	AEROSOL	surface
EUREF [31]	http://www.epncb.oma.be/ [32]	WATER VAPOUR	column
EUROSKYRAD [33]	http://www.euroskyrad.net/ [34]	AEROSOL,WATER VAPOUR	column
GAWPFR [35]	http://www.pmodwrc.ch/worcc/ [36]	AEROSOL	column
GPSMET [37]	gpsmet.noaa.gov	WATER VAPOUR	column
GRUAN [38]	www.gruan.org [39]	TEMPERATURE, WATER VAPOUR	profile
GSN [40]	www.wmo.int/pages/themes/climate/climate_data_management_exchange.php [41]	TEMPERATURE	surface
GUAN [42]	https://www1.ncdc.noaa.gov/pub/data/igra/ [43]	TEMPERATURE, WATER VAPOUR	profile
ICOS (including InGOS) [44]	www.icos-ri.eu [45] www.ingos-infrastructure.eu [46]	CO, CO₂, CH₄	In situ & tower
IGS [47]	https://igscb.jpl.nasa.gov [48]	WATER VAPOUR	column
IMPROVE [49]	http://vista.cira.colostate.edu/improve/ [50]	AEROSOL	surface
MESONET [51]	www.mesonet.org [52]	TEMPERATURE, WATER VAPOUR	surface
MPLnet [53]	http://mplnet.gsfc.nasa.gov/ [54]	AEROSOL	profile
MWRnet [55]	http://cetemps.aquila.infn.it/mwrnet/ [56]	TEMPERATURE,WATER VAPOUR	profile, column
NDACC [57]	www.ndsc.ncep.noaa.gov/ [58]	CO, CH_4,NO₂,O₃,WATER VAPOUR	profile, column
NOAA ESRL WV profiles [59]	http://www.esrl.noaa.gov/ [60]	WATER VAPOUR	profile
NOAA ESRL O₃profiles [61]	http://www.esrl.noaa.gov/ [60]	O₃	profile
NOAA ESRL O₃dobson [62]	http://www.esrl.noaa.gov/ [60]	O₃	column
NOAA ESRL O₃in-situ [63]	http://www.esrl.noaa.gov/ [60]	O₃	surface
NOAA ESRL O₃aircraft [64]	http://www.esrl.noaa.gov/ [60]	O₃	aircraft
RAOB [65]	www.raob.com [66]	TEMPERATURE, WATER VAPOUR	profile
RBSN [67]	http://www.wmo.int/pages/prog/www/ois/monitor/agm/AGM2009A/datasets.html [68]	TEMPERATURE	surface
SCRIPPS CO₂program [69]	http://scrippsco2.ucsd.edu/ [70]	CO₂	surface
SHADOZ [71]	http://croc.gsfc.nasa.gov/shadoz/Archive.html [72]	O₃	profile
SKYNET [73]	http://atmos2.cr.chiba-u.jp/skynet/ [74]	AEROSOL, NO₂, O₃, TEMPERATURE, WATER VAPOUR	column,profile,surface
SMEAR [75]	http://avaa.tdata.fi/web/smart/smear [76]	AEROSOL, CO₂, CO, CH₄, NO₂,O₃,TEMPERATURE, WATER VAPOUR	surface, tower
SUOMINET [77]	www.suominet.ucar.edu [78]	WATER VAPOUR	column
SURFRAD [79]	http://www.esrl.noaa.gov/gmd/grad/surfrad/sitepage.html [80]	AEROSOL	column
TCCON [81]	https://tccon-wiki.caltech.edu/Sites [82]	CO₂,CH₄	column
TOLNET [83]	http://www-air.larc.nasa.gov/missions/TOLNet/ [84]	O₃	profile
USCRN [85]	https://www.ncdc.noaa.gov/crn/ [86]	TEMPERATURE, WATER VAPOUR	surface
WOUDC [87]	http://woudc.org/home.php [88]	O₃	column, profile

Table . Full list of networks assessed for which maturity matrices are available , the list above notes ECV and measurement type for each network.

Public Content [89]