Quality Control of Large Argo Datasets

Argo floats have significantly improved the observation of the global ocean interior, but as the size of the database increases, so does the need for efficient tools to perform reliable quality control. It is shown here how the classical method of optimal analysis can be used to validate very large...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of atmospheric and oceanic technology 2009-02, Vol.26 (2), p.337-351
Hauptverfasser: Gaillard, Fabienne, Autret, Emmanuelle, Thierry, Virginie, Galaup, Philippe, Coatanoan, Christine, Loubrieu, Thomas
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 351
container_issue 2
container_start_page 337
container_title Journal of atmospheric and oceanic technology
container_volume 26
creator Gaillard, Fabienne
Autret, Emmanuelle
Thierry, Virginie
Galaup, Philippe
Coatanoan, Christine
Loubrieu, Thomas
description Argo floats have significantly improved the observation of the global ocean interior, but as the size of the database increases, so does the need for efficient tools to perform reliable quality control. It is shown here how the classical method of optimal analysis can be used to validate very large datasets before operational or scientific use. The analysis system employed is the one implemented at the Coriolis data center to produce the weekly fields of temperature and salinity, and the key data are the analysis residuals. The impacts of the various sensor errors are evaluated and twin experiments are performed to measure the system capacity in identifying these errors. It appears that for a typical data distribution, the analysis residuals extract 2/3 of the sensor error after a single analysis. The method has been applied on the full Argo Atlantic real-time dataset for the 2000-04 period (482 floats) and 15% of the floats were detected as having salinity drifts or offset. A second test was performed on the delayed mode dataset (120 floats) to check the overall consistency, and except for a few isolated anomalous profiles, the corrected datasets were found to be globally good. The last experiment performed on the Coriolis real-time products takes into account the recently discovered problem in the pressure labeling. For this experiment, a sample of 36 floats, mixing well-behaved and anomalous instruments of the 2003-06 period, was considered and the simple test designed to detect the most common systematic anomalies successfully identified the deficient floats.
doi_str_mv 10.1175/2008JTECHO552.1
format Article
fullrecord <record><control><sourceid>proquest_hal_p</sourceid><recordid>TN_cdi_hal_primary_oai_HAL_hal_00384678v1</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1656534801</sourcerecordid><originalsourceid>FETCH-LOGICAL-c517t-3c3893ac818191b4f4376b803d6575dde3383832fb386e0b12537bbe90765faa3</originalsourceid><addsrcrecordid>eNqFkc1Lw0AUxBdRsFbPXoOHgoe0b_dlP3IssVolUIR6Xjbppqak3bqbCP3vTakIepE5PBh-DPMYQm4pjCmVfMIA1Mtyls0XnLMxPSMDyhnEkDBxTgYgMY2BS3ZJrkLYAABFKgZk9NqZpm4PUeZ2rXdN5KooN35to6lfu-jBtCbYNlyTi8o0wd583yF5e5wts3mcL56es2kel5zKNsYSVYqmVFTRlBZJlaAUhQJcCS75amURVS9WFaiEhYIyjrIobApS8MoYHJL7U-67afTe11vjD9qZWs-nuT56AKgSIdUn7dnRid1799HZ0OptHUrbNGZnXRc0JpyJRKb_ggyESBFFD979ATeu87v-Yc1YXxWQHdMmJ6j0LgRvq5-eFPRxCf1rCU3xCysSdyk</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>222530329</pqid></control><display><type>article</type><title>Quality Control of Large Argo Datasets</title><source>American Meteorological Society</source><source>EZB-FREE-00999 freely available EZB journals</source><source>Alma/SFX Local Collection</source><creator>Gaillard, Fabienne ; Autret, Emmanuelle ; Thierry, Virginie ; Galaup, Philippe ; Coatanoan, Christine ; Loubrieu, Thomas</creator><creatorcontrib>Gaillard, Fabienne ; Autret, Emmanuelle ; Thierry, Virginie ; Galaup, Philippe ; Coatanoan, Christine ; Loubrieu, Thomas</creatorcontrib><description>Argo floats have significantly improved the observation of the global ocean interior, but as the size of the database increases, so does the need for efficient tools to perform reliable quality control. It is shown here how the classical method of optimal analysis can be used to validate very large datasets before operational or scientific use. The analysis system employed is the one implemented at the Coriolis data center to produce the weekly fields of temperature and salinity, and the key data are the analysis residuals. The impacts of the various sensor errors are evaluated and twin experiments are performed to measure the system capacity in identifying these errors. It appears that for a typical data distribution, the analysis residuals extract 2/3 of the sensor error after a single analysis. The method has been applied on the full Argo Atlantic real-time dataset for the 2000-04 period (482 floats) and 15% of the floats were detected as having salinity drifts or offset. A second test was performed on the delayed mode dataset (120 floats) to check the overall consistency, and except for a few isolated anomalous profiles, the corrected datasets were found to be globally good. The last experiment performed on the Coriolis real-time products takes into account the recently discovered problem in the pressure labeling. For this experiment, a sample of 36 floats, mixing well-behaved and anomalous instruments of the 2003-06 period, was considered and the simple test designed to detect the most common systematic anomalies successfully identified the deficient floats.</description><identifier>ISSN: 0739-0572</identifier><identifier>EISSN: 1520-0426</identifier><identifier>DOI: 10.1175/2008JTECHO552.1</identifier><language>eng</language><publisher>Boston: American Meteorological Society</publisher><subject>Computer centers ; Earth Sciences ; Floats ; Marine ; Oceanography ; Quality control ; Remote sensing ; Residuals ; Salinity ; Sciences of the Universe ; Standard deviation</subject><ispartof>Journal of atmospheric and oceanic technology, 2009-02, Vol.26 (2), p.337-351</ispartof><rights>Copyright American Meteorological Society Feb 2009</rights><rights>Distributed under a Creative Commons Attribution 4.0 International License</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c517t-3c3893ac818191b4f4376b803d6575dde3383832fb386e0b12537bbe90765faa3</citedby><cites>FETCH-LOGICAL-c517t-3c3893ac818191b4f4376b803d6575dde3383832fb386e0b12537bbe90765faa3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,776,780,881,3668,27901,27902</link.rule.ids><backlink>$$Uhttps://hal.science/hal-00384678$$DView record in HAL$$Hfree_for_read</backlink></links><search><creatorcontrib>Gaillard, Fabienne</creatorcontrib><creatorcontrib>Autret, Emmanuelle</creatorcontrib><creatorcontrib>Thierry, Virginie</creatorcontrib><creatorcontrib>Galaup, Philippe</creatorcontrib><creatorcontrib>Coatanoan, Christine</creatorcontrib><creatorcontrib>Loubrieu, Thomas</creatorcontrib><title>Quality Control of Large Argo Datasets</title><title>Journal of atmospheric and oceanic technology</title><description>Argo floats have significantly improved the observation of the global ocean interior, but as the size of the database increases, so does the need for efficient tools to perform reliable quality control. It is shown here how the classical method of optimal analysis can be used to validate very large datasets before operational or scientific use. The analysis system employed is the one implemented at the Coriolis data center to produce the weekly fields of temperature and salinity, and the key data are the analysis residuals. The impacts of the various sensor errors are evaluated and twin experiments are performed to measure the system capacity in identifying these errors. It appears that for a typical data distribution, the analysis residuals extract 2/3 of the sensor error after a single analysis. The method has been applied on the full Argo Atlantic real-time dataset for the 2000-04 period (482 floats) and 15% of the floats were detected as having salinity drifts or offset. A second test was performed on the delayed mode dataset (120 floats) to check the overall consistency, and except for a few isolated anomalous profiles, the corrected datasets were found to be globally good. The last experiment performed on the Coriolis real-time products takes into account the recently discovered problem in the pressure labeling. For this experiment, a sample of 36 floats, mixing well-behaved and anomalous instruments of the 2003-06 period, was considered and the simple test designed to detect the most common systematic anomalies successfully identified the deficient floats.</description><subject>Computer centers</subject><subject>Earth Sciences</subject><subject>Floats</subject><subject>Marine</subject><subject>Oceanography</subject><subject>Quality control</subject><subject>Remote sensing</subject><subject>Residuals</subject><subject>Salinity</subject><subject>Sciences of the Universe</subject><subject>Standard deviation</subject><issn>0739-0572</issn><issn>1520-0426</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2009</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNqFkc1Lw0AUxBdRsFbPXoOHgoe0b_dlP3IssVolUIR6Xjbppqak3bqbCP3vTakIepE5PBh-DPMYQm4pjCmVfMIA1Mtyls0XnLMxPSMDyhnEkDBxTgYgMY2BS3ZJrkLYAABFKgZk9NqZpm4PUeZ2rXdN5KooN35to6lfu-jBtCbYNlyTi8o0wd583yF5e5wts3mcL56es2kel5zKNsYSVYqmVFTRlBZJlaAUhQJcCS75amURVS9WFaiEhYIyjrIobApS8MoYHJL7U-67afTe11vjD9qZWs-nuT56AKgSIdUn7dnRid1799HZ0OptHUrbNGZnXRc0JpyJRKb_ggyESBFFD979ATeu87v-Yc1YXxWQHdMmJ6j0LgRvq5-eFPRxCf1rCU3xCysSdyk</recordid><startdate>20090201</startdate><enddate>20090201</enddate><creator>Gaillard, Fabienne</creator><creator>Autret, Emmanuelle</creator><creator>Thierry, Virginie</creator><creator>Galaup, Philippe</creator><creator>Coatanoan, Christine</creator><creator>Loubrieu, Thomas</creator><general>American Meteorological Society</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7TG</scope><scope>7TN</scope><scope>7UA</scope><scope>7XB</scope><scope>88F</scope><scope>88I</scope><scope>8AF</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AEUYN</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>BKSAR</scope><scope>C1K</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>F1W</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>H8D</scope><scope>H96</scope><scope>HCIFZ</scope><scope>KL.</scope><scope>L.G</scope><scope>L7M</scope><scope>M1Q</scope><scope>M2O</scope><scope>M2P</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PATMY</scope><scope>PCBAR</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PYCSY</scope><scope>Q9U</scope><scope>S0X</scope><scope>1XC</scope></search><sort><creationdate>20090201</creationdate><title>Quality Control of Large Argo Datasets</title><author>Gaillard, Fabienne ; Autret, Emmanuelle ; Thierry, Virginie ; Galaup, Philippe ; Coatanoan, Christine ; Loubrieu, Thomas</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c517t-3c3893ac818191b4f4376b803d6575dde3383832fb386e0b12537bbe90765faa3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2009</creationdate><topic>Computer centers</topic><topic>Earth Sciences</topic><topic>Floats</topic><topic>Marine</topic><topic>Oceanography</topic><topic>Quality control</topic><topic>Remote sensing</topic><topic>Residuals</topic><topic>Salinity</topic><topic>Sciences of the Universe</topic><topic>Standard deviation</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Gaillard, Fabienne</creatorcontrib><creatorcontrib>Autret, Emmanuelle</creatorcontrib><creatorcontrib>Thierry, Virginie</creatorcontrib><creatorcontrib>Galaup, Philippe</creatorcontrib><creatorcontrib>Coatanoan, Christine</creatorcontrib><creatorcontrib>Loubrieu, Thomas</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Meteorological &amp; Geoastrophysical Abstracts</collection><collection>Oceanic Abstracts</collection><collection>Water Resources Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Military Database (Alumni Edition)</collection><collection>Science Database (Alumni Edition)</collection><collection>STEM Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest One Sustainability</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>Agricultural &amp; Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection (ProQuest)</collection><collection>Natural Science Collection</collection><collection>Earth, Atmospheric &amp; Aquatic Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>Aerospace Database</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy &amp; Non-Living Resources</collection><collection>SciTech Premium Collection</collection><collection>Meteorological &amp; Geoastrophysical Abstracts - Academic</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Military Database</collection><collection>Research Library</collection><collection>Science Database</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Environmental Science Database</collection><collection>Earth, Atmospheric &amp; Aquatic Science Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Environmental Science Collection</collection><collection>ProQuest Central Basic</collection><collection>SIRS Editorial</collection><collection>Hyper Article en Ligne (HAL)</collection><jtitle>Journal of atmospheric and oceanic technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Gaillard, Fabienne</au><au>Autret, Emmanuelle</au><au>Thierry, Virginie</au><au>Galaup, Philippe</au><au>Coatanoan, Christine</au><au>Loubrieu, Thomas</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Quality Control of Large Argo Datasets</atitle><jtitle>Journal of atmospheric and oceanic technology</jtitle><date>2009-02-01</date><risdate>2009</risdate><volume>26</volume><issue>2</issue><spage>337</spage><epage>351</epage><pages>337-351</pages><issn>0739-0572</issn><eissn>1520-0426</eissn><abstract>Argo floats have significantly improved the observation of the global ocean interior, but as the size of the database increases, so does the need for efficient tools to perform reliable quality control. It is shown here how the classical method of optimal analysis can be used to validate very large datasets before operational or scientific use. The analysis system employed is the one implemented at the Coriolis data center to produce the weekly fields of temperature and salinity, and the key data are the analysis residuals. The impacts of the various sensor errors are evaluated and twin experiments are performed to measure the system capacity in identifying these errors. It appears that for a typical data distribution, the analysis residuals extract 2/3 of the sensor error after a single analysis. The method has been applied on the full Argo Atlantic real-time dataset for the 2000-04 period (482 floats) and 15% of the floats were detected as having salinity drifts or offset. A second test was performed on the delayed mode dataset (120 floats) to check the overall consistency, and except for a few isolated anomalous profiles, the corrected datasets were found to be globally good. The last experiment performed on the Coriolis real-time products takes into account the recently discovered problem in the pressure labeling. For this experiment, a sample of 36 floats, mixing well-behaved and anomalous instruments of the 2003-06 period, was considered and the simple test designed to detect the most common systematic anomalies successfully identified the deficient floats.</abstract><cop>Boston</cop><pub>American Meteorological Society</pub><doi>10.1175/2008JTECHO552.1</doi><tpages>15</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0739-0572
ispartof Journal of atmospheric and oceanic technology, 2009-02, Vol.26 (2), p.337-351
issn 0739-0572
1520-0426
language eng
recordid cdi_hal_primary_oai_HAL_hal_00384678v1
source American Meteorological Society; EZB-FREE-00999 freely available EZB journals; Alma/SFX Local Collection
subjects Computer centers
Earth Sciences
Floats
Marine
Oceanography
Quality control
Remote sensing
Residuals
Salinity
Sciences of the Universe
Standard deviation
title Quality Control of Large Argo Datasets
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-07T03%3A53%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_hal_p&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Quality%20Control%20of%20Large%20Argo%20Datasets&rft.jtitle=Journal%20of%20atmospheric%20and%20oceanic%20technology&rft.au=Gaillard,%20Fabienne&rft.date=2009-02-01&rft.volume=26&rft.issue=2&rft.spage=337&rft.epage=351&rft.pages=337-351&rft.issn=0739-0572&rft.eissn=1520-0426&rft_id=info:doi/10.1175/2008JTECHO552.1&rft_dat=%3Cproquest_hal_p%3E1656534801%3C/proquest_hal_p%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=222530329&rft_id=info:pmid/&rfr_iscdi=true