A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping

An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a global assimilation into subproblems. This unsupervised loca...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Cheng, Sibo, Argaud, Jean-Philippe, Iooss, Bertrand, Ponçot, Angélique, Lucor, Didier
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Cheng, Sibo
Argaud, Jean-Philippe
Iooss, Bertrand
Ponçot, Angélique
Lucor, Didier
description An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a global assimilation into subproblems. This unsupervised localization technique based on a linearizedstate-observation measure is general and does not rely on any prior information such as relevant spatial scales, empirical cut-off radius or homogeneity assumptions. It automatically segregates the state and observation variables in an optimal number of clusters (otherwise named as subspaces or communities), more amenable to scalable data assimilation.The application of this method does not require underlying block-diagonal structures of prior covariance matrices. In order to deal with inter-cluster connectivity, two alternative data adaptations are proposed. Once the localization is completed, an adaptive covariance diagnosis and tuning is performed within each cluster. Numerical tests show that this approach is less costly and more flexible than a global covariance tuning, and most often results in more accurate background and observations error covariances.
doi_str_mv 10.48550/arxiv.2001.11860
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2001_11860</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2001_11860</sourcerecordid><originalsourceid>FETCH-LOGICAL-a670-f7a8b7c6d0e106936662e823b94748584f92103fe25196c16d884f006f63526c3</originalsourceid><addsrcrecordid>eNotkLtuwzAMRbV0KNJ-QKfwB-zqYcvyGAR9AQG6ZDdoWUoE2JYhKUbbsV9eJ-5EgheHBA8hT4zmhSpL-ozhy805p5TljClJ78nvDk4BpzPo_hKTCW48AU5T8KjPkDz0XmPvfjA5P4L1AbDDKbnZgPYzBoejNpAu45VzI3SYEDBGN7h-ZVqMpoOliQmTyXwbTZjXaFgOLdwDubPYR_P4Xzfk-Ppy3L9nh8-3j_3ukKGsaGYrVG2lZUcNo7IWUkpuFBdtXVTLc6qwNWdUWMNLVkvNZKeWGaXSSlFyqcWGbNe1NwnNFNyA4bu5ymhuMsQfsvZb3A</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping</title><source>arXiv.org</source><creator>Cheng, Sibo ; Argaud, Jean-Philippe ; Iooss, Bertrand ; Ponçot, Angélique ; Lucor, Didier</creator><creatorcontrib>Cheng, Sibo ; Argaud, Jean-Philippe ; Iooss, Bertrand ; Ponçot, Angélique ; Lucor, Didier</creatorcontrib><description>An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a global assimilation into subproblems. This unsupervised localization technique based on a linearizedstate-observation measure is general and does not rely on any prior information such as relevant spatial scales, empirical cut-off radius or homogeneity assumptions. It automatically segregates the state and observation variables in an optimal number of clusters (otherwise named as subspaces or communities), more amenable to scalable data assimilation.The application of this method does not require underlying block-diagonal structures of prior covariance matrices. In order to deal with inter-cluster connectivity, two alternative data adaptations are proposed. Once the localization is completed, an adaptive covariance diagnosis and tuning is performed within each cluster. Numerical tests show that this approach is less costly and more flexible than a global covariance tuning, and most often results in more accurate background and observations error covariances.</description><identifier>DOI: 10.48550/arxiv.2001.11860</identifier><language>eng</language><subject>Mathematics - Statistics Theory ; Statistics - Computation ; Statistics - Theory</subject><creationdate>2020-01</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,881</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2001.11860$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2001.11860$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Cheng, Sibo</creatorcontrib><creatorcontrib>Argaud, Jean-Philippe</creatorcontrib><creatorcontrib>Iooss, Bertrand</creatorcontrib><creatorcontrib>Ponçot, Angélique</creatorcontrib><creatorcontrib>Lucor, Didier</creatorcontrib><title>A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping</title><description>An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a global assimilation into subproblems. This unsupervised localization technique based on a linearizedstate-observation measure is general and does not rely on any prior information such as relevant spatial scales, empirical cut-off radius or homogeneity assumptions. It automatically segregates the state and observation variables in an optimal number of clusters (otherwise named as subspaces or communities), more amenable to scalable data assimilation.The application of this method does not require underlying block-diagonal structures of prior covariance matrices. In order to deal with inter-cluster connectivity, two alternative data adaptations are proposed. Once the localization is completed, an adaptive covariance diagnosis and tuning is performed within each cluster. Numerical tests show that this approach is less costly and more flexible than a global covariance tuning, and most often results in more accurate background and observations error covariances.</description><subject>Mathematics - Statistics Theory</subject><subject>Statistics - Computation</subject><subject>Statistics - Theory</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotkLtuwzAMRbV0KNJ-QKfwB-zqYcvyGAR9AQG6ZDdoWUoE2JYhKUbbsV9eJ-5EgheHBA8hT4zmhSpL-ozhy805p5TljClJ78nvDk4BpzPo_hKTCW48AU5T8KjPkDz0XmPvfjA5P4L1AbDDKbnZgPYzBoejNpAu45VzI3SYEDBGN7h-ZVqMpoOliQmTyXwbTZjXaFgOLdwDubPYR_P4Xzfk-Ppy3L9nh8-3j_3ukKGsaGYrVG2lZUcNo7IWUkpuFBdtXVTLc6qwNWdUWMNLVkvNZKeWGaXSSlFyqcWGbNe1NwnNFNyA4bu5ymhuMsQfsvZb3A</recordid><startdate>20200131</startdate><enddate>20200131</enddate><creator>Cheng, Sibo</creator><creator>Argaud, Jean-Philippe</creator><creator>Iooss, Bertrand</creator><creator>Ponçot, Angélique</creator><creator>Lucor, Didier</creator><scope>AKZ</scope><scope>EPD</scope><scope>GOX</scope></search><sort><creationdate>20200131</creationdate><title>A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping</title><author>Cheng, Sibo ; Argaud, Jean-Philippe ; Iooss, Bertrand ; Ponçot, Angélique ; Lucor, Didier</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a670-f7a8b7c6d0e106936662e823b94748584f92103fe25196c16d884f006f63526c3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Mathematics - Statistics Theory</topic><topic>Statistics - Computation</topic><topic>Statistics - Theory</topic><toplevel>online_resources</toplevel><creatorcontrib>Cheng, Sibo</creatorcontrib><creatorcontrib>Argaud, Jean-Philippe</creatorcontrib><creatorcontrib>Iooss, Bertrand</creatorcontrib><creatorcontrib>Ponçot, Angélique</creatorcontrib><creatorcontrib>Lucor, Didier</creatorcontrib><collection>arXiv Mathematics</collection><collection>arXiv Statistics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Cheng, Sibo</au><au>Argaud, Jean-Philippe</au><au>Iooss, Bertrand</au><au>Ponçot, Angélique</au><au>Lucor, Didier</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping</atitle><date>2020-01-31</date><risdate>2020</risdate><abstract>An original graph clustering approach to efficient localization of error covariances is proposed within an ensemble-variational data assimilation framework. Here the localization term is very generic and refers to the idea of breaking up a global assimilation into subproblems. This unsupervised localization technique based on a linearizedstate-observation measure is general and does not rely on any prior information such as relevant spatial scales, empirical cut-off radius or homogeneity assumptions. It automatically segregates the state and observation variables in an optimal number of clusters (otherwise named as subspaces or communities), more amenable to scalable data assimilation.The application of this method does not require underlying block-diagonal structures of prior covariance matrices. In order to deal with inter-cluster connectivity, two alternative data adaptations are proposed. Once the localization is completed, an adaptive covariance diagnosis and tuning is performed within each cluster. Numerical tests show that this approach is less costly and more flexible than a global covariance tuning, and most often results in more accurate background and observations error covariances.</abstract><doi>10.48550/arxiv.2001.11860</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2001.11860
ispartof
issn
language eng
recordid cdi_arxiv_primary_2001_11860
source arXiv.org
subjects Mathematics - Statistics Theory
Statistics - Computation
Statistics - Theory
title A graph clustering approach to localization for adaptive covariance tuning in data assimilation based on state-observation mapping
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-23T07%3A27%3A35IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20graph%20clustering%20approach%20to%20localization%20for%20adaptive%20covariance%20tuning%20in%20data%20assimilation%20based%20on%20state-observation%20mapping&rft.au=Cheng,%20Sibo&rft.date=2020-01-31&rft_id=info:doi/10.48550/arxiv.2001.11860&rft_dat=%3Carxiv_GOX%3E2001_11860%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true