Spatio-temporal dynamic model and parallelized ensemble Kalman filter for precipitation data

This paper presents a spatiotemporal dynamic model which allows Bayesian inference of precipitation states in some Venezuelan meteorological stations. One of the limitations that are reported in digital databases is the reliability of the records and the lack of information for certain days, weeks,...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Brazilian journal of probability and statistics 2016-11, Vol.30 (4), p.653-675
Hauptverfasser: Sánchez, Luis, Infante, Saba, Griffin, Victor, Rey, Demetrio
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 675
container_issue 4
container_start_page 653
container_title Brazilian journal of probability and statistics
container_volume 30
creator Sánchez, Luis
Infante, Saba
Griffin, Victor
Rey, Demetrio
description This paper presents a spatiotemporal dynamic model which allows Bayesian inference of precipitation states in some Venezuelan meteorological stations. One of the limitations that are reported in digital databases is the reliability of the records and the lack of information for certain days, weeks, or months. To complete the missing data, the Gibbs algorithm, a Markov Chain Monte Carlo (MCMC) procedure, was used. A feature of precipitation series is that their distribution contains discrete and continuous components implying complicated dynamics. A model is proposed based on a discrete representation of a stochastic integro-difference equation. Given the difficulty of obtaining explicit analytical expressions for the predictive posterior distribution, approximations were obtained using a sequential Monte Carlo algorithm called the parallelized ensemble Kalman filter. The proposed method permits the completion of the missing data in the series where required and secondly allows the splitting of a large database into smaller ones for separate evaluation and eventual combination of the individual results. The objective is to reduce the dimension and computational cost in order to obtain models that are able to describe the reality in real time. It was shown that the obtained models are able to predict spatially and temporally the states of rainfall for at least three to four days quickly, efficiently and accurately. Three methods of statistical validation were used to evaluate the performance of the model and showed no significant discrepancies. Speedup and efficiency factors were calculated to compare the speed of calculation using the parallelized ensemble Kalman filter algorithm with the speed of the sequential version. The improvement in speed for four pthread executions was greatest.
doi_str_mv 10.1214/15-BJPS297
format Article
fullrecord <record><control><sourceid>jstor_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1214_15_BJPS297</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><jstor_id>24913886</jstor_id><sourcerecordid>24913886</sourcerecordid><originalsourceid>FETCH-LOGICAL-c289t-2af817989259ca148c4c33c0346b9e94fb0e0ae06d837c4f623e1c1e49726f4b3</originalsourceid><addsrcrecordid>eNo9kEtLAzEUhYMoWGo37oWshWhe88hSi9ZHQaG6E4Y7mRtIyTxIsqm_3pYWz-bA4eNbHEKuBb8TUuh7UbDHt8-NNNUZmUklKlYKY87JjAuuGK8KeUkWKW35PspILfmM_GwmyH5kGftpjBBotxug95b2Y4eBwtDRCfZ7wOB_saM4JOzbgPQdQg8DdT5kjNSNkU4RrZ98PvgG2kGGK3LhICRcnHpOvp-fvpYvbP2xel0-rJmVtclMgqtFZWojC2NB6Npqq5TlSpetQaNdy5ED8rKrVWW1K6VCYQVqU8nS6VbNye3Ra-OYUkTXTNH3EHeN4M3hmkYUzemaPXxzhLcpj_GflNoIVdel-gPelmDe</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Spatio-temporal dynamic model and parallelized ensemble Kalman filter for precipitation data</title><source>Jstor Complete Legacy</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>Project Euclid Complete</source><source>JSTOR Mathematics &amp; Statistics</source><creator>Sánchez, Luis ; Infante, Saba ; Griffin, Victor ; Rey, Demetrio</creator><creatorcontrib>Sánchez, Luis ; Infante, Saba ; Griffin, Victor ; Rey, Demetrio</creatorcontrib><description>This paper presents a spatiotemporal dynamic model which allows Bayesian inference of precipitation states in some Venezuelan meteorological stations. One of the limitations that are reported in digital databases is the reliability of the records and the lack of information for certain days, weeks, or months. To complete the missing data, the Gibbs algorithm, a Markov Chain Monte Carlo (MCMC) procedure, was used. A feature of precipitation series is that their distribution contains discrete and continuous components implying complicated dynamics. A model is proposed based on a discrete representation of a stochastic integro-difference equation. Given the difficulty of obtaining explicit analytical expressions for the predictive posterior distribution, approximations were obtained using a sequential Monte Carlo algorithm called the parallelized ensemble Kalman filter. The proposed method permits the completion of the missing data in the series where required and secondly allows the splitting of a large database into smaller ones for separate evaluation and eventual combination of the individual results. The objective is to reduce the dimension and computational cost in order to obtain models that are able to describe the reality in real time. It was shown that the obtained models are able to predict spatially and temporally the states of rainfall for at least three to four days quickly, efficiently and accurately. Three methods of statistical validation were used to evaluate the performance of the model and showed no significant discrepancies. Speedup and efficiency factors were calculated to compare the speed of calculation using the parallelized ensemble Kalman filter algorithm with the speed of the sequential version. The improvement in speed for four pthread executions was greatest.</description><identifier>ISSN: 0103-0752</identifier><identifier>EISSN: 2317-6199</identifier><identifier>DOI: 10.1214/15-BJPS297</identifier><language>eng</language><publisher>Brazilian Statistical Association</publisher><subject>Algorithms ; Covariance ; Dynamic modeling ; Gaussian distributions ; Missing data ; Multilevel models ; Precipitation ; Rainfall ; Spatial models ; Weather stations</subject><ispartof>Brazilian journal of probability and statistics, 2016-11, Vol.30 (4), p.653-675</ispartof><rights>Copyright © 2016 Brazilian Statistical Association</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c289t-2af817989259ca148c4c33c0346b9e94fb0e0ae06d837c4f623e1c1e49726f4b3</citedby><cites>FETCH-LOGICAL-c289t-2af817989259ca148c4c33c0346b9e94fb0e0ae06d837c4f623e1c1e49726f4b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.jstor.org/stable/pdf/24913886$$EPDF$$P50$$Gjstor$$H</linktopdf><linktohtml>$$Uhttps://www.jstor.org/stable/24913886$$EHTML$$P50$$Gjstor$$H</linktohtml><link.rule.ids>314,776,780,799,828,27901,27902,57992,57996,58225,58229</link.rule.ids></links><search><creatorcontrib>Sánchez, Luis</creatorcontrib><creatorcontrib>Infante, Saba</creatorcontrib><creatorcontrib>Griffin, Victor</creatorcontrib><creatorcontrib>Rey, Demetrio</creatorcontrib><title>Spatio-temporal dynamic model and parallelized ensemble Kalman filter for precipitation data</title><title>Brazilian journal of probability and statistics</title><description>This paper presents a spatiotemporal dynamic model which allows Bayesian inference of precipitation states in some Venezuelan meteorological stations. One of the limitations that are reported in digital databases is the reliability of the records and the lack of information for certain days, weeks, or months. To complete the missing data, the Gibbs algorithm, a Markov Chain Monte Carlo (MCMC) procedure, was used. A feature of precipitation series is that their distribution contains discrete and continuous components implying complicated dynamics. A model is proposed based on a discrete representation of a stochastic integro-difference equation. Given the difficulty of obtaining explicit analytical expressions for the predictive posterior distribution, approximations were obtained using a sequential Monte Carlo algorithm called the parallelized ensemble Kalman filter. The proposed method permits the completion of the missing data in the series where required and secondly allows the splitting of a large database into smaller ones for separate evaluation and eventual combination of the individual results. The objective is to reduce the dimension and computational cost in order to obtain models that are able to describe the reality in real time. It was shown that the obtained models are able to predict spatially and temporally the states of rainfall for at least three to four days quickly, efficiently and accurately. Three methods of statistical validation were used to evaluate the performance of the model and showed no significant discrepancies. Speedup and efficiency factors were calculated to compare the speed of calculation using the parallelized ensemble Kalman filter algorithm with the speed of the sequential version. The improvement in speed for four pthread executions was greatest.</description><subject>Algorithms</subject><subject>Covariance</subject><subject>Dynamic modeling</subject><subject>Gaussian distributions</subject><subject>Missing data</subject><subject>Multilevel models</subject><subject>Precipitation</subject><subject>Rainfall</subject><subject>Spatial models</subject><subject>Weather stations</subject><issn>0103-0752</issn><issn>2317-6199</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><recordid>eNo9kEtLAzEUhYMoWGo37oWshWhe88hSi9ZHQaG6E4Y7mRtIyTxIsqm_3pYWz-bA4eNbHEKuBb8TUuh7UbDHt8-NNNUZmUklKlYKY87JjAuuGK8KeUkWKW35PspILfmM_GwmyH5kGftpjBBotxug95b2Y4eBwtDRCfZ7wOB_saM4JOzbgPQdQg8DdT5kjNSNkU4RrZ98PvgG2kGGK3LhICRcnHpOvp-fvpYvbP2xel0-rJmVtclMgqtFZWojC2NB6Npqq5TlSpetQaNdy5ED8rKrVWW1K6VCYQVqU8nS6VbNye3Ra-OYUkTXTNH3EHeN4M3hmkYUzemaPXxzhLcpj_GflNoIVdel-gPelmDe</recordid><startdate>20161101</startdate><enddate>20161101</enddate><creator>Sánchez, Luis</creator><creator>Infante, Saba</creator><creator>Griffin, Victor</creator><creator>Rey, Demetrio</creator><general>Brazilian Statistical Association</general><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20161101</creationdate><title>Spatio-temporal dynamic model and parallelized ensemble Kalman filter for precipitation data</title><author>Sánchez, Luis ; Infante, Saba ; Griffin, Victor ; Rey, Demetrio</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c289t-2af817989259ca148c4c33c0346b9e94fb0e0ae06d837c4f623e1c1e49726f4b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Algorithms</topic><topic>Covariance</topic><topic>Dynamic modeling</topic><topic>Gaussian distributions</topic><topic>Missing data</topic><topic>Multilevel models</topic><topic>Precipitation</topic><topic>Rainfall</topic><topic>Spatial models</topic><topic>Weather stations</topic><toplevel>online_resources</toplevel><creatorcontrib>Sánchez, Luis</creatorcontrib><creatorcontrib>Infante, Saba</creatorcontrib><creatorcontrib>Griffin, Victor</creatorcontrib><creatorcontrib>Rey, Demetrio</creatorcontrib><collection>CrossRef</collection><jtitle>Brazilian journal of probability and statistics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sánchez, Luis</au><au>Infante, Saba</au><au>Griffin, Victor</au><au>Rey, Demetrio</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Spatio-temporal dynamic model and parallelized ensemble Kalman filter for precipitation data</atitle><jtitle>Brazilian journal of probability and statistics</jtitle><date>2016-11-01</date><risdate>2016</risdate><volume>30</volume><issue>4</issue><spage>653</spage><epage>675</epage><pages>653-675</pages><issn>0103-0752</issn><eissn>2317-6199</eissn><abstract>This paper presents a spatiotemporal dynamic model which allows Bayesian inference of precipitation states in some Venezuelan meteorological stations. One of the limitations that are reported in digital databases is the reliability of the records and the lack of information for certain days, weeks, or months. To complete the missing data, the Gibbs algorithm, a Markov Chain Monte Carlo (MCMC) procedure, was used. A feature of precipitation series is that their distribution contains discrete and continuous components implying complicated dynamics. A model is proposed based on a discrete representation of a stochastic integro-difference equation. Given the difficulty of obtaining explicit analytical expressions for the predictive posterior distribution, approximations were obtained using a sequential Monte Carlo algorithm called the parallelized ensemble Kalman filter. The proposed method permits the completion of the missing data in the series where required and secondly allows the splitting of a large database into smaller ones for separate evaluation and eventual combination of the individual results. The objective is to reduce the dimension and computational cost in order to obtain models that are able to describe the reality in real time. It was shown that the obtained models are able to predict spatially and temporally the states of rainfall for at least three to four days quickly, efficiently and accurately. Three methods of statistical validation were used to evaluate the performance of the model and showed no significant discrepancies. Speedup and efficiency factors were calculated to compare the speed of calculation using the parallelized ensemble Kalman filter algorithm with the speed of the sequential version. The improvement in speed for four pthread executions was greatest.</abstract><pub>Brazilian Statistical Association</pub><doi>10.1214/15-BJPS297</doi><tpages>23</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0103-0752
ispartof Brazilian journal of probability and statistics, 2016-11, Vol.30 (4), p.653-675
issn 0103-0752
2317-6199
language eng
recordid cdi_crossref_primary_10_1214_15_BJPS297
source Jstor Complete Legacy; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; Project Euclid Complete; JSTOR Mathematics & Statistics
subjects Algorithms
Covariance
Dynamic modeling
Gaussian distributions
Missing data
Multilevel models
Precipitation
Rainfall
Spatial models
Weather stations
title Spatio-temporal dynamic model and parallelized ensemble Kalman filter for precipitation data
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T12%3A36%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-jstor_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Spatio-temporal%20dynamic%20model%20and%20parallelized%20ensemble%20Kalman%20filter%20for%20precipitation%20data&rft.jtitle=Brazilian%20journal%20of%20probability%20and%20statistics&rft.au=S%C3%A1nchez,%20Luis&rft.date=2016-11-01&rft.volume=30&rft.issue=4&rft.spage=653&rft.epage=675&rft.pages=653-675&rft.issn=0103-0752&rft.eissn=2317-6199&rft_id=info:doi/10.1214/15-BJPS297&rft_dat=%3Cjstor_cross%3E24913886%3C/jstor_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_jstor_id=24913886&rfr_iscdi=true