Retrieval of missing values in water temperature series using a data-driven model
A measurement buoy with attached sensors has been deployed at our study area to monitor hydrodynamics, water properties, and water quality conditions. High-resolution temporal data have been collected and streamed into an online system that is accessible in nearly real-time. However, in certain circ...
Gespeichert in:
| Veröffentlicht in: | Earth science informatics 2015-12, Vol.8 (4), p.787-798 |
|---|---|
| Hauptverfasser: | , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 798 |
|---|---|
| container_issue | 4 |
| container_start_page | 787 |
| container_title | Earth science informatics |
| container_volume | 8 |
| creator | Mulia, Iyan E. Asano, Toshiyuki Tkalich, Pavel |
| description | A measurement buoy with attached sensors has been deployed at our study area to monitor hydrodynamics, water properties, and water quality conditions. High-resolution temporal data have been collected and streamed into an online system that is accessible in nearly real-time. However, in certain circumstances the sensors may fail to provide continuous and high quality data. This results in gaps or corrupted values. The aim of this study was to reconstruct the faulty values. This paper proposes a method based on a data-driven model, using an Artificial Neural Network combined with a Genetic Algorithm to generate a synthetic data series. The generated data can be used as a patch for the incomplete measured data. Additional improvements were achieved by removing seasonal patterns from the original time series using a wavelet decomposition prior to the data-driven model training process. Comparisons with a standard missing-data imputation method using the Kohonen self-organizing map were made to further asses the performance of the proposed data-driven model. The algorithm was applied to water temperature data, but the same approach is applicable to other parameters of interest. |
| doi_str_mv | 10.1007/s12145-015-0210-x |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1888964501</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3870061671</sourcerecordid><originalsourceid>FETCH-LOGICAL-c452t-56025c03608cc5f4cadc9634dc53fba6b2762bea35c6b680852373e552cf6ff23</originalsourceid><addsrcrecordid>eNqFkU1LAzEQhoMoWGp_gLeAFy-r-d70KEWtUBBFzyGbnZSV_ajJbq3_3tQVEUE8hMkwz_syw4vQKSUXlJD8MlJGhcwITY9Rku0O0IRqlTqh6eH3P-fHaBZjVRBOmeKM6Ql6eIQ-VLC1Ne48bqo0btc4tQNEXLX4zfYQcA_NBoLthwA4QuIjHj5Bi0vb26wM1RZa3HQl1CfoyNs6wuyrTtHzzfXTYpmt7m_vFlerzAnJ-kwqwqQjXBHtnPTC2dLNFRelk9wXVhUsV6wAy6VThdJES8ZzDlIy55X3jE_R-ei7Cd1r2rY3aXsHdW1b6IZoqNZ6roQk9H80zzURhMz3rme_0JduCG06JFFcUKlyqhJFR8qFLsYA3mxC1djwbigx-0jMGIlJkZh9JGaXNGzUxMS2awg_nP8UfQAgg427</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1734156716</pqid></control><display><type>article</type><title>Retrieval of missing values in water temperature series using a data-driven model</title><source>SpringerNature Journals</source><creator>Mulia, Iyan E. ; Asano, Toshiyuki ; Tkalich, Pavel</creator><creatorcontrib>Mulia, Iyan E. ; Asano, Toshiyuki ; Tkalich, Pavel</creatorcontrib><description>A measurement buoy with attached sensors has been deployed at our study area to monitor hydrodynamics, water properties, and water quality conditions. High-resolution temporal data have been collected and streamed into an online system that is accessible in nearly real-time. However, in certain circumstances the sensors may fail to provide continuous and high quality data. This results in gaps or corrupted values. The aim of this study was to reconstruct the faulty values. This paper proposes a method based on a data-driven model, using an Artificial Neural Network combined with a Genetic Algorithm to generate a synthetic data series. The generated data can be used as a patch for the incomplete measured data. Additional improvements were achieved by removing seasonal patterns from the original time series using a wavelet decomposition prior to the data-driven model training process. Comparisons with a standard missing-data imputation method using the Kohonen self-organizing map were made to further asses the performance of the proposed data-driven model. The algorithm was applied to water temperature data, but the same approach is applicable to other parameters of interest.</description><identifier>ISSN: 1865-0473</identifier><identifier>EISSN: 1865-0481</identifier><identifier>DOI: 10.1007/s12145-015-0210-x</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Accessibility ; Algorithms ; Earth and Environmental Science ; Earth Sciences ; Earth System Sciences ; Genetic algorithms ; Hydrodynamics ; Information Systems Applications (incl.Internet) ; Monitors ; Neural networks ; Ontology ; Research Article ; Retrieval ; Seawater ; Sensors ; Simulation and Modeling ; Space Exploration and Astronautics ; Space Sciences (including Extraterrestrial Physics ; Temperature ; Water properties ; Water quality ; Water temperature</subject><ispartof>Earth science informatics, 2015-12, Vol.8 (4), p.787-798</ispartof><rights>Springer-Verlag Berlin Heidelberg 2015</rights><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c452t-56025c03608cc5f4cadc9634dc53fba6b2762bea35c6b680852373e552cf6ff23</citedby><cites>FETCH-LOGICAL-c452t-56025c03608cc5f4cadc9634dc53fba6b2762bea35c6b680852373e552cf6ff23</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s12145-015-0210-x$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s12145-015-0210-x$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Mulia, Iyan E.</creatorcontrib><creatorcontrib>Asano, Toshiyuki</creatorcontrib><creatorcontrib>Tkalich, Pavel</creatorcontrib><title>Retrieval of missing values in water temperature series using a data-driven model</title><title>Earth science informatics</title><addtitle>Earth Sci Inform</addtitle><description>A measurement buoy with attached sensors has been deployed at our study area to monitor hydrodynamics, water properties, and water quality conditions. High-resolution temporal data have been collected and streamed into an online system that is accessible in nearly real-time. However, in certain circumstances the sensors may fail to provide continuous and high quality data. This results in gaps or corrupted values. The aim of this study was to reconstruct the faulty values. This paper proposes a method based on a data-driven model, using an Artificial Neural Network combined with a Genetic Algorithm to generate a synthetic data series. The generated data can be used as a patch for the incomplete measured data. Additional improvements were achieved by removing seasonal patterns from the original time series using a wavelet decomposition prior to the data-driven model training process. Comparisons with a standard missing-data imputation method using the Kohonen self-organizing map were made to further asses the performance of the proposed data-driven model. The algorithm was applied to water temperature data, but the same approach is applicable to other parameters of interest.</description><subject>Accessibility</subject><subject>Algorithms</subject><subject>Earth and Environmental Science</subject><subject>Earth Sciences</subject><subject>Earth System Sciences</subject><subject>Genetic algorithms</subject><subject>Hydrodynamics</subject><subject>Information Systems Applications (incl.Internet)</subject><subject>Monitors</subject><subject>Neural networks</subject><subject>Ontology</subject><subject>Research Article</subject><subject>Retrieval</subject><subject>Seawater</subject><subject>Sensors</subject><subject>Simulation and Modeling</subject><subject>Space Exploration and Astronautics</subject><subject>Space Sciences (including Extraterrestrial Physics</subject><subject>Temperature</subject><subject>Water properties</subject><subject>Water quality</subject><subject>Water temperature</subject><issn>1865-0473</issn><issn>1865-0481</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><recordid>eNqFkU1LAzEQhoMoWGp_gLeAFy-r-d70KEWtUBBFzyGbnZSV_ajJbq3_3tQVEUE8hMkwz_syw4vQKSUXlJD8MlJGhcwITY9Rku0O0IRqlTqh6eH3P-fHaBZjVRBOmeKM6Ql6eIQ-VLC1Ne48bqo0btc4tQNEXLX4zfYQcA_NBoLthwA4QuIjHj5Bi0vb26wM1RZa3HQl1CfoyNs6wuyrTtHzzfXTYpmt7m_vFlerzAnJ-kwqwqQjXBHtnPTC2dLNFRelk9wXVhUsV6wAy6VThdJES8ZzDlIy55X3jE_R-ei7Cd1r2rY3aXsHdW1b6IZoqNZ6roQk9H80zzURhMz3rme_0JduCG06JFFcUKlyqhJFR8qFLsYA3mxC1djwbigx-0jMGIlJkZh9JGaXNGzUxMS2awg_nP8UfQAgg427</recordid><startdate>20151201</startdate><enddate>20151201</enddate><creator>Mulia, Iyan E.</creator><creator>Asano, Toshiyuki</creator><creator>Tkalich, Pavel</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7TG</scope><scope>7XB</scope><scope>88I</scope><scope>8AL</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>BKSAR</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>KL.</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0N</scope><scope>M2P</scope><scope>P5Z</scope><scope>P62</scope><scope>PCBAR</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope><scope>7QH</scope><scope>7UA</scope><scope>C1K</scope><scope>F1W</scope><scope>H97</scope><scope>L.G</scope></search><sort><creationdate>20151201</creationdate><title>Retrieval of missing values in water temperature series using a data-driven model</title><author>Mulia, Iyan E. ; Asano, Toshiyuki ; Tkalich, Pavel</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c452t-56025c03608cc5f4cadc9634dc53fba6b2762bea35c6b680852373e552cf6ff23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Accessibility</topic><topic>Algorithms</topic><topic>Earth and Environmental Science</topic><topic>Earth Sciences</topic><topic>Earth System Sciences</topic><topic>Genetic algorithms</topic><topic>Hydrodynamics</topic><topic>Information Systems Applications (incl.Internet)</topic><topic>Monitors</topic><topic>Neural networks</topic><topic>Ontology</topic><topic>Research Article</topic><topic>Retrieval</topic><topic>Seawater</topic><topic>Sensors</topic><topic>Simulation and Modeling</topic><topic>Space Exploration and Astronautics</topic><topic>Space Sciences (including Extraterrestrial Physics</topic><topic>Temperature</topic><topic>Water properties</topic><topic>Water quality</topic><topic>Water temperature</topic><toplevel>online_resources</toplevel><creatorcontrib>Mulia, Iyan E.</creatorcontrib><creatorcontrib>Asano, Toshiyuki</creatorcontrib><creatorcontrib>Tkalich, Pavel</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Science Database (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>Earth, Atmospheric & Aquatic Science Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>Computing Database</collection><collection>Science Database</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Earth, Atmospheric & Aquatic Science Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><collection>Aqualine</collection><collection>Water Resources Abstracts</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) 3: Aquatic Pollution & Environmental Quality</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) Professional</collection><jtitle>Earth science informatics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Mulia, Iyan E.</au><au>Asano, Toshiyuki</au><au>Tkalich, Pavel</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Retrieval of missing values in water temperature series using a data-driven model</atitle><jtitle>Earth science informatics</jtitle><stitle>Earth Sci Inform</stitle><date>2015-12-01</date><risdate>2015</risdate><volume>8</volume><issue>4</issue><spage>787</spage><epage>798</epage><pages>787-798</pages><issn>1865-0473</issn><eissn>1865-0481</eissn><abstract>A measurement buoy with attached sensors has been deployed at our study area to monitor hydrodynamics, water properties, and water quality conditions. High-resolution temporal data have been collected and streamed into an online system that is accessible in nearly real-time. However, in certain circumstances the sensors may fail to provide continuous and high quality data. This results in gaps or corrupted values. The aim of this study was to reconstruct the faulty values. This paper proposes a method based on a data-driven model, using an Artificial Neural Network combined with a Genetic Algorithm to generate a synthetic data series. The generated data can be used as a patch for the incomplete measured data. Additional improvements were achieved by removing seasonal patterns from the original time series using a wavelet decomposition prior to the data-driven model training process. Comparisons with a standard missing-data imputation method using the Kohonen self-organizing map were made to further asses the performance of the proposed data-driven model. The algorithm was applied to water temperature data, but the same approach is applicable to other parameters of interest.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s12145-015-0210-x</doi><tpages>12</tpages></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1865-0473 |
| ispartof | Earth science informatics, 2015-12, Vol.8 (4), p.787-798 |
| issn | 1865-0473 1865-0481 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_1888964501 |
| source | SpringerNature Journals |
| subjects | Accessibility Algorithms Earth and Environmental Science Earth Sciences Earth System Sciences Genetic algorithms Hydrodynamics Information Systems Applications (incl.Internet) Monitors Neural networks Ontology Research Article Retrieval Seawater Sensors Simulation and Modeling Space Exploration and Astronautics Space Sciences (including Extraterrestrial Physics Temperature Water properties Water quality Water temperature |
| title | Retrieval of missing values in water temperature series using a data-driven model |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-21T14%3A53%3A36IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Retrieval%20of%20missing%20values%20in%20water%20temperature%20series%20using%20a%20data-driven%20model&rft.jtitle=Earth%20science%20informatics&rft.au=Mulia,%20Iyan%20E.&rft.date=2015-12-01&rft.volume=8&rft.issue=4&rft.spage=787&rft.epage=798&rft.pages=787-798&rft.issn=1865-0473&rft.eissn=1865-0481&rft_id=info:doi/10.1007/s12145-015-0210-x&rft_dat=%3Cproquest_cross%3E3870061671%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1734156716&rft_id=info:pmid/&rfr_iscdi=true |