Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time

A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observat...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Remote sensing of environment 2015-06, Vol.162, p.67-83
Hauptverfasser: Zhu, Zhe, Woodcock, Curtis E., Holden, Christopher, Yang, Zhiqiang
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 83
container_issue
container_start_page 67
container_title Remote sensing of environment
container_volume 162
creator Zhu, Zhe
Woodcock, Curtis E.
Holden, Christopher
Yang, Zhiqiang
description A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products. •All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The pred
doi_str_mv 10.1016/j.rse.2015.02.009
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1770301288</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0034425715000590</els_id><sourcerecordid>1732815496</sourcerecordid><originalsourceid>FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</originalsourceid><addsrcrecordid>eNqNkUFvEzEQhS0EEqH0B3DzkcsuY-869sIJVbRUigSH9myNvbPB0cZbbCdSjvzzugQ4VpxmNPO9keY9xt4JaAWI9YddmzK1EoRqQbYAwwu2EkYPDWjoX7IVQNc3vVT6NXuT8w4qaLRYsV83FClhCXHL8ymWH1SC5xuMY8bCwx63lLnDTCNfIsd55njEMKOb6R81YsGP_HuiMfjfh_4u8iFN6IknmmbyBWPt6xjjiW_DkSIvYU9v2asJ50yXf-oFu7_-cnf1tdl8u7m9-rxpfK9ladQ0EYBxqNCtZdcZpyat3XocCBBpUgrc4HqPneslemnQjIpQaSQlOwPdBXt_vvuQlp8HysXuQ_Y0zxhpOWQrtIYOhDTmP9BOGqH6YV1RcUZ9WnKuj9qHVF1LJyvAPiVjd7YmY5-SsSBtTaZqPp01VN89Bko2-0DVnDGkapMdl_CM-hE5rZh_</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1732815496</pqid></control><display><type>article</type><title>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Zhu, Zhe ; Woodcock, Curtis E. ; Holden, Christopher ; Yang, Zhiqiang</creator><creatorcontrib>Zhu, Zhe ; Woodcock, Curtis E. ; Holden, Christopher ; Yang, Zhiqiang</creatorcontrib><description>A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products. •All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The prediction accuracy is similar in magnitude to the noise levels in Landsat data.</description><identifier>ISSN: 0034-4257</identifier><identifier>EISSN: 1879-0704</identifier><identifier>DOI: 10.1016/j.rse.2015.02.009</identifier><language>eng</language><publisher>Elsevier Inc</publisher><subject>Algorithms ; Clouds ; Landsat ; Mathematical models ; Predict ; Reflectance ; Reflectivity ; Satellite imagery ; Snow ; Surface reflectance ; Synthetic ; Time series ; Time series model</subject><ispartof>Remote sensing of environment, 2015-06, Vol.162, p.67-83</ispartof><rights>2015 Elsevier Inc.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</citedby><cites>FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.rse.2015.02.009$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Zhu, Zhe</creatorcontrib><creatorcontrib>Woodcock, Curtis E.</creatorcontrib><creatorcontrib>Holden, Christopher</creatorcontrib><creatorcontrib>Yang, Zhiqiang</creatorcontrib><title>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</title><title>Remote sensing of environment</title><description>A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products. •All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The prediction accuracy is similar in magnitude to the noise levels in Landsat data.</description><subject>Algorithms</subject><subject>Clouds</subject><subject>Landsat</subject><subject>Mathematical models</subject><subject>Predict</subject><subject>Reflectance</subject><subject>Reflectivity</subject><subject>Satellite imagery</subject><subject>Snow</subject><subject>Surface reflectance</subject><subject>Synthetic</subject><subject>Time series</subject><subject>Time series model</subject><issn>0034-4257</issn><issn>1879-0704</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><recordid>eNqNkUFvEzEQhS0EEqH0B3DzkcsuY-869sIJVbRUigSH9myNvbPB0cZbbCdSjvzzugQ4VpxmNPO9keY9xt4JaAWI9YddmzK1EoRqQbYAwwu2EkYPDWjoX7IVQNc3vVT6NXuT8w4qaLRYsV83FClhCXHL8ymWH1SC5xuMY8bCwx63lLnDTCNfIsd55njEMKOb6R81YsGP_HuiMfjfh_4u8iFN6IknmmbyBWPt6xjjiW_DkSIvYU9v2asJ50yXf-oFu7_-cnf1tdl8u7m9-rxpfK9ladQ0EYBxqNCtZdcZpyat3XocCBBpUgrc4HqPneslemnQjIpQaSQlOwPdBXt_vvuQlp8HysXuQ_Y0zxhpOWQrtIYOhDTmP9BOGqH6YV1RcUZ9WnKuj9qHVF1LJyvAPiVjd7YmY5-SsSBtTaZqPp01VN89Bko2-0DVnDGkapMdl_CM-hE5rZh_</recordid><startdate>20150601</startdate><enddate>20150601</enddate><creator>Zhu, Zhe</creator><creator>Woodcock, Curtis E.</creator><creator>Holden, Christopher</creator><creator>Yang, Zhiqiang</creator><general>Elsevier Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SN</scope><scope>7ST</scope><scope>7U6</scope><scope>7UA</scope><scope>C1K</scope><scope>F1W</scope><scope>H96</scope><scope>L.G</scope><scope>SOI</scope><scope>7SU</scope><scope>8FD</scope><scope>FR3</scope><scope>H8D</scope><scope>KR7</scope><scope>L7M</scope></search><sort><creationdate>20150601</creationdate><title>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</title><author>Zhu, Zhe ; Woodcock, Curtis E. ; Holden, Christopher ; Yang, Zhiqiang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Algorithms</topic><topic>Clouds</topic><topic>Landsat</topic><topic>Mathematical models</topic><topic>Predict</topic><topic>Reflectance</topic><topic>Reflectivity</topic><topic>Satellite imagery</topic><topic>Snow</topic><topic>Surface reflectance</topic><topic>Synthetic</topic><topic>Time series</topic><topic>Time series model</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhu, Zhe</creatorcontrib><creatorcontrib>Woodcock, Curtis E.</creatorcontrib><creatorcontrib>Holden, Christopher</creatorcontrib><creatorcontrib>Yang, Zhiqiang</creatorcontrib><collection>CrossRef</collection><collection>Ecology Abstracts</collection><collection>Environment Abstracts</collection><collection>Sustainability Science Abstracts</collection><collection>Water Resources Abstracts</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy &amp; Non-Living Resources</collection><collection>Aquatic Science &amp; Fisheries Abstracts (ASFA) Professional</collection><collection>Environment Abstracts</collection><collection>Environmental Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Remote sensing of environment</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhu, Zhe</au><au>Woodcock, Curtis E.</au><au>Holden, Christopher</au><au>Yang, Zhiqiang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</atitle><jtitle>Remote sensing of environment</jtitle><date>2015-06-01</date><risdate>2015</risdate><volume>162</volume><spage>67</spage><epage>83</epage><pages>67-83</pages><issn>0034-4257</issn><eissn>1879-0704</eissn><abstract>A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products. •All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The prediction accuracy is similar in magnitude to the noise levels in Landsat data.</abstract><pub>Elsevier Inc</pub><doi>10.1016/j.rse.2015.02.009</doi><tpages>17</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0034-4257
ispartof Remote sensing of environment, 2015-06, Vol.162, p.67-83
issn 0034-4257
1879-0704
language eng
recordid cdi_proquest_miscellaneous_1770301288
source Elsevier ScienceDirect Journals Complete
subjects Algorithms
Clouds
Landsat
Mathematical models
Predict
Reflectance
Reflectivity
Satellite imagery
Snow
Surface reflectance
Synthetic
Time series
Time series model
title Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T05%3A09%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Generating%20synthetic%20Landsat%20images%20based%20on%20all%20available%20Landsat%20data:%20Predicting%20Landsat%20surface%20reflectance%20at%20any%20given%20time&rft.jtitle=Remote%20sensing%20of%20environment&rft.au=Zhu,%20Zhe&rft.date=2015-06-01&rft.volume=162&rft.spage=67&rft.epage=83&rft.pages=67-83&rft.issn=0034-4257&rft.eissn=1879-0704&rft_id=info:doi/10.1016/j.rse.2015.02.009&rft_dat=%3Cproquest_cross%3E1732815496%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1732815496&rft_id=info:pmid/&rft_els_id=S0034425715000590&rfr_iscdi=true