Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time
A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observat...
Gespeichert in:
Veröffentlicht in: | Remote sensing of environment 2015-06, Vol.162, p.67-83 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 83 |
---|---|
container_issue | |
container_start_page | 67 |
container_title | Remote sensing of environment |
container_volume | 162 |
creator | Zhu, Zhe Woodcock, Curtis E. Holden, Christopher Yang, Zhiqiang |
description | A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products.
•All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The pred |
doi_str_mv | 10.1016/j.rse.2015.02.009 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1770301288</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0034425715000590</els_id><sourcerecordid>1732815496</sourcerecordid><originalsourceid>FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</originalsourceid><addsrcrecordid>eNqNkUFvEzEQhS0EEqH0B3DzkcsuY-869sIJVbRUigSH9myNvbPB0cZbbCdSjvzzugQ4VpxmNPO9keY9xt4JaAWI9YddmzK1EoRqQbYAwwu2EkYPDWjoX7IVQNc3vVT6NXuT8w4qaLRYsV83FClhCXHL8ymWH1SC5xuMY8bCwx63lLnDTCNfIsd55njEMKOb6R81YsGP_HuiMfjfh_4u8iFN6IknmmbyBWPt6xjjiW_DkSIvYU9v2asJ50yXf-oFu7_-cnf1tdl8u7m9-rxpfK9ladQ0EYBxqNCtZdcZpyat3XocCBBpUgrc4HqPneslemnQjIpQaSQlOwPdBXt_vvuQlp8HysXuQ_Y0zxhpOWQrtIYOhDTmP9BOGqH6YV1RcUZ9WnKuj9qHVF1LJyvAPiVjd7YmY5-SsSBtTaZqPp01VN89Bko2-0DVnDGkapMdl_CM-hE5rZh_</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1732815496</pqid></control><display><type>article</type><title>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Zhu, Zhe ; Woodcock, Curtis E. ; Holden, Christopher ; Yang, Zhiqiang</creator><creatorcontrib>Zhu, Zhe ; Woodcock, Curtis E. ; Holden, Christopher ; Yang, Zhiqiang</creatorcontrib><description>A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products.
•All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The prediction accuracy is similar in magnitude to the noise levels in Landsat data.</description><identifier>ISSN: 0034-4257</identifier><identifier>EISSN: 1879-0704</identifier><identifier>DOI: 10.1016/j.rse.2015.02.009</identifier><language>eng</language><publisher>Elsevier Inc</publisher><subject>Algorithms ; Clouds ; Landsat ; Mathematical models ; Predict ; Reflectance ; Reflectivity ; Satellite imagery ; Snow ; Surface reflectance ; Synthetic ; Time series ; Time series model</subject><ispartof>Remote sensing of environment, 2015-06, Vol.162, p.67-83</ispartof><rights>2015 Elsevier Inc.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</citedby><cites>FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.rse.2015.02.009$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Zhu, Zhe</creatorcontrib><creatorcontrib>Woodcock, Curtis E.</creatorcontrib><creatorcontrib>Holden, Christopher</creatorcontrib><creatorcontrib>Yang, Zhiqiang</creatorcontrib><title>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</title><title>Remote sensing of environment</title><description>A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products.
•All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The prediction accuracy is similar in magnitude to the noise levels in Landsat data.</description><subject>Algorithms</subject><subject>Clouds</subject><subject>Landsat</subject><subject>Mathematical models</subject><subject>Predict</subject><subject>Reflectance</subject><subject>Reflectivity</subject><subject>Satellite imagery</subject><subject>Snow</subject><subject>Surface reflectance</subject><subject>Synthetic</subject><subject>Time series</subject><subject>Time series model</subject><issn>0034-4257</issn><issn>1879-0704</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><recordid>eNqNkUFvEzEQhS0EEqH0B3DzkcsuY-869sIJVbRUigSH9myNvbPB0cZbbCdSjvzzugQ4VpxmNPO9keY9xt4JaAWI9YddmzK1EoRqQbYAwwu2EkYPDWjoX7IVQNc3vVT6NXuT8w4qaLRYsV83FClhCXHL8ymWH1SC5xuMY8bCwx63lLnDTCNfIsd55njEMKOb6R81YsGP_HuiMfjfh_4u8iFN6IknmmbyBWPt6xjjiW_DkSIvYU9v2asJ50yXf-oFu7_-cnf1tdl8u7m9-rxpfK9ladQ0EYBxqNCtZdcZpyat3XocCBBpUgrc4HqPneslemnQjIpQaSQlOwPdBXt_vvuQlp8HysXuQ_Y0zxhpOWQrtIYOhDTmP9BOGqH6YV1RcUZ9WnKuj9qHVF1LJyvAPiVjd7YmY5-SsSBtTaZqPp01VN89Bko2-0DVnDGkapMdl_CM-hE5rZh_</recordid><startdate>20150601</startdate><enddate>20150601</enddate><creator>Zhu, Zhe</creator><creator>Woodcock, Curtis E.</creator><creator>Holden, Christopher</creator><creator>Yang, Zhiqiang</creator><general>Elsevier Inc</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SN</scope><scope>7ST</scope><scope>7U6</scope><scope>7UA</scope><scope>C1K</scope><scope>F1W</scope><scope>H96</scope><scope>L.G</scope><scope>SOI</scope><scope>7SU</scope><scope>8FD</scope><scope>FR3</scope><scope>H8D</scope><scope>KR7</scope><scope>L7M</scope></search><sort><creationdate>20150601</creationdate><title>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</title><author>Zhu, Zhe ; Woodcock, Curtis E. ; Holden, Christopher ; Yang, Zhiqiang</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c472t-5ffe008ba5ab62338b5f77b6d9e0aaef550b9b4ca3b42ac28a8d5ea57ae523803</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Algorithms</topic><topic>Clouds</topic><topic>Landsat</topic><topic>Mathematical models</topic><topic>Predict</topic><topic>Reflectance</topic><topic>Reflectivity</topic><topic>Satellite imagery</topic><topic>Snow</topic><topic>Surface reflectance</topic><topic>Synthetic</topic><topic>Time series</topic><topic>Time series model</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhu, Zhe</creatorcontrib><creatorcontrib>Woodcock, Curtis E.</creatorcontrib><creatorcontrib>Holden, Christopher</creatorcontrib><creatorcontrib>Yang, Zhiqiang</creatorcontrib><collection>CrossRef</collection><collection>Ecology Abstracts</collection><collection>Environment Abstracts</collection><collection>Sustainability Science Abstracts</collection><collection>Water Resources Abstracts</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ASFA: Aquatic Sciences and Fisheries Abstracts</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) 2: Ocean Technology, Policy & Non-Living Resources</collection><collection>Aquatic Science & Fisheries Abstracts (ASFA) Professional</collection><collection>Environment Abstracts</collection><collection>Environmental Engineering Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Aerospace Database</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Remote sensing of environment</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhu, Zhe</au><au>Woodcock, Curtis E.</au><au>Holden, Christopher</au><au>Yang, Zhiqiang</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time</atitle><jtitle>Remote sensing of environment</jtitle><date>2015-06-01</date><risdate>2015</risdate><volume>162</volume><spage>67</spage><epage>83</epage><pages>67-83</pages><issn>0034-4257</issn><eissn>1879-0704</eissn><abstract>A new algorithm for generating synthetic Landsat images is developed based on all available Landsat data. This algorithm is capable of predicting Landsat surface reflectance for any desired date. It first excludes cloud, cloud shadow, and snow observations, and then uses the remaining clear observations to estimate time series models for each Landsat pixel. Three time series models (a simple model, advanced model, and full model) are used for estimating surface reflectance for each pixel, and the selection of a time series model is dependent on the number of clear observations available: the more clear observations, the more complex the model will be that is used. For each time series model there are three components (seasonality, trend, and breaks), that are used for modeling intra-annual and inter-annual differences and abrupt surface change. Abrupt surface changes are detected by differencing predicted and observed Landsat observations, and if the difference is larger than twice the Root Mean Square Error (RMSE) for six consecutive observations, it will be detected as a “break” in the time series model. The RMSE values are temporally adjusted to provide better threshold range. For each “synthetic” image, a Quality Assessment (QA) Band is provided that contains information on how the time series model was estimated and used for generating the synthetic data. We have applied this approach to six Landsat scenes within the United States. We visually compared the synthetic images with real Landsat images for different kinds of environments and they are similar for all image pairs. We also quantitatively assessed the accuracy of the synthetic data by calculating the RMSE value for all clear Landsat observations. The RMSE values for the three visible bands are the lowest (approximately 0.01), and the Short-wave Infrared (SWIR) bands are slightly higher in magnitude (between 0.01 and 0.02). The Near Infrared (NIR) band has the highest RMSE values (between 0.02 and 0.03). The goal of this paper is to provide Landsat images that are free of cloud, cloud shadow, snow, and Scan Line Corrector (SLC)-off gaps that can be used to derive land cover and bio-physical products.
•All available Landsat data are used for predicting surface reflectance.•Synthetic Landsat images can be generated for any given time.•Model selection, LASSO, and temporally-adjusted RMSE are used for better modeling.•Synthetic images are similar to real Landsat images for all image pairs.•The prediction accuracy is similar in magnitude to the noise levels in Landsat data.</abstract><pub>Elsevier Inc</pub><doi>10.1016/j.rse.2015.02.009</doi><tpages>17</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0034-4257 |
ispartof | Remote sensing of environment, 2015-06, Vol.162, p.67-83 |
issn | 0034-4257 1879-0704 |
language | eng |
recordid | cdi_proquest_miscellaneous_1770301288 |
source | Elsevier ScienceDirect Journals Complete |
subjects | Algorithms Clouds Landsat Mathematical models Predict Reflectance Reflectivity Satellite imagery Snow Surface reflectance Synthetic Time series Time series model |
title | Generating synthetic Landsat images based on all available Landsat data: Predicting Landsat surface reflectance at any given time |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-26T05%3A09%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Generating%20synthetic%20Landsat%20images%20based%20on%20all%20available%20Landsat%20data:%20Predicting%20Landsat%20surface%20reflectance%20at%20any%20given%20time&rft.jtitle=Remote%20sensing%20of%20environment&rft.au=Zhu,%20Zhe&rft.date=2015-06-01&rft.volume=162&rft.spage=67&rft.epage=83&rft.pages=67-83&rft.issn=0034-4257&rft.eissn=1879-0704&rft_id=info:doi/10.1016/j.rse.2015.02.009&rft_dat=%3Cproquest_cross%3E1732815496%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1732815496&rft_id=info:pmid/&rft_els_id=S0034425715000590&rfr_iscdi=true |