Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI
Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each nig...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2018-11 |
---|---|
Hauptverfasser: | , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | McCully, Curtis Volgenau, Nikolaus H Daniel-Rolf Harbeck Lister, Tim A Saunders, Eric S Turner, Monica L Siverd, Robert J Bowman, Mark |
description | Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control. |
doi_str_mv | 10.48550/arxiv.1811.04163 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_1811_04163</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2132521363</sourcerecordid><originalsourceid>FETCH-LOGICAL-a523-f9e158047524243d40b32d278c2a67a2dbd1e8da35669509ebb06f4f4e15dd4a3</originalsourceid><addsrcrecordid>eNotkEFPwzAMhSMkJKaxH8CJSJw7Eidpu-OYgE2amIR64lKljTs62mUk7WD_nqzjYstPny2_R8gdZ1OZKsUetfutj1Oecj5lksfiioxACB6lEuCGTLzfMcYgTkApMSLNO-om6uoW6cHZEr2v91tqK9p9Iq1bvT2PRneaVs62g7rH7se6rzO01p4u-rZw6Omm8OiOurPuRDNs0Jf2EOR-OPg0f_uYr27JdaUbj5P_PibZy3O2WEbrzetqMV9HWoGIqhlylTKZKJAghZGsEGAgSUvQcaLBFIZjarRQcTxTbIZFweJKVjKsGSO1GJP7y9khivzggg93ys-R5EMkgXi4EMHzd4--y3e2d_vwUw5cgAolUH_QJGPh</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2132521363</pqid></control><display><type>article</type><title>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</title><source>Freely Accessible Journals</source><source>arXiv.org</source><creator>McCully, Curtis ; Volgenau, Nikolaus H ; Daniel-Rolf Harbeck ; Lister, Tim A ; Saunders, Eric S ; Turner, Monica L ; Siverd, Robert J ; Bowman, Mark</creator><creatorcontrib>McCully, Curtis ; Volgenau, Nikolaus H ; Daniel-Rolf Harbeck ; Lister, Tim A ; Saunders, Eric S ; Turner, Monica L ; Siverd, Robert J ; Bowman, Mark</creatorcontrib><description>Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.1811.04163</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Astronomy ; Data processing ; Data transmission ; Masking ; Night ; Observatories ; Physics - Instrumentation and Methods for Astrophysics ; Quality control ; Real time ; Telescopes ; Time domain analysis</subject><ispartof>arXiv.org, 2018-11</ispartof><rights>2018. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.1117/12.2314340$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.1811.04163$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>McCully, Curtis</creatorcontrib><creatorcontrib>Volgenau, Nikolaus H</creatorcontrib><creatorcontrib>Daniel-Rolf Harbeck</creatorcontrib><creatorcontrib>Lister, Tim A</creatorcontrib><creatorcontrib>Saunders, Eric S</creatorcontrib><creatorcontrib>Turner, Monica L</creatorcontrib><creatorcontrib>Siverd, Robert J</creatorcontrib><creatorcontrib>Bowman, Mark</creatorcontrib><title>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</title><title>arXiv.org</title><description>Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.</description><subject>Astronomy</subject><subject>Data processing</subject><subject>Data transmission</subject><subject>Masking</subject><subject>Night</subject><subject>Observatories</subject><subject>Physics - Instrumentation and Methods for Astrophysics</subject><subject>Quality control</subject><subject>Real time</subject><subject>Telescopes</subject><subject>Time domain analysis</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotkEFPwzAMhSMkJKaxH8CJSJw7Eidpu-OYgE2amIR64lKljTs62mUk7WD_nqzjYstPny2_R8gdZ1OZKsUetfutj1Oecj5lksfiioxACB6lEuCGTLzfMcYgTkApMSLNO-om6uoW6cHZEr2v91tqK9p9Iq1bvT2PRneaVs62g7rH7se6rzO01p4u-rZw6Omm8OiOurPuRDNs0Jf2EOR-OPg0f_uYr27JdaUbj5P_PibZy3O2WEbrzetqMV9HWoGIqhlylTKZKJAghZGsEGAgSUvQcaLBFIZjarRQcTxTbIZFweJKVjKsGSO1GJP7y9khivzggg93ys-R5EMkgXi4EMHzd4--y3e2d_vwUw5cgAolUH_QJGPh</recordid><startdate>20181110</startdate><enddate>20181110</enddate><creator>McCully, Curtis</creator><creator>Volgenau, Nikolaus H</creator><creator>Daniel-Rolf Harbeck</creator><creator>Lister, Tim A</creator><creator>Saunders, Eric S</creator><creator>Turner, Monica L</creator><creator>Siverd, Robert J</creator><creator>Bowman, Mark</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20181110</creationdate><title>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</title><author>McCully, Curtis ; Volgenau, Nikolaus H ; Daniel-Rolf Harbeck ; Lister, Tim A ; Saunders, Eric S ; Turner, Monica L ; Siverd, Robert J ; Bowman, Mark</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a523-f9e158047524243d40b32d278c2a67a2dbd1e8da35669509ebb06f4f4e15dd4a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Astronomy</topic><topic>Data processing</topic><topic>Data transmission</topic><topic>Masking</topic><topic>Night</topic><topic>Observatories</topic><topic>Physics - Instrumentation and Methods for Astrophysics</topic><topic>Quality control</topic><topic>Real time</topic><topic>Telescopes</topic><topic>Time domain analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>McCully, Curtis</creatorcontrib><creatorcontrib>Volgenau, Nikolaus H</creatorcontrib><creatorcontrib>Daniel-Rolf Harbeck</creatorcontrib><creatorcontrib>Lister, Tim A</creatorcontrib><creatorcontrib>Saunders, Eric S</creatorcontrib><creatorcontrib>Turner, Monica L</creatorcontrib><creatorcontrib>Siverd, Robert J</creatorcontrib><creatorcontrib>Bowman, Mark</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>McCully, Curtis</au><au>Volgenau, Nikolaus H</au><au>Daniel-Rolf Harbeck</au><au>Lister, Tim A</au><au>Saunders, Eric S</au><au>Turner, Monica L</au><au>Siverd, Robert J</au><au>Bowman, Mark</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</atitle><jtitle>arXiv.org</jtitle><date>2018-11-10</date><risdate>2018</risdate><eissn>2331-8422</eissn><abstract>Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.1811.04163</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2018-11 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_1811_04163 |
source | Freely Accessible Journals; arXiv.org |
subjects | Astronomy Data processing Data transmission Masking Night Observatories Physics - Instrumentation and Methods for Astrophysics Quality control Real time Telescopes Time domain analysis |
title | Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-09T00%3A17%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Real-time%20processing%20of%20the%20imaging%20data%20from%20the%20network%20of%20Las%20Cumbres%20Observatory%20Telescopes%20using%20BANZAI&rft.jtitle=arXiv.org&rft.au=McCully,%20Curtis&rft.date=2018-11-10&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.1811.04163&rft_dat=%3Cproquest_arxiv%3E2132521363%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2132521363&rft_id=info:pmid/&rfr_iscdi=true |