Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI

Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each nig...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2018-11
Hauptverfasser: McCully, Curtis, Volgenau, Nikolaus H, Daniel-Rolf Harbeck, Lister, Tim A, Saunders, Eric S, Turner, Monica L, Siverd, Robert J, Bowman, Mark
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator McCully, Curtis
Volgenau, Nikolaus H
Daniel-Rolf Harbeck
Lister, Tim A
Saunders, Eric S
Turner, Monica L
Siverd, Robert J
Bowman, Mark
description Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.
doi_str_mv 10.48550/arxiv.1811.04163
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_1811_04163</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2132521363</sourcerecordid><originalsourceid>FETCH-LOGICAL-a523-f9e158047524243d40b32d278c2a67a2dbd1e8da35669509ebb06f4f4e15dd4a3</originalsourceid><addsrcrecordid>eNotkEFPwzAMhSMkJKaxH8CJSJw7Eidpu-OYgE2amIR64lKljTs62mUk7WD_nqzjYstPny2_R8gdZ1OZKsUetfutj1Oecj5lksfiioxACB6lEuCGTLzfMcYgTkApMSLNO-om6uoW6cHZEr2v91tqK9p9Iq1bvT2PRneaVs62g7rH7se6rzO01p4u-rZw6Omm8OiOurPuRDNs0Jf2EOR-OPg0f_uYr27JdaUbj5P_PibZy3O2WEbrzetqMV9HWoGIqhlylTKZKJAghZGsEGAgSUvQcaLBFIZjarRQcTxTbIZFweJKVjKsGSO1GJP7y9khivzggg93ys-R5EMkgXi4EMHzd4--y3e2d_vwUw5cgAolUH_QJGPh</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2132521363</pqid></control><display><type>article</type><title>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</title><source>Freely Accessible Journals</source><source>arXiv.org</source><creator>McCully, Curtis ; Volgenau, Nikolaus H ; Daniel-Rolf Harbeck ; Lister, Tim A ; Saunders, Eric S ; Turner, Monica L ; Siverd, Robert J ; Bowman, Mark</creator><creatorcontrib>McCully, Curtis ; Volgenau, Nikolaus H ; Daniel-Rolf Harbeck ; Lister, Tim A ; Saunders, Eric S ; Turner, Monica L ; Siverd, Robert J ; Bowman, Mark</creatorcontrib><description>Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.1811.04163</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Astronomy ; Data processing ; Data transmission ; Masking ; Night ; Observatories ; Physics - Instrumentation and Methods for Astrophysics ; Quality control ; Real time ; Telescopes ; Time domain analysis</subject><ispartof>arXiv.org, 2018-11</ispartof><rights>2018. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.1117/12.2314340$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.48550/arXiv.1811.04163$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>McCully, Curtis</creatorcontrib><creatorcontrib>Volgenau, Nikolaus H</creatorcontrib><creatorcontrib>Daniel-Rolf Harbeck</creatorcontrib><creatorcontrib>Lister, Tim A</creatorcontrib><creatorcontrib>Saunders, Eric S</creatorcontrib><creatorcontrib>Turner, Monica L</creatorcontrib><creatorcontrib>Siverd, Robert J</creatorcontrib><creatorcontrib>Bowman, Mark</creatorcontrib><title>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</title><title>arXiv.org</title><description>Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.</description><subject>Astronomy</subject><subject>Data processing</subject><subject>Data transmission</subject><subject>Masking</subject><subject>Night</subject><subject>Observatories</subject><subject>Physics - Instrumentation and Methods for Astrophysics</subject><subject>Quality control</subject><subject>Real time</subject><subject>Telescopes</subject><subject>Time domain analysis</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotkEFPwzAMhSMkJKaxH8CJSJw7Eidpu-OYgE2amIR64lKljTs62mUk7WD_nqzjYstPny2_R8gdZ1OZKsUetfutj1Oecj5lksfiioxACB6lEuCGTLzfMcYgTkApMSLNO-om6uoW6cHZEr2v91tqK9p9Iq1bvT2PRneaVs62g7rH7se6rzO01p4u-rZw6Omm8OiOurPuRDNs0Jf2EOR-OPg0f_uYr27JdaUbj5P_PibZy3O2WEbrzetqMV9HWoGIqhlylTKZKJAghZGsEGAgSUvQcaLBFIZjarRQcTxTbIZFweJKVjKsGSO1GJP7y9khivzggg93ys-R5EMkgXi4EMHzd4--y3e2d_vwUw5cgAolUH_QJGPh</recordid><startdate>20181110</startdate><enddate>20181110</enddate><creator>McCully, Curtis</creator><creator>Volgenau, Nikolaus H</creator><creator>Daniel-Rolf Harbeck</creator><creator>Lister, Tim A</creator><creator>Saunders, Eric S</creator><creator>Turner, Monica L</creator><creator>Siverd, Robert J</creator><creator>Bowman, Mark</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20181110</creationdate><title>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</title><author>McCully, Curtis ; Volgenau, Nikolaus H ; Daniel-Rolf Harbeck ; Lister, Tim A ; Saunders, Eric S ; Turner, Monica L ; Siverd, Robert J ; Bowman, Mark</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a523-f9e158047524243d40b32d278c2a67a2dbd1e8da35669509ebb06f4f4e15dd4a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Astronomy</topic><topic>Data processing</topic><topic>Data transmission</topic><topic>Masking</topic><topic>Night</topic><topic>Observatories</topic><topic>Physics - Instrumentation and Methods for Astrophysics</topic><topic>Quality control</topic><topic>Real time</topic><topic>Telescopes</topic><topic>Time domain analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>McCully, Curtis</creatorcontrib><creatorcontrib>Volgenau, Nikolaus H</creatorcontrib><creatorcontrib>Daniel-Rolf Harbeck</creatorcontrib><creatorcontrib>Lister, Tim A</creatorcontrib><creatorcontrib>Saunders, Eric S</creatorcontrib><creatorcontrib>Turner, Monica L</creatorcontrib><creatorcontrib>Siverd, Robert J</creatorcontrib><creatorcontrib>Bowman, Mark</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>McCully, Curtis</au><au>Volgenau, Nikolaus H</au><au>Daniel-Rolf Harbeck</au><au>Lister, Tim A</au><au>Saunders, Eric S</au><au>Turner, Monica L</au><au>Siverd, Robert J</au><au>Bowman, Mark</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI</atitle><jtitle>arXiv.org</jtitle><date>2018-11-10</date><risdate>2018</risdate><eissn>2331-8422</eissn><abstract>Work in time-domain astronomy necessitates robust, automated data processing pipelines that operate in real time. We present the BANZAI pipeline which processes the thousands of science images produced across the Las Cumbres Observatory Global Telescope (LCOGT) network of robotic telescopes each night. BANZAI is designed to perform near real-time preview and end-of-night final processing for four types of optical CCD imagers on the three LCOGT telescope classes. It performs instrumental signature removal (bad pixel masking, bias and dark removal, flat-field correction), astrometric fitting and source catalog extraction. We discuss the design considerations for BANZAI, including testing, performance, and extensibility. BANZAI is integrated into the observatory infrastructure and fulfills two critical functions: (1) real-time data processing that delivers data to users quickly and (2) derive metrics from those data products to monitor the health of the telescope network. In the era of time-domain astronomy, to get from these observations to scientific results, we must be able to automatically reduce data with minimal human interaction, but still have insight into the data stream for quality control.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.1811.04163</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2018-11
issn 2331-8422
language eng
recordid cdi_arxiv_primary_1811_04163
source Freely Accessible Journals; arXiv.org
subjects Astronomy
Data processing
Data transmission
Masking
Night
Observatories
Physics - Instrumentation and Methods for Astrophysics
Quality control
Real time
Telescopes
Time domain analysis
title Real-time processing of the imaging data from the network of Las Cumbres Observatory Telescopes using BANZAI
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-09T00%3A17%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Real-time%20processing%20of%20the%20imaging%20data%20from%20the%20network%20of%20Las%20Cumbres%20Observatory%20Telescopes%20using%20BANZAI&rft.jtitle=arXiv.org&rft.au=McCully,%20Curtis&rft.date=2018-11-10&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.1811.04163&rft_dat=%3Cproquest_arxiv%3E2132521363%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2132521363&rft_id=info:pmid/&rfr_iscdi=true