Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization

Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We ex...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:arXiv.org 2023-02
Hauptverfasser: Pagano, Michael, Liu, Jing, Liu, Adrian, Kern, Nicholas S, Ewall-Wice, Aaron, Bull, Philip, Pascua, Robert, Ravanbakhsh, Siamak, Abdurashidova, Zara, Adams, Tyrone, Aguirre, James E, Alexander, Paul, Ali, Zaki S, Baartman, Rushelle, Balfour, Yanga, Beardsley, Adam P, Bernardi, Gianni, Billings, Tashalee S, Bowman, Judd D, Bradley, Richard F, Burba, Jacob, Carey, Steven, Carilli, Chris L, Cheng, Carina, DeBoer, David R, Eloy de Lera Acedo, Dexter, Matt, Dillon, Joshua S, Eksteen, Nico, Ely, John, Fagnoni, Nicolas, Fritz, Randall, Furlanetto, Steven R, Gale-Sides, Kingsley, Glendenning, Brian, Gorthi, Deepthi, Greig, Bradley, Grobbelaar, Jasper, Halday, Ziyaad, Hazelton, Bryna J, Hewitt, Jacqueline N, Hickish, Jack, Jacobs, Daniel C, Austin, Julius, Kariseb, MacCalvin, Kerrigan, Joshua, Kittiwisit, Piyanat, Kohn, Saul A, Kolopanis, Matthew, Lanman, Adam, Paul La Plante, Loots, Anita, MacMahon, David Harold Edward, Malan, Lourence, Malgas, Cresshim, Malgas, Keith, Marero, Bradley, Martinot, Zachary E, Mesinger, Andrei, Molewa, Mathakane, Morales, Miguel F, Mosiane, Tshegofalang, Neben, Abraham R, Nikolic, Bojan, Nuwegeld, Hans, Parsons, Aaron R, Patra, Nipanjana, Pieterse, Samantha, Razavi-Ghods, Nima, Robnett, James, Rosie, Kathryn, Sims, Peter, Smith, Craig, Swarts, Hilton, Thyagarajan, Nithyanandan, Pieter van Wyngaarden, Williams, Peter K G, Zheng, Haoxuan
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title arXiv.org
container_volume
creator Pagano, Michael
Liu, Jing
Liu, Adrian
Kern, Nicholas S
Ewall-Wice, Aaron
Bull, Philip
Pascua, Robert
Ravanbakhsh, Siamak
Abdurashidova, Zara
Adams, Tyrone
Aguirre, James E
Alexander, Paul
Ali, Zaki S
Baartman, Rushelle
Balfour, Yanga
Beardsley, Adam P
Bernardi, Gianni
Billings, Tashalee S
Bowman, Judd D
Bradley, Richard F
Burba, Jacob
Carey, Steven
Carilli, Chris L
Cheng, Carina
DeBoer, David R
Eloy de Lera Acedo
Dexter, Matt
Dillon, Joshua S
Eksteen, Nico
Ely, John
Fagnoni, Nicolas
Fritz, Randall
Furlanetto, Steven R
Gale-Sides, Kingsley
Glendenning, Brian
Gorthi, Deepthi
Greig, Bradley
Grobbelaar, Jasper
Halday, Ziyaad
Hazelton, Bryna J
Hewitt, Jacqueline N
Hickish, Jack
Jacobs, Daniel C
Austin, Julius
Kariseb, MacCalvin
Kerrigan, Joshua
Kittiwisit, Piyanat
Kohn, Saul A
Kolopanis, Matthew
Lanman, Adam
Paul La Plante
Loots, Anita
MacMahon, David Harold Edward
Malan, Lourence
Malgas, Cresshim
Malgas, Keith
Marero, Bradley
Martinot, Zachary E
Mesinger, Andrei
Molewa, Mathakane
Morales, Miguel F
Mosiane, Tshegofalang
Neben, Abraham R
Nikolic, Bojan
Nuwegeld, Hans
Parsons, Aaron R
Patra, Nipanjana
Pieterse, Samantha
Razavi-Ghods, Nima
Robnett, James
Rosie, Kathryn
Sims, Peter
Smith, Craig
Swarts, Hilton
Thyagarajan, Nithyanandan
Pieter van Wyngaarden
Williams, Peter K G
Zheng, Haoxuan
description Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.
doi_str_mv 10.48550/arxiv.2210.14927
format Article
fullrecord <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2210_14927</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2729741357</sourcerecordid><originalsourceid>FETCH-LOGICAL-a957-74b0fbd582af028ddb6131c2c163403c672d2af68a110128dc3cea9d85b9e4d63</originalsourceid><addsrcrecordid>eNotkNtKAzEQhoMgWGofwCsDXm_NcbN7KaVqoVIovV-yySyb4h5MsqI-vekBBgb--fgYfoQeKFmKQkryrP2P-14ylgIqSqZu0IxxTrNCMHaHFiEcCSEsV0xKPkP1qtVemwje_enohh7vGrzpR-36iPcQnJ30Z0hJmgQ14IcOoncGf4AOk4cO-hjw0ODYAl6Pg2lPhj0k1dV4j26b5IDFdc_R4XV9WL1n293bZvWyzXQpVaZETZrayoLphrDC2jqnnBpmaM4F4SY9bNMpLzSlhCbAcAO6tIWsSxA253P0eNGeC6hG7zrtf6tTEdW5iEQ8XYjRD18ThFgdh8n36aeKKVYqQblU_B9lf2Gg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2729741357</pqid></control><display><type>article</type><title>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Pagano, Michael ; Liu, Jing ; Liu, Adrian ; Kern, Nicholas S ; Ewall-Wice, Aaron ; Bull, Philip ; Pascua, Robert ; Ravanbakhsh, Siamak ; Abdurashidova, Zara ; Adams, Tyrone ; Aguirre, James E ; Alexander, Paul ; Ali, Zaki S ; Baartman, Rushelle ; Balfour, Yanga ; Beardsley, Adam P ; Bernardi, Gianni ; Billings, Tashalee S ; Bowman, Judd D ; Bradley, Richard F ; Burba, Jacob ; Carey, Steven ; Carilli, Chris L ; Cheng, Carina ; DeBoer, David R ; Eloy de Lera Acedo ; Dexter, Matt ; Dillon, Joshua S ; Eksteen, Nico ; Ely, John ; Fagnoni, Nicolas ; Fritz, Randall ; Furlanetto, Steven R ; Gale-Sides, Kingsley ; Glendenning, Brian ; Gorthi, Deepthi ; Greig, Bradley ; Grobbelaar, Jasper ; Halday, Ziyaad ; Hazelton, Bryna J ; Hewitt, Jacqueline N ; Hickish, Jack ; Jacobs, Daniel C ; Austin, Julius ; Kariseb, MacCalvin ; Kerrigan, Joshua ; Kittiwisit, Piyanat ; Kohn, Saul A ; Kolopanis, Matthew ; Lanman, Adam ; Paul La Plante ; Loots, Anita ; MacMahon, David Harold Edward ; Malan, Lourence ; Malgas, Cresshim ; Malgas, Keith ; Marero, Bradley ; Martinot, Zachary E ; Mesinger, Andrei ; Molewa, Mathakane ; Morales, Miguel F ; Mosiane, Tshegofalang ; Neben, Abraham R ; Nikolic, Bojan ; Nuwegeld, Hans ; Parsons, Aaron R ; Patra, Nipanjana ; Pieterse, Samantha ; Razavi-Ghods, Nima ; Robnett, James ; Rosie, Kathryn ; Sims, Peter ; Smith, Craig ; Swarts, Hilton ; Thyagarajan, Nithyanandan ; Pieter van Wyngaarden ; Williams, Peter K G ; Zheng, Haoxuan</creator><creatorcontrib>Pagano, Michael ; Liu, Jing ; Liu, Adrian ; Kern, Nicholas S ; Ewall-Wice, Aaron ; Bull, Philip ; Pascua, Robert ; Ravanbakhsh, Siamak ; Abdurashidova, Zara ; Adams, Tyrone ; Aguirre, James E ; Alexander, Paul ; Ali, Zaki S ; Baartman, Rushelle ; Balfour, Yanga ; Beardsley, Adam P ; Bernardi, Gianni ; Billings, Tashalee S ; Bowman, Judd D ; Bradley, Richard F ; Burba, Jacob ; Carey, Steven ; Carilli, Chris L ; Cheng, Carina ; DeBoer, David R ; Eloy de Lera Acedo ; Dexter, Matt ; Dillon, Joshua S ; Eksteen, Nico ; Ely, John ; Fagnoni, Nicolas ; Fritz, Randall ; Furlanetto, Steven R ; Gale-Sides, Kingsley ; Glendenning, Brian ; Gorthi, Deepthi ; Greig, Bradley ; Grobbelaar, Jasper ; Halday, Ziyaad ; Hazelton, Bryna J ; Hewitt, Jacqueline N ; Hickish, Jack ; Jacobs, Daniel C ; Austin, Julius ; Kariseb, MacCalvin ; Kerrigan, Joshua ; Kittiwisit, Piyanat ; Kohn, Saul A ; Kolopanis, Matthew ; Lanman, Adam ; Paul La Plante ; Loots, Anita ; MacMahon, David Harold Edward ; Malan, Lourence ; Malgas, Cresshim ; Malgas, Keith ; Marero, Bradley ; Martinot, Zachary E ; Mesinger, Andrei ; Molewa, Mathakane ; Morales, Miguel F ; Mosiane, Tshegofalang ; Neben, Abraham R ; Nikolic, Bojan ; Nuwegeld, Hans ; Parsons, Aaron R ; Patra, Nipanjana ; Pieterse, Samantha ; Razavi-Ghods, Nima ; Robnett, James ; Rosie, Kathryn ; Sims, Peter ; Smith, Craig ; Swarts, Hilton ; Thyagarajan, Nithyanandan ; Pieter van Wyngaarden ; Williams, Peter K G ; Zheng, Haoxuan</creatorcontrib><description>Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2210.14927</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Artificial neural networks ; Data analysis ; Errors ; Interferometry ; Ionization ; Narrowband ; Noise levels ; Physics - Cosmology and Nongalactic Astrophysics ; Physics - Instrumentation and Methods for Astrophysics ; Qualitative analysis ; Radio frequency ; Radio frequency interference ; Simulation ; Spectrum analysis</subject><ispartof>arXiv.org, 2023-02</ispartof><rights>2023. This work is published under http://creativecommons.org/publicdomain/zero/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/publicdomain/zero/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2210.14927$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1093/mnras/stad441$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Pagano, Michael</creatorcontrib><creatorcontrib>Liu, Jing</creatorcontrib><creatorcontrib>Liu, Adrian</creatorcontrib><creatorcontrib>Kern, Nicholas S</creatorcontrib><creatorcontrib>Ewall-Wice, Aaron</creatorcontrib><creatorcontrib>Bull, Philip</creatorcontrib><creatorcontrib>Pascua, Robert</creatorcontrib><creatorcontrib>Ravanbakhsh, Siamak</creatorcontrib><creatorcontrib>Abdurashidova, Zara</creatorcontrib><creatorcontrib>Adams, Tyrone</creatorcontrib><creatorcontrib>Aguirre, James E</creatorcontrib><creatorcontrib>Alexander, Paul</creatorcontrib><creatorcontrib>Ali, Zaki S</creatorcontrib><creatorcontrib>Baartman, Rushelle</creatorcontrib><creatorcontrib>Balfour, Yanga</creatorcontrib><creatorcontrib>Beardsley, Adam P</creatorcontrib><creatorcontrib>Bernardi, Gianni</creatorcontrib><creatorcontrib>Billings, Tashalee S</creatorcontrib><creatorcontrib>Bowman, Judd D</creatorcontrib><creatorcontrib>Bradley, Richard F</creatorcontrib><creatorcontrib>Burba, Jacob</creatorcontrib><creatorcontrib>Carey, Steven</creatorcontrib><creatorcontrib>Carilli, Chris L</creatorcontrib><creatorcontrib>Cheng, Carina</creatorcontrib><creatorcontrib>DeBoer, David R</creatorcontrib><creatorcontrib>Eloy de Lera Acedo</creatorcontrib><creatorcontrib>Dexter, Matt</creatorcontrib><creatorcontrib>Dillon, Joshua S</creatorcontrib><creatorcontrib>Eksteen, Nico</creatorcontrib><creatorcontrib>Ely, John</creatorcontrib><creatorcontrib>Fagnoni, Nicolas</creatorcontrib><creatorcontrib>Fritz, Randall</creatorcontrib><creatorcontrib>Furlanetto, Steven R</creatorcontrib><creatorcontrib>Gale-Sides, Kingsley</creatorcontrib><creatorcontrib>Glendenning, Brian</creatorcontrib><creatorcontrib>Gorthi, Deepthi</creatorcontrib><creatorcontrib>Greig, Bradley</creatorcontrib><creatorcontrib>Grobbelaar, Jasper</creatorcontrib><creatorcontrib>Halday, Ziyaad</creatorcontrib><creatorcontrib>Hazelton, Bryna J</creatorcontrib><creatorcontrib>Hewitt, Jacqueline N</creatorcontrib><creatorcontrib>Hickish, Jack</creatorcontrib><creatorcontrib>Jacobs, Daniel C</creatorcontrib><creatorcontrib>Austin, Julius</creatorcontrib><creatorcontrib>Kariseb, MacCalvin</creatorcontrib><creatorcontrib>Kerrigan, Joshua</creatorcontrib><creatorcontrib>Kittiwisit, Piyanat</creatorcontrib><creatorcontrib>Kohn, Saul A</creatorcontrib><creatorcontrib>Kolopanis, Matthew</creatorcontrib><creatorcontrib>Lanman, Adam</creatorcontrib><creatorcontrib>Paul La Plante</creatorcontrib><creatorcontrib>Loots, Anita</creatorcontrib><creatorcontrib>MacMahon, David Harold Edward</creatorcontrib><creatorcontrib>Malan, Lourence</creatorcontrib><creatorcontrib>Malgas, Cresshim</creatorcontrib><creatorcontrib>Malgas, Keith</creatorcontrib><creatorcontrib>Marero, Bradley</creatorcontrib><creatorcontrib>Martinot, Zachary E</creatorcontrib><creatorcontrib>Mesinger, Andrei</creatorcontrib><creatorcontrib>Molewa, Mathakane</creatorcontrib><creatorcontrib>Morales, Miguel F</creatorcontrib><creatorcontrib>Mosiane, Tshegofalang</creatorcontrib><creatorcontrib>Neben, Abraham R</creatorcontrib><creatorcontrib>Nikolic, Bojan</creatorcontrib><creatorcontrib>Nuwegeld, Hans</creatorcontrib><creatorcontrib>Parsons, Aaron R</creatorcontrib><creatorcontrib>Patra, Nipanjana</creatorcontrib><creatorcontrib>Pieterse, Samantha</creatorcontrib><creatorcontrib>Razavi-Ghods, Nima</creatorcontrib><creatorcontrib>Robnett, James</creatorcontrib><creatorcontrib>Rosie, Kathryn</creatorcontrib><creatorcontrib>Sims, Peter</creatorcontrib><creatorcontrib>Smith, Craig</creatorcontrib><creatorcontrib>Swarts, Hilton</creatorcontrib><creatorcontrib>Thyagarajan, Nithyanandan</creatorcontrib><creatorcontrib>Pieter van Wyngaarden</creatorcontrib><creatorcontrib>Williams, Peter K G</creatorcontrib><creatorcontrib>Zheng, Haoxuan</creatorcontrib><title>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</title><title>arXiv.org</title><description>Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.</description><subject>Artificial neural networks</subject><subject>Data analysis</subject><subject>Errors</subject><subject>Interferometry</subject><subject>Ionization</subject><subject>Narrowband</subject><subject>Noise levels</subject><subject>Physics - Cosmology and Nongalactic Astrophysics</subject><subject>Physics - Instrumentation and Methods for Astrophysics</subject><subject>Qualitative analysis</subject><subject>Radio frequency</subject><subject>Radio frequency interference</subject><subject>Simulation</subject><subject>Spectrum analysis</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotkNtKAzEQhoMgWGofwCsDXm_NcbN7KaVqoVIovV-yySyb4h5MsqI-vekBBgb--fgYfoQeKFmKQkryrP2P-14ylgIqSqZu0IxxTrNCMHaHFiEcCSEsV0xKPkP1qtVemwje_enohh7vGrzpR-36iPcQnJ30Z0hJmgQ14IcOoncGf4AOk4cO-hjw0ODYAl6Pg2lPhj0k1dV4j26b5IDFdc_R4XV9WL1n293bZvWyzXQpVaZETZrayoLphrDC2jqnnBpmaM4F4SY9bNMpLzSlhCbAcAO6tIWsSxA253P0eNGeC6hG7zrtf6tTEdW5iEQ8XYjRD18ThFgdh8n36aeKKVYqQblU_B9lf2Gg</recordid><startdate>20230220</startdate><enddate>20230220</enddate><creator>Pagano, Michael</creator><creator>Liu, Jing</creator><creator>Liu, Adrian</creator><creator>Kern, Nicholas S</creator><creator>Ewall-Wice, Aaron</creator><creator>Bull, Philip</creator><creator>Pascua, Robert</creator><creator>Ravanbakhsh, Siamak</creator><creator>Abdurashidova, Zara</creator><creator>Adams, Tyrone</creator><creator>Aguirre, James E</creator><creator>Alexander, Paul</creator><creator>Ali, Zaki S</creator><creator>Baartman, Rushelle</creator><creator>Balfour, Yanga</creator><creator>Beardsley, Adam P</creator><creator>Bernardi, Gianni</creator><creator>Billings, Tashalee S</creator><creator>Bowman, Judd D</creator><creator>Bradley, Richard F</creator><creator>Burba, Jacob</creator><creator>Carey, Steven</creator><creator>Carilli, Chris L</creator><creator>Cheng, Carina</creator><creator>DeBoer, David R</creator><creator>Eloy de Lera Acedo</creator><creator>Dexter, Matt</creator><creator>Dillon, Joshua S</creator><creator>Eksteen, Nico</creator><creator>Ely, John</creator><creator>Fagnoni, Nicolas</creator><creator>Fritz, Randall</creator><creator>Furlanetto, Steven R</creator><creator>Gale-Sides, Kingsley</creator><creator>Glendenning, Brian</creator><creator>Gorthi, Deepthi</creator><creator>Greig, Bradley</creator><creator>Grobbelaar, Jasper</creator><creator>Halday, Ziyaad</creator><creator>Hazelton, Bryna J</creator><creator>Hewitt, Jacqueline N</creator><creator>Hickish, Jack</creator><creator>Jacobs, Daniel C</creator><creator>Austin, Julius</creator><creator>Kariseb, MacCalvin</creator><creator>Kerrigan, Joshua</creator><creator>Kittiwisit, Piyanat</creator><creator>Kohn, Saul A</creator><creator>Kolopanis, Matthew</creator><creator>Lanman, Adam</creator><creator>Paul La Plante</creator><creator>Loots, Anita</creator><creator>MacMahon, David Harold Edward</creator><creator>Malan, Lourence</creator><creator>Malgas, Cresshim</creator><creator>Malgas, Keith</creator><creator>Marero, Bradley</creator><creator>Martinot, Zachary E</creator><creator>Mesinger, Andrei</creator><creator>Molewa, Mathakane</creator><creator>Morales, Miguel F</creator><creator>Mosiane, Tshegofalang</creator><creator>Neben, Abraham R</creator><creator>Nikolic, Bojan</creator><creator>Nuwegeld, Hans</creator><creator>Parsons, Aaron R</creator><creator>Patra, Nipanjana</creator><creator>Pieterse, Samantha</creator><creator>Razavi-Ghods, Nima</creator><creator>Robnett, James</creator><creator>Rosie, Kathryn</creator><creator>Sims, Peter</creator><creator>Smith, Craig</creator><creator>Swarts, Hilton</creator><creator>Thyagarajan, Nithyanandan</creator><creator>Pieter van Wyngaarden</creator><creator>Williams, Peter K G</creator><creator>Zheng, Haoxuan</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20230220</creationdate><title>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</title><author>Pagano, Michael ; Liu, Jing ; Liu, Adrian ; Kern, Nicholas S ; Ewall-Wice, Aaron ; Bull, Philip ; Pascua, Robert ; Ravanbakhsh, Siamak ; Abdurashidova, Zara ; Adams, Tyrone ; Aguirre, James E ; Alexander, Paul ; Ali, Zaki S ; Baartman, Rushelle ; Balfour, Yanga ; Beardsley, Adam P ; Bernardi, Gianni ; Billings, Tashalee S ; Bowman, Judd D ; Bradley, Richard F ; Burba, Jacob ; Carey, Steven ; Carilli, Chris L ; Cheng, Carina ; DeBoer, David R ; Eloy de Lera Acedo ; Dexter, Matt ; Dillon, Joshua S ; Eksteen, Nico ; Ely, John ; Fagnoni, Nicolas ; Fritz, Randall ; Furlanetto, Steven R ; Gale-Sides, Kingsley ; Glendenning, Brian ; Gorthi, Deepthi ; Greig, Bradley ; Grobbelaar, Jasper ; Halday, Ziyaad ; Hazelton, Bryna J ; Hewitt, Jacqueline N ; Hickish, Jack ; Jacobs, Daniel C ; Austin, Julius ; Kariseb, MacCalvin ; Kerrigan, Joshua ; Kittiwisit, Piyanat ; Kohn, Saul A ; Kolopanis, Matthew ; Lanman, Adam ; Paul La Plante ; Loots, Anita ; MacMahon, David Harold Edward ; Malan, Lourence ; Malgas, Cresshim ; Malgas, Keith ; Marero, Bradley ; Martinot, Zachary E ; Mesinger, Andrei ; Molewa, Mathakane ; Morales, Miguel F ; Mosiane, Tshegofalang ; Neben, Abraham R ; Nikolic, Bojan ; Nuwegeld, Hans ; Parsons, Aaron R ; Patra, Nipanjana ; Pieterse, Samantha ; Razavi-Ghods, Nima ; Robnett, James ; Rosie, Kathryn ; Sims, Peter ; Smith, Craig ; Swarts, Hilton ; Thyagarajan, Nithyanandan ; Pieter van Wyngaarden ; Williams, Peter K G ; Zheng, Haoxuan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a957-74b0fbd582af028ddb6131c2c163403c672d2af68a110128dc3cea9d85b9e4d63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Artificial neural networks</topic><topic>Data analysis</topic><topic>Errors</topic><topic>Interferometry</topic><topic>Ionization</topic><topic>Narrowband</topic><topic>Noise levels</topic><topic>Physics - Cosmology and Nongalactic Astrophysics</topic><topic>Physics - Instrumentation and Methods for Astrophysics</topic><topic>Qualitative analysis</topic><topic>Radio frequency</topic><topic>Radio frequency interference</topic><topic>Simulation</topic><topic>Spectrum analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>Pagano, Michael</creatorcontrib><creatorcontrib>Liu, Jing</creatorcontrib><creatorcontrib>Liu, Adrian</creatorcontrib><creatorcontrib>Kern, Nicholas S</creatorcontrib><creatorcontrib>Ewall-Wice, Aaron</creatorcontrib><creatorcontrib>Bull, Philip</creatorcontrib><creatorcontrib>Pascua, Robert</creatorcontrib><creatorcontrib>Ravanbakhsh, Siamak</creatorcontrib><creatorcontrib>Abdurashidova, Zara</creatorcontrib><creatorcontrib>Adams, Tyrone</creatorcontrib><creatorcontrib>Aguirre, James E</creatorcontrib><creatorcontrib>Alexander, Paul</creatorcontrib><creatorcontrib>Ali, Zaki S</creatorcontrib><creatorcontrib>Baartman, Rushelle</creatorcontrib><creatorcontrib>Balfour, Yanga</creatorcontrib><creatorcontrib>Beardsley, Adam P</creatorcontrib><creatorcontrib>Bernardi, Gianni</creatorcontrib><creatorcontrib>Billings, Tashalee S</creatorcontrib><creatorcontrib>Bowman, Judd D</creatorcontrib><creatorcontrib>Bradley, Richard F</creatorcontrib><creatorcontrib>Burba, Jacob</creatorcontrib><creatorcontrib>Carey, Steven</creatorcontrib><creatorcontrib>Carilli, Chris L</creatorcontrib><creatorcontrib>Cheng, Carina</creatorcontrib><creatorcontrib>DeBoer, David R</creatorcontrib><creatorcontrib>Eloy de Lera Acedo</creatorcontrib><creatorcontrib>Dexter, Matt</creatorcontrib><creatorcontrib>Dillon, Joshua S</creatorcontrib><creatorcontrib>Eksteen, Nico</creatorcontrib><creatorcontrib>Ely, John</creatorcontrib><creatorcontrib>Fagnoni, Nicolas</creatorcontrib><creatorcontrib>Fritz, Randall</creatorcontrib><creatorcontrib>Furlanetto, Steven R</creatorcontrib><creatorcontrib>Gale-Sides, Kingsley</creatorcontrib><creatorcontrib>Glendenning, Brian</creatorcontrib><creatorcontrib>Gorthi, Deepthi</creatorcontrib><creatorcontrib>Greig, Bradley</creatorcontrib><creatorcontrib>Grobbelaar, Jasper</creatorcontrib><creatorcontrib>Halday, Ziyaad</creatorcontrib><creatorcontrib>Hazelton, Bryna J</creatorcontrib><creatorcontrib>Hewitt, Jacqueline N</creatorcontrib><creatorcontrib>Hickish, Jack</creatorcontrib><creatorcontrib>Jacobs, Daniel C</creatorcontrib><creatorcontrib>Austin, Julius</creatorcontrib><creatorcontrib>Kariseb, MacCalvin</creatorcontrib><creatorcontrib>Kerrigan, Joshua</creatorcontrib><creatorcontrib>Kittiwisit, Piyanat</creatorcontrib><creatorcontrib>Kohn, Saul A</creatorcontrib><creatorcontrib>Kolopanis, Matthew</creatorcontrib><creatorcontrib>Lanman, Adam</creatorcontrib><creatorcontrib>Paul La Plante</creatorcontrib><creatorcontrib>Loots, Anita</creatorcontrib><creatorcontrib>MacMahon, David Harold Edward</creatorcontrib><creatorcontrib>Malan, Lourence</creatorcontrib><creatorcontrib>Malgas, Cresshim</creatorcontrib><creatorcontrib>Malgas, Keith</creatorcontrib><creatorcontrib>Marero, Bradley</creatorcontrib><creatorcontrib>Martinot, Zachary E</creatorcontrib><creatorcontrib>Mesinger, Andrei</creatorcontrib><creatorcontrib>Molewa, Mathakane</creatorcontrib><creatorcontrib>Morales, Miguel F</creatorcontrib><creatorcontrib>Mosiane, Tshegofalang</creatorcontrib><creatorcontrib>Neben, Abraham R</creatorcontrib><creatorcontrib>Nikolic, Bojan</creatorcontrib><creatorcontrib>Nuwegeld, Hans</creatorcontrib><creatorcontrib>Parsons, Aaron R</creatorcontrib><creatorcontrib>Patra, Nipanjana</creatorcontrib><creatorcontrib>Pieterse, Samantha</creatorcontrib><creatorcontrib>Razavi-Ghods, Nima</creatorcontrib><creatorcontrib>Robnett, James</creatorcontrib><creatorcontrib>Rosie, Kathryn</creatorcontrib><creatorcontrib>Sims, Peter</creatorcontrib><creatorcontrib>Smith, Craig</creatorcontrib><creatorcontrib>Swarts, Hilton</creatorcontrib><creatorcontrib>Thyagarajan, Nithyanandan</creatorcontrib><creatorcontrib>Pieter van Wyngaarden</creatorcontrib><creatorcontrib>Williams, Peter K G</creatorcontrib><creatorcontrib>Zheng, Haoxuan</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science &amp; Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pagano, Michael</au><au>Liu, Jing</au><au>Liu, Adrian</au><au>Kern, Nicholas S</au><au>Ewall-Wice, Aaron</au><au>Bull, Philip</au><au>Pascua, Robert</au><au>Ravanbakhsh, Siamak</au><au>Abdurashidova, Zara</au><au>Adams, Tyrone</au><au>Aguirre, James E</au><au>Alexander, Paul</au><au>Ali, Zaki S</au><au>Baartman, Rushelle</au><au>Balfour, Yanga</au><au>Beardsley, Adam P</au><au>Bernardi, Gianni</au><au>Billings, Tashalee S</au><au>Bowman, Judd D</au><au>Bradley, Richard F</au><au>Burba, Jacob</au><au>Carey, Steven</au><au>Carilli, Chris L</au><au>Cheng, Carina</au><au>DeBoer, David R</au><au>Eloy de Lera Acedo</au><au>Dexter, Matt</au><au>Dillon, Joshua S</au><au>Eksteen, Nico</au><au>Ely, John</au><au>Fagnoni, Nicolas</au><au>Fritz, Randall</au><au>Furlanetto, Steven R</au><au>Gale-Sides, Kingsley</au><au>Glendenning, Brian</au><au>Gorthi, Deepthi</au><au>Greig, Bradley</au><au>Grobbelaar, Jasper</au><au>Halday, Ziyaad</au><au>Hazelton, Bryna J</au><au>Hewitt, Jacqueline N</au><au>Hickish, Jack</au><au>Jacobs, Daniel C</au><au>Austin, Julius</au><au>Kariseb, MacCalvin</au><au>Kerrigan, Joshua</au><au>Kittiwisit, Piyanat</au><au>Kohn, Saul A</au><au>Kolopanis, Matthew</au><au>Lanman, Adam</au><au>Paul La Plante</au><au>Loots, Anita</au><au>MacMahon, David Harold Edward</au><au>Malan, Lourence</au><au>Malgas, Cresshim</au><au>Malgas, Keith</au><au>Marero, Bradley</au><au>Martinot, Zachary E</au><au>Mesinger, Andrei</au><au>Molewa, Mathakane</au><au>Morales, Miguel F</au><au>Mosiane, Tshegofalang</au><au>Neben, Abraham R</au><au>Nikolic, Bojan</au><au>Nuwegeld, Hans</au><au>Parsons, Aaron R</au><au>Patra, Nipanjana</au><au>Pieterse, Samantha</au><au>Razavi-Ghods, Nima</au><au>Robnett, James</au><au>Rosie, Kathryn</au><au>Sims, Peter</au><au>Smith, Craig</au><au>Swarts, Hilton</au><au>Thyagarajan, Nithyanandan</au><au>Pieter van Wyngaarden</au><au>Williams, Peter K G</au><au>Zheng, Haoxuan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</atitle><jtitle>arXiv.org</jtitle><date>2023-02-20</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2210.14927</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier EISSN: 2331-8422
ispartof arXiv.org, 2023-02
issn 2331-8422
language eng
recordid cdi_arxiv_primary_2210_14927
source arXiv.org; Free E- Journals
subjects Artificial neural networks
Data analysis
Errors
Interferometry
Ionization
Narrowband
Noise levels
Physics - Cosmology and Nongalactic Astrophysics
Physics - Instrumentation and Methods for Astrophysics
Qualitative analysis
Radio frequency
Radio frequency interference
Simulation
Spectrum analysis
title Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-10T02%3A19%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Characterization%20Of%20Inpaint%20Residuals%20In%20Interferometric%20Measurements%20of%20the%20Epoch%20Of%20Reionization&rft.jtitle=arXiv.org&rft.au=Pagano,%20Michael&rft.date=2023-02-20&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2210.14927&rft_dat=%3Cproquest_arxiv%3E2729741357%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2729741357&rft_id=info:pmid/&rfr_iscdi=true