Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization
Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We ex...
Gespeichert in:
Veröffentlicht in: | arXiv.org 2023-02 |
---|---|
Hauptverfasser: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | |
---|---|
container_issue | |
container_start_page | |
container_title | arXiv.org |
container_volume | |
creator | Pagano, Michael Liu, Jing Liu, Adrian Kern, Nicholas S Ewall-Wice, Aaron Bull, Philip Pascua, Robert Ravanbakhsh, Siamak Abdurashidova, Zara Adams, Tyrone Aguirre, James E Alexander, Paul Ali, Zaki S Baartman, Rushelle Balfour, Yanga Beardsley, Adam P Bernardi, Gianni Billings, Tashalee S Bowman, Judd D Bradley, Richard F Burba, Jacob Carey, Steven Carilli, Chris L Cheng, Carina DeBoer, David R Eloy de Lera Acedo Dexter, Matt Dillon, Joshua S Eksteen, Nico Ely, John Fagnoni, Nicolas Fritz, Randall Furlanetto, Steven R Gale-Sides, Kingsley Glendenning, Brian Gorthi, Deepthi Greig, Bradley Grobbelaar, Jasper Halday, Ziyaad Hazelton, Bryna J Hewitt, Jacqueline N Hickish, Jack Jacobs, Daniel C Austin, Julius Kariseb, MacCalvin Kerrigan, Joshua Kittiwisit, Piyanat Kohn, Saul A Kolopanis, Matthew Lanman, Adam Paul La Plante Loots, Anita MacMahon, David Harold Edward Malan, Lourence Malgas, Cresshim Malgas, Keith Marero, Bradley Martinot, Zachary E Mesinger, Andrei Molewa, Mathakane Morales, Miguel F Mosiane, Tshegofalang Neben, Abraham R Nikolic, Bojan Nuwegeld, Hans Parsons, Aaron R Patra, Nipanjana Pieterse, Samantha Razavi-Ghods, Nima Robnett, James Rosie, Kathryn Sims, Peter Smith, Craig Swarts, Hilton Thyagarajan, Nithyanandan Pieter van Wyngaarden Williams, Peter K G Zheng, Haoxuan |
description | Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data. |
doi_str_mv | 10.48550/arxiv.2210.14927 |
format | Article |
fullrecord | <record><control><sourceid>proquest_arxiv</sourceid><recordid>TN_cdi_arxiv_primary_2210_14927</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2729741357</sourcerecordid><originalsourceid>FETCH-LOGICAL-a957-74b0fbd582af028ddb6131c2c163403c672d2af68a110128dc3cea9d85b9e4d63</originalsourceid><addsrcrecordid>eNotkNtKAzEQhoMgWGofwCsDXm_NcbN7KaVqoVIovV-yySyb4h5MsqI-vekBBgb--fgYfoQeKFmKQkryrP2P-14ylgIqSqZu0IxxTrNCMHaHFiEcCSEsV0xKPkP1qtVemwje_enohh7vGrzpR-36iPcQnJ30Z0hJmgQ14IcOoncGf4AOk4cO-hjw0ODYAl6Pg2lPhj0k1dV4j26b5IDFdc_R4XV9WL1n293bZvWyzXQpVaZETZrayoLphrDC2jqnnBpmaM4F4SY9bNMpLzSlhCbAcAO6tIWsSxA253P0eNGeC6hG7zrtf6tTEdW5iEQ8XYjRD18ThFgdh8n36aeKKVYqQblU_B9lf2Gg</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2729741357</pqid></control><display><type>article</type><title>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</title><source>arXiv.org</source><source>Free E- Journals</source><creator>Pagano, Michael ; Liu, Jing ; Liu, Adrian ; Kern, Nicholas S ; Ewall-Wice, Aaron ; Bull, Philip ; Pascua, Robert ; Ravanbakhsh, Siamak ; Abdurashidova, Zara ; Adams, Tyrone ; Aguirre, James E ; Alexander, Paul ; Ali, Zaki S ; Baartman, Rushelle ; Balfour, Yanga ; Beardsley, Adam P ; Bernardi, Gianni ; Billings, Tashalee S ; Bowman, Judd D ; Bradley, Richard F ; Burba, Jacob ; Carey, Steven ; Carilli, Chris L ; Cheng, Carina ; DeBoer, David R ; Eloy de Lera Acedo ; Dexter, Matt ; Dillon, Joshua S ; Eksteen, Nico ; Ely, John ; Fagnoni, Nicolas ; Fritz, Randall ; Furlanetto, Steven R ; Gale-Sides, Kingsley ; Glendenning, Brian ; Gorthi, Deepthi ; Greig, Bradley ; Grobbelaar, Jasper ; Halday, Ziyaad ; Hazelton, Bryna J ; Hewitt, Jacqueline N ; Hickish, Jack ; Jacobs, Daniel C ; Austin, Julius ; Kariseb, MacCalvin ; Kerrigan, Joshua ; Kittiwisit, Piyanat ; Kohn, Saul A ; Kolopanis, Matthew ; Lanman, Adam ; Paul La Plante ; Loots, Anita ; MacMahon, David Harold Edward ; Malan, Lourence ; Malgas, Cresshim ; Malgas, Keith ; Marero, Bradley ; Martinot, Zachary E ; Mesinger, Andrei ; Molewa, Mathakane ; Morales, Miguel F ; Mosiane, Tshegofalang ; Neben, Abraham R ; Nikolic, Bojan ; Nuwegeld, Hans ; Parsons, Aaron R ; Patra, Nipanjana ; Pieterse, Samantha ; Razavi-Ghods, Nima ; Robnett, James ; Rosie, Kathryn ; Sims, Peter ; Smith, Craig ; Swarts, Hilton ; Thyagarajan, Nithyanandan ; Pieter van Wyngaarden ; Williams, Peter K G ; Zheng, Haoxuan</creator><creatorcontrib>Pagano, Michael ; Liu, Jing ; Liu, Adrian ; Kern, Nicholas S ; Ewall-Wice, Aaron ; Bull, Philip ; Pascua, Robert ; Ravanbakhsh, Siamak ; Abdurashidova, Zara ; Adams, Tyrone ; Aguirre, James E ; Alexander, Paul ; Ali, Zaki S ; Baartman, Rushelle ; Balfour, Yanga ; Beardsley, Adam P ; Bernardi, Gianni ; Billings, Tashalee S ; Bowman, Judd D ; Bradley, Richard F ; Burba, Jacob ; Carey, Steven ; Carilli, Chris L ; Cheng, Carina ; DeBoer, David R ; Eloy de Lera Acedo ; Dexter, Matt ; Dillon, Joshua S ; Eksteen, Nico ; Ely, John ; Fagnoni, Nicolas ; Fritz, Randall ; Furlanetto, Steven R ; Gale-Sides, Kingsley ; Glendenning, Brian ; Gorthi, Deepthi ; Greig, Bradley ; Grobbelaar, Jasper ; Halday, Ziyaad ; Hazelton, Bryna J ; Hewitt, Jacqueline N ; Hickish, Jack ; Jacobs, Daniel C ; Austin, Julius ; Kariseb, MacCalvin ; Kerrigan, Joshua ; Kittiwisit, Piyanat ; Kohn, Saul A ; Kolopanis, Matthew ; Lanman, Adam ; Paul La Plante ; Loots, Anita ; MacMahon, David Harold Edward ; Malan, Lourence ; Malgas, Cresshim ; Malgas, Keith ; Marero, Bradley ; Martinot, Zachary E ; Mesinger, Andrei ; Molewa, Mathakane ; Morales, Miguel F ; Mosiane, Tshegofalang ; Neben, Abraham R ; Nikolic, Bojan ; Nuwegeld, Hans ; Parsons, Aaron R ; Patra, Nipanjana ; Pieterse, Samantha ; Razavi-Ghods, Nima ; Robnett, James ; Rosie, Kathryn ; Sims, Peter ; Smith, Craig ; Swarts, Hilton ; Thyagarajan, Nithyanandan ; Pieter van Wyngaarden ; Williams, Peter K G ; Zheng, Haoxuan</creatorcontrib><description>Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.</description><identifier>EISSN: 2331-8422</identifier><identifier>DOI: 10.48550/arxiv.2210.14927</identifier><language>eng</language><publisher>Ithaca: Cornell University Library, arXiv.org</publisher><subject>Artificial neural networks ; Data analysis ; Errors ; Interferometry ; Ionization ; Narrowband ; Noise levels ; Physics - Cosmology and Nongalactic Astrophysics ; Physics - Instrumentation and Methods for Astrophysics ; Qualitative analysis ; Radio frequency ; Radio frequency interference ; Simulation ; Spectrum analysis</subject><ispartof>arXiv.org, 2023-02</ispartof><rights>2023. This work is published under http://creativecommons.org/publicdomain/zero/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>http://creativecommons.org/publicdomain/zero/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,776,780,881,27902</link.rule.ids><backlink>$$Uhttps://doi.org/10.48550/arXiv.2210.14927$$DView paper in arXiv$$Hfree_for_read</backlink><backlink>$$Uhttps://doi.org/10.1093/mnras/stad441$$DView published paper (Access to full text may be restricted)$$Hfree_for_read</backlink></links><search><creatorcontrib>Pagano, Michael</creatorcontrib><creatorcontrib>Liu, Jing</creatorcontrib><creatorcontrib>Liu, Adrian</creatorcontrib><creatorcontrib>Kern, Nicholas S</creatorcontrib><creatorcontrib>Ewall-Wice, Aaron</creatorcontrib><creatorcontrib>Bull, Philip</creatorcontrib><creatorcontrib>Pascua, Robert</creatorcontrib><creatorcontrib>Ravanbakhsh, Siamak</creatorcontrib><creatorcontrib>Abdurashidova, Zara</creatorcontrib><creatorcontrib>Adams, Tyrone</creatorcontrib><creatorcontrib>Aguirre, James E</creatorcontrib><creatorcontrib>Alexander, Paul</creatorcontrib><creatorcontrib>Ali, Zaki S</creatorcontrib><creatorcontrib>Baartman, Rushelle</creatorcontrib><creatorcontrib>Balfour, Yanga</creatorcontrib><creatorcontrib>Beardsley, Adam P</creatorcontrib><creatorcontrib>Bernardi, Gianni</creatorcontrib><creatorcontrib>Billings, Tashalee S</creatorcontrib><creatorcontrib>Bowman, Judd D</creatorcontrib><creatorcontrib>Bradley, Richard F</creatorcontrib><creatorcontrib>Burba, Jacob</creatorcontrib><creatorcontrib>Carey, Steven</creatorcontrib><creatorcontrib>Carilli, Chris L</creatorcontrib><creatorcontrib>Cheng, Carina</creatorcontrib><creatorcontrib>DeBoer, David R</creatorcontrib><creatorcontrib>Eloy de Lera Acedo</creatorcontrib><creatorcontrib>Dexter, Matt</creatorcontrib><creatorcontrib>Dillon, Joshua S</creatorcontrib><creatorcontrib>Eksteen, Nico</creatorcontrib><creatorcontrib>Ely, John</creatorcontrib><creatorcontrib>Fagnoni, Nicolas</creatorcontrib><creatorcontrib>Fritz, Randall</creatorcontrib><creatorcontrib>Furlanetto, Steven R</creatorcontrib><creatorcontrib>Gale-Sides, Kingsley</creatorcontrib><creatorcontrib>Glendenning, Brian</creatorcontrib><creatorcontrib>Gorthi, Deepthi</creatorcontrib><creatorcontrib>Greig, Bradley</creatorcontrib><creatorcontrib>Grobbelaar, Jasper</creatorcontrib><creatorcontrib>Halday, Ziyaad</creatorcontrib><creatorcontrib>Hazelton, Bryna J</creatorcontrib><creatorcontrib>Hewitt, Jacqueline N</creatorcontrib><creatorcontrib>Hickish, Jack</creatorcontrib><creatorcontrib>Jacobs, Daniel C</creatorcontrib><creatorcontrib>Austin, Julius</creatorcontrib><creatorcontrib>Kariseb, MacCalvin</creatorcontrib><creatorcontrib>Kerrigan, Joshua</creatorcontrib><creatorcontrib>Kittiwisit, Piyanat</creatorcontrib><creatorcontrib>Kohn, Saul A</creatorcontrib><creatorcontrib>Kolopanis, Matthew</creatorcontrib><creatorcontrib>Lanman, Adam</creatorcontrib><creatorcontrib>Paul La Plante</creatorcontrib><creatorcontrib>Loots, Anita</creatorcontrib><creatorcontrib>MacMahon, David Harold Edward</creatorcontrib><creatorcontrib>Malan, Lourence</creatorcontrib><creatorcontrib>Malgas, Cresshim</creatorcontrib><creatorcontrib>Malgas, Keith</creatorcontrib><creatorcontrib>Marero, Bradley</creatorcontrib><creatorcontrib>Martinot, Zachary E</creatorcontrib><creatorcontrib>Mesinger, Andrei</creatorcontrib><creatorcontrib>Molewa, Mathakane</creatorcontrib><creatorcontrib>Morales, Miguel F</creatorcontrib><creatorcontrib>Mosiane, Tshegofalang</creatorcontrib><creatorcontrib>Neben, Abraham R</creatorcontrib><creatorcontrib>Nikolic, Bojan</creatorcontrib><creatorcontrib>Nuwegeld, Hans</creatorcontrib><creatorcontrib>Parsons, Aaron R</creatorcontrib><creatorcontrib>Patra, Nipanjana</creatorcontrib><creatorcontrib>Pieterse, Samantha</creatorcontrib><creatorcontrib>Razavi-Ghods, Nima</creatorcontrib><creatorcontrib>Robnett, James</creatorcontrib><creatorcontrib>Rosie, Kathryn</creatorcontrib><creatorcontrib>Sims, Peter</creatorcontrib><creatorcontrib>Smith, Craig</creatorcontrib><creatorcontrib>Swarts, Hilton</creatorcontrib><creatorcontrib>Thyagarajan, Nithyanandan</creatorcontrib><creatorcontrib>Pieter van Wyngaarden</creatorcontrib><creatorcontrib>Williams, Peter K G</creatorcontrib><creatorcontrib>Zheng, Haoxuan</creatorcontrib><title>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</title><title>arXiv.org</title><description>Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.</description><subject>Artificial neural networks</subject><subject>Data analysis</subject><subject>Errors</subject><subject>Interferometry</subject><subject>Ionization</subject><subject>Narrowband</subject><subject>Noise levels</subject><subject>Physics - Cosmology and Nongalactic Astrophysics</subject><subject>Physics - Instrumentation and Methods for Astrophysics</subject><subject>Qualitative analysis</subject><subject>Radio frequency</subject><subject>Radio frequency interference</subject><subject>Simulation</subject><subject>Spectrum analysis</subject><issn>2331-8422</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><sourceid>GOX</sourceid><recordid>eNotkNtKAzEQhoMgWGofwCsDXm_NcbN7KaVqoVIovV-yySyb4h5MsqI-vekBBgb--fgYfoQeKFmKQkryrP2P-14ylgIqSqZu0IxxTrNCMHaHFiEcCSEsV0xKPkP1qtVemwje_enohh7vGrzpR-36iPcQnJ30Z0hJmgQ14IcOoncGf4AOk4cO-hjw0ODYAl6Pg2lPhj0k1dV4j26b5IDFdc_R4XV9WL1n293bZvWyzXQpVaZETZrayoLphrDC2jqnnBpmaM4F4SY9bNMpLzSlhCbAcAO6tIWsSxA253P0eNGeC6hG7zrtf6tTEdW5iEQ8XYjRD18ThFgdh8n36aeKKVYqQblU_B9lf2Gg</recordid><startdate>20230220</startdate><enddate>20230220</enddate><creator>Pagano, Michael</creator><creator>Liu, Jing</creator><creator>Liu, Adrian</creator><creator>Kern, Nicholas S</creator><creator>Ewall-Wice, Aaron</creator><creator>Bull, Philip</creator><creator>Pascua, Robert</creator><creator>Ravanbakhsh, Siamak</creator><creator>Abdurashidova, Zara</creator><creator>Adams, Tyrone</creator><creator>Aguirre, James E</creator><creator>Alexander, Paul</creator><creator>Ali, Zaki S</creator><creator>Baartman, Rushelle</creator><creator>Balfour, Yanga</creator><creator>Beardsley, Adam P</creator><creator>Bernardi, Gianni</creator><creator>Billings, Tashalee S</creator><creator>Bowman, Judd D</creator><creator>Bradley, Richard F</creator><creator>Burba, Jacob</creator><creator>Carey, Steven</creator><creator>Carilli, Chris L</creator><creator>Cheng, Carina</creator><creator>DeBoer, David R</creator><creator>Eloy de Lera Acedo</creator><creator>Dexter, Matt</creator><creator>Dillon, Joshua S</creator><creator>Eksteen, Nico</creator><creator>Ely, John</creator><creator>Fagnoni, Nicolas</creator><creator>Fritz, Randall</creator><creator>Furlanetto, Steven R</creator><creator>Gale-Sides, Kingsley</creator><creator>Glendenning, Brian</creator><creator>Gorthi, Deepthi</creator><creator>Greig, Bradley</creator><creator>Grobbelaar, Jasper</creator><creator>Halday, Ziyaad</creator><creator>Hazelton, Bryna J</creator><creator>Hewitt, Jacqueline N</creator><creator>Hickish, Jack</creator><creator>Jacobs, Daniel C</creator><creator>Austin, Julius</creator><creator>Kariseb, MacCalvin</creator><creator>Kerrigan, Joshua</creator><creator>Kittiwisit, Piyanat</creator><creator>Kohn, Saul A</creator><creator>Kolopanis, Matthew</creator><creator>Lanman, Adam</creator><creator>Paul La Plante</creator><creator>Loots, Anita</creator><creator>MacMahon, David Harold Edward</creator><creator>Malan, Lourence</creator><creator>Malgas, Cresshim</creator><creator>Malgas, Keith</creator><creator>Marero, Bradley</creator><creator>Martinot, Zachary E</creator><creator>Mesinger, Andrei</creator><creator>Molewa, Mathakane</creator><creator>Morales, Miguel F</creator><creator>Mosiane, Tshegofalang</creator><creator>Neben, Abraham R</creator><creator>Nikolic, Bojan</creator><creator>Nuwegeld, Hans</creator><creator>Parsons, Aaron R</creator><creator>Patra, Nipanjana</creator><creator>Pieterse, Samantha</creator><creator>Razavi-Ghods, Nima</creator><creator>Robnett, James</creator><creator>Rosie, Kathryn</creator><creator>Sims, Peter</creator><creator>Smith, Craig</creator><creator>Swarts, Hilton</creator><creator>Thyagarajan, Nithyanandan</creator><creator>Pieter van Wyngaarden</creator><creator>Williams, Peter K G</creator><creator>Zheng, Haoxuan</creator><general>Cornell University Library, arXiv.org</general><scope>8FE</scope><scope>8FG</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>HCIFZ</scope><scope>L6V</scope><scope>M7S</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>GOX</scope></search><sort><creationdate>20230220</creationdate><title>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</title><author>Pagano, Michael ; Liu, Jing ; Liu, Adrian ; Kern, Nicholas S ; Ewall-Wice, Aaron ; Bull, Philip ; Pascua, Robert ; Ravanbakhsh, Siamak ; Abdurashidova, Zara ; Adams, Tyrone ; Aguirre, James E ; Alexander, Paul ; Ali, Zaki S ; Baartman, Rushelle ; Balfour, Yanga ; Beardsley, Adam P ; Bernardi, Gianni ; Billings, Tashalee S ; Bowman, Judd D ; Bradley, Richard F ; Burba, Jacob ; Carey, Steven ; Carilli, Chris L ; Cheng, Carina ; DeBoer, David R ; Eloy de Lera Acedo ; Dexter, Matt ; Dillon, Joshua S ; Eksteen, Nico ; Ely, John ; Fagnoni, Nicolas ; Fritz, Randall ; Furlanetto, Steven R ; Gale-Sides, Kingsley ; Glendenning, Brian ; Gorthi, Deepthi ; Greig, Bradley ; Grobbelaar, Jasper ; Halday, Ziyaad ; Hazelton, Bryna J ; Hewitt, Jacqueline N ; Hickish, Jack ; Jacobs, Daniel C ; Austin, Julius ; Kariseb, MacCalvin ; Kerrigan, Joshua ; Kittiwisit, Piyanat ; Kohn, Saul A ; Kolopanis, Matthew ; Lanman, Adam ; Paul La Plante ; Loots, Anita ; MacMahon, David Harold Edward ; Malan, Lourence ; Malgas, Cresshim ; Malgas, Keith ; Marero, Bradley ; Martinot, Zachary E ; Mesinger, Andrei ; Molewa, Mathakane ; Morales, Miguel F ; Mosiane, Tshegofalang ; Neben, Abraham R ; Nikolic, Bojan ; Nuwegeld, Hans ; Parsons, Aaron R ; Patra, Nipanjana ; Pieterse, Samantha ; Razavi-Ghods, Nima ; Robnett, James ; Rosie, Kathryn ; Sims, Peter ; Smith, Craig ; Swarts, Hilton ; Thyagarajan, Nithyanandan ; Pieter van Wyngaarden ; Williams, Peter K G ; Zheng, Haoxuan</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a957-74b0fbd582af028ddb6131c2c163403c672d2af68a110128dc3cea9d85b9e4d63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Artificial neural networks</topic><topic>Data analysis</topic><topic>Errors</topic><topic>Interferometry</topic><topic>Ionization</topic><topic>Narrowband</topic><topic>Noise levels</topic><topic>Physics - Cosmology and Nongalactic Astrophysics</topic><topic>Physics - Instrumentation and Methods for Astrophysics</topic><topic>Qualitative analysis</topic><topic>Radio frequency</topic><topic>Radio frequency interference</topic><topic>Simulation</topic><topic>Spectrum analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>Pagano, Michael</creatorcontrib><creatorcontrib>Liu, Jing</creatorcontrib><creatorcontrib>Liu, Adrian</creatorcontrib><creatorcontrib>Kern, Nicholas S</creatorcontrib><creatorcontrib>Ewall-Wice, Aaron</creatorcontrib><creatorcontrib>Bull, Philip</creatorcontrib><creatorcontrib>Pascua, Robert</creatorcontrib><creatorcontrib>Ravanbakhsh, Siamak</creatorcontrib><creatorcontrib>Abdurashidova, Zara</creatorcontrib><creatorcontrib>Adams, Tyrone</creatorcontrib><creatorcontrib>Aguirre, James E</creatorcontrib><creatorcontrib>Alexander, Paul</creatorcontrib><creatorcontrib>Ali, Zaki S</creatorcontrib><creatorcontrib>Baartman, Rushelle</creatorcontrib><creatorcontrib>Balfour, Yanga</creatorcontrib><creatorcontrib>Beardsley, Adam P</creatorcontrib><creatorcontrib>Bernardi, Gianni</creatorcontrib><creatorcontrib>Billings, Tashalee S</creatorcontrib><creatorcontrib>Bowman, Judd D</creatorcontrib><creatorcontrib>Bradley, Richard F</creatorcontrib><creatorcontrib>Burba, Jacob</creatorcontrib><creatorcontrib>Carey, Steven</creatorcontrib><creatorcontrib>Carilli, Chris L</creatorcontrib><creatorcontrib>Cheng, Carina</creatorcontrib><creatorcontrib>DeBoer, David R</creatorcontrib><creatorcontrib>Eloy de Lera Acedo</creatorcontrib><creatorcontrib>Dexter, Matt</creatorcontrib><creatorcontrib>Dillon, Joshua S</creatorcontrib><creatorcontrib>Eksteen, Nico</creatorcontrib><creatorcontrib>Ely, John</creatorcontrib><creatorcontrib>Fagnoni, Nicolas</creatorcontrib><creatorcontrib>Fritz, Randall</creatorcontrib><creatorcontrib>Furlanetto, Steven R</creatorcontrib><creatorcontrib>Gale-Sides, Kingsley</creatorcontrib><creatorcontrib>Glendenning, Brian</creatorcontrib><creatorcontrib>Gorthi, Deepthi</creatorcontrib><creatorcontrib>Greig, Bradley</creatorcontrib><creatorcontrib>Grobbelaar, Jasper</creatorcontrib><creatorcontrib>Halday, Ziyaad</creatorcontrib><creatorcontrib>Hazelton, Bryna J</creatorcontrib><creatorcontrib>Hewitt, Jacqueline N</creatorcontrib><creatorcontrib>Hickish, Jack</creatorcontrib><creatorcontrib>Jacobs, Daniel C</creatorcontrib><creatorcontrib>Austin, Julius</creatorcontrib><creatorcontrib>Kariseb, MacCalvin</creatorcontrib><creatorcontrib>Kerrigan, Joshua</creatorcontrib><creatorcontrib>Kittiwisit, Piyanat</creatorcontrib><creatorcontrib>Kohn, Saul A</creatorcontrib><creatorcontrib>Kolopanis, Matthew</creatorcontrib><creatorcontrib>Lanman, Adam</creatorcontrib><creatorcontrib>Paul La Plante</creatorcontrib><creatorcontrib>Loots, Anita</creatorcontrib><creatorcontrib>MacMahon, David Harold Edward</creatorcontrib><creatorcontrib>Malan, Lourence</creatorcontrib><creatorcontrib>Malgas, Cresshim</creatorcontrib><creatorcontrib>Malgas, Keith</creatorcontrib><creatorcontrib>Marero, Bradley</creatorcontrib><creatorcontrib>Martinot, Zachary E</creatorcontrib><creatorcontrib>Mesinger, Andrei</creatorcontrib><creatorcontrib>Molewa, Mathakane</creatorcontrib><creatorcontrib>Morales, Miguel F</creatorcontrib><creatorcontrib>Mosiane, Tshegofalang</creatorcontrib><creatorcontrib>Neben, Abraham R</creatorcontrib><creatorcontrib>Nikolic, Bojan</creatorcontrib><creatorcontrib>Nuwegeld, Hans</creatorcontrib><creatorcontrib>Parsons, Aaron R</creatorcontrib><creatorcontrib>Patra, Nipanjana</creatorcontrib><creatorcontrib>Pieterse, Samantha</creatorcontrib><creatorcontrib>Razavi-Ghods, Nima</creatorcontrib><creatorcontrib>Robnett, James</creatorcontrib><creatorcontrib>Rosie, Kathryn</creatorcontrib><creatorcontrib>Sims, Peter</creatorcontrib><creatorcontrib>Smith, Craig</creatorcontrib><creatorcontrib>Swarts, Hilton</creatorcontrib><creatorcontrib>Thyagarajan, Nithyanandan</creatorcontrib><creatorcontrib>Pieter van Wyngaarden</creatorcontrib><creatorcontrib>Williams, Peter K G</creatorcontrib><creatorcontrib>Zheng, Haoxuan</creatorcontrib><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Engineering Collection</collection><collection>Engineering Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>arXiv.org</collection><jtitle>arXiv.org</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Pagano, Michael</au><au>Liu, Jing</au><au>Liu, Adrian</au><au>Kern, Nicholas S</au><au>Ewall-Wice, Aaron</au><au>Bull, Philip</au><au>Pascua, Robert</au><au>Ravanbakhsh, Siamak</au><au>Abdurashidova, Zara</au><au>Adams, Tyrone</au><au>Aguirre, James E</au><au>Alexander, Paul</au><au>Ali, Zaki S</au><au>Baartman, Rushelle</au><au>Balfour, Yanga</au><au>Beardsley, Adam P</au><au>Bernardi, Gianni</au><au>Billings, Tashalee S</au><au>Bowman, Judd D</au><au>Bradley, Richard F</au><au>Burba, Jacob</au><au>Carey, Steven</au><au>Carilli, Chris L</au><au>Cheng, Carina</au><au>DeBoer, David R</au><au>Eloy de Lera Acedo</au><au>Dexter, Matt</au><au>Dillon, Joshua S</au><au>Eksteen, Nico</au><au>Ely, John</au><au>Fagnoni, Nicolas</au><au>Fritz, Randall</au><au>Furlanetto, Steven R</au><au>Gale-Sides, Kingsley</au><au>Glendenning, Brian</au><au>Gorthi, Deepthi</au><au>Greig, Bradley</au><au>Grobbelaar, Jasper</au><au>Halday, Ziyaad</au><au>Hazelton, Bryna J</au><au>Hewitt, Jacqueline N</au><au>Hickish, Jack</au><au>Jacobs, Daniel C</au><au>Austin, Julius</au><au>Kariseb, MacCalvin</au><au>Kerrigan, Joshua</au><au>Kittiwisit, Piyanat</au><au>Kohn, Saul A</au><au>Kolopanis, Matthew</au><au>Lanman, Adam</au><au>Paul La Plante</au><au>Loots, Anita</au><au>MacMahon, David Harold Edward</au><au>Malan, Lourence</au><au>Malgas, Cresshim</au><au>Malgas, Keith</au><au>Marero, Bradley</au><au>Martinot, Zachary E</au><au>Mesinger, Andrei</au><au>Molewa, Mathakane</au><au>Morales, Miguel F</au><au>Mosiane, Tshegofalang</au><au>Neben, Abraham R</au><au>Nikolic, Bojan</au><au>Nuwegeld, Hans</au><au>Parsons, Aaron R</au><au>Patra, Nipanjana</au><au>Pieterse, Samantha</au><au>Razavi-Ghods, Nima</au><au>Robnett, James</au><au>Rosie, Kathryn</au><au>Sims, Peter</au><au>Smith, Craig</au><au>Swarts, Hilton</au><au>Thyagarajan, Nithyanandan</au><au>Pieter van Wyngaarden</au><au>Williams, Peter K G</au><au>Zheng, Haoxuan</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization</atitle><jtitle>arXiv.org</jtitle><date>2023-02-20</date><risdate>2023</risdate><eissn>2331-8422</eissn><abstract>Radio Frequency Interference (RFI) is one of the systematic challenges preventing 21cm interferometric instruments from detecting the Epoch of Reionization. To mitigate the effects of RFI on data analysis pipelines, numerous inpaint techniques have been developed to restore RFI corrupted data. We examine the qualitative and quantitative errors introduced into the visibilities and power spectrum due to inpainting. We perform our analysis on simulated data as well as real data from the Hydrogen Epoch of Reionization Array (HERA) Phase 1 upper limits. We also introduce a convolutional neural network that capable of inpainting RFI corrupted data in interferometric instruments. We train our network on simulated data and show that our network is capable at inpainting real data without requiring to be retrained. We find that techniques that incorporate high wavenumbers in delay space in their modeling are best suited for inpainting over narrowband RFI. We also show that with our fiducial parameters Discrete Prolate Spheroidal Sequences (DPSS) and CLEAN provide the best performance for intermittent ``narrowband'' RFI while Gaussian Progress Regression (GPR) and Least Squares Spectral Analysis (LSSA) provide the best performance for larger RFI gaps. However we caution that these qualitative conclusions are sensitive to the chosen hyperparameters of each inpainting technique. We find these results to be consistent in both simulated and real visibilities. We show that all inpainting techniques reliably reproduce foreground dominated modes in the power spectrum. Since the inpainting techniques should not be capable of reproducing noise realizations, we find that the largest errors occur in the noise dominated delay modes. We show that in the future, as the noise level of the data comes down, CLEAN and DPSS are most capable of reproducing the fine frequency structure in the visibilities of HERA data.</abstract><cop>Ithaca</cop><pub>Cornell University Library, arXiv.org</pub><doi>10.48550/arxiv.2210.14927</doi><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | EISSN: 2331-8422 |
ispartof | arXiv.org, 2023-02 |
issn | 2331-8422 |
language | eng |
recordid | cdi_arxiv_primary_2210_14927 |
source | arXiv.org; Free E- Journals |
subjects | Artificial neural networks Data analysis Errors Interferometry Ionization Narrowband Noise levels Physics - Cosmology and Nongalactic Astrophysics Physics - Instrumentation and Methods for Astrophysics Qualitative analysis Radio frequency Radio frequency interference Simulation Spectrum analysis |
title | Characterization Of Inpaint Residuals In Interferometric Measurements of the Epoch Of Reionization |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-10T02%3A19%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_arxiv&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Characterization%20Of%20Inpaint%20Residuals%20In%20Interferometric%20Measurements%20of%20the%20Epoch%20Of%20Reionization&rft.jtitle=arXiv.org&rft.au=Pagano,%20Michael&rft.date=2023-02-20&rft.eissn=2331-8422&rft_id=info:doi/10.48550/arxiv.2210.14927&rft_dat=%3Cproquest_arxiv%3E2729741357%3C/proquest_arxiv%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2729741357&rft_id=info:pmid/&rfr_iscdi=true |