NetCDF based data archiving system applied to ITER Fast Plant System Control prototype

► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and cluste...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Fusion engineering and design 2012-12, Vol.87 (12), p.2223-2228
Hauptverfasser: Castro, R., Vega, J., Ruiz, M., De Arcas, G., Barrera, E., López, J.M., Sanz, D., Gonçalves, B., Santos, B., Utzel, N., Makijarvi, P.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 2228
container_issue 12
container_start_page 2223
container_title Fusion engineering and design
container_volume 87
creator Castro, R.
Vega, J.
Ruiz, M.
De Arcas, G.
Barrera, E.
López, J.M.
Sanz, D.
Gonçalves, B.
Santos, B.
Utzel, N.
Makijarvi, P.
description ► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving. EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control. The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency. In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.
doi_str_mv 10.1016/j.fusengdes.2012.05.003
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1671517817</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0920379612002906</els_id><sourcerecordid>1671517817</sourcerecordid><originalsourceid>FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</originalsourceid><addsrcrecordid>eNqFkE1LAzEQhoMoWD9-gzl62XWyH8nmKNVqoaho9RpiMqsp2901SYX-e1MqXoWBOcz7vjPzEHLBIGfA-NUqbzcB-w-LIS-AFTnUOUB5QCasEWUmmOSHZAKygKwUkh-TkxBWAEykmpC3B4zTmxl91wEttTpqqr35dN-u_6BhGyKuqR7HzqVpHOh8eftMZzpE-tTpPtKXvWI69NEPHR39EIe4HfGMHLW6C3j-20_J6-x2Ob3PFo938-n1IjOlFDHjjYXWiLJiwKXkramglgCF4VoKAU3TYFGAaThvW1u2spTYVLW0WNQ2WarylFzuc9Pmrw2GqNYuGOzScThsgmJcsJqJhokkFXup8UMIHls1erfWfqsYqB1JtVJ_JNWOpIJaJZLJeb13Yvrk26FXwTjsDVrn0URlB_dvxg9BN3-0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1671517817</pqid></control><display><type>article</type><title>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Castro, R. ; Vega, J. ; Ruiz, M. ; De Arcas, G. ; Barrera, E. ; López, J.M. ; Sanz, D. ; Gonçalves, B. ; Santos, B. ; Utzel, N. ; Makijarvi, P.</creator><creatorcontrib>Castro, R. ; Vega, J. ; Ruiz, M. ; De Arcas, G. ; Barrera, E. ; López, J.M. ; Sanz, D. ; Gonçalves, B. ; Santos, B. ; Utzel, N. ; Makijarvi, P.</creatorcontrib><description>► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving. EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control. The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency. In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.</description><identifier>ISSN: 0920-3796</identifier><identifier>EISSN: 1873-7196</identifier><identifier>DOI: 10.1016/j.fusengdes.2012.05.003</identifier><language>eng</language><publisher>Elsevier B.V</publisher><subject>Archiving ; Cluster ; Control ; Control systems ; EPICS ; Fault tolerance ; Format ; Management ; Mathematical models ; NetCDF ; Networks ; Prototypes</subject><ispartof>Fusion engineering and design, 2012-12, Vol.87 (12), p.2223-2228</ispartof><rights>2012 Elsevier B.V.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</citedby><cites>FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.fusengdes.2012.05.003$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Castro, R.</creatorcontrib><creatorcontrib>Vega, J.</creatorcontrib><creatorcontrib>Ruiz, M.</creatorcontrib><creatorcontrib>De Arcas, G.</creatorcontrib><creatorcontrib>Barrera, E.</creatorcontrib><creatorcontrib>López, J.M.</creatorcontrib><creatorcontrib>Sanz, D.</creatorcontrib><creatorcontrib>Gonçalves, B.</creatorcontrib><creatorcontrib>Santos, B.</creatorcontrib><creatorcontrib>Utzel, N.</creatorcontrib><creatorcontrib>Makijarvi, P.</creatorcontrib><title>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</title><title>Fusion engineering and design</title><description>► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving. EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control. The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency. In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.</description><subject>Archiving</subject><subject>Cluster</subject><subject>Control</subject><subject>Control systems</subject><subject>EPICS</subject><subject>Fault tolerance</subject><subject>Format</subject><subject>Management</subject><subject>Mathematical models</subject><subject>NetCDF</subject><subject>Networks</subject><subject>Prototypes</subject><issn>0920-3796</issn><issn>1873-7196</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><recordid>eNqFkE1LAzEQhoMoWD9-gzl62XWyH8nmKNVqoaho9RpiMqsp2901SYX-e1MqXoWBOcz7vjPzEHLBIGfA-NUqbzcB-w-LIS-AFTnUOUB5QCasEWUmmOSHZAKygKwUkh-TkxBWAEykmpC3B4zTmxl91wEttTpqqr35dN-u_6BhGyKuqR7HzqVpHOh8eftMZzpE-tTpPtKXvWI69NEPHR39EIe4HfGMHLW6C3j-20_J6-x2Ob3PFo938-n1IjOlFDHjjYXWiLJiwKXkramglgCF4VoKAU3TYFGAaThvW1u2spTYVLW0WNQ2WarylFzuc9Pmrw2GqNYuGOzScThsgmJcsJqJhokkFXup8UMIHls1erfWfqsYqB1JtVJ_JNWOpIJaJZLJeb13Yvrk26FXwTjsDVrn0URlB_dvxg9BN3-0</recordid><startdate>201212</startdate><enddate>201212</enddate><creator>Castro, R.</creator><creator>Vega, J.</creator><creator>Ruiz, M.</creator><creator>De Arcas, G.</creator><creator>Barrera, E.</creator><creator>López, J.M.</creator><creator>Sanz, D.</creator><creator>Gonçalves, B.</creator><creator>Santos, B.</creator><creator>Utzel, N.</creator><creator>Makijarvi, P.</creator><general>Elsevier B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7TB</scope><scope>7U5</scope><scope>8FD</scope><scope>FR3</scope><scope>KR7</scope><scope>L7M</scope></search><sort><creationdate>201212</creationdate><title>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</title><author>Castro, R. ; Vega, J. ; Ruiz, M. ; De Arcas, G. ; Barrera, E. ; López, J.M. ; Sanz, D. ; Gonçalves, B. ; Santos, B. ; Utzel, N. ; Makijarvi, P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Archiving</topic><topic>Cluster</topic><topic>Control</topic><topic>Control systems</topic><topic>EPICS</topic><topic>Fault tolerance</topic><topic>Format</topic><topic>Management</topic><topic>Mathematical models</topic><topic>NetCDF</topic><topic>Networks</topic><topic>Prototypes</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Castro, R.</creatorcontrib><creatorcontrib>Vega, J.</creatorcontrib><creatorcontrib>Ruiz, M.</creatorcontrib><creatorcontrib>De Arcas, G.</creatorcontrib><creatorcontrib>Barrera, E.</creatorcontrib><creatorcontrib>López, J.M.</creatorcontrib><creatorcontrib>Sanz, D.</creatorcontrib><creatorcontrib>Gonçalves, B.</creatorcontrib><creatorcontrib>Santos, B.</creatorcontrib><creatorcontrib>Utzel, N.</creatorcontrib><creatorcontrib>Makijarvi, P.</creatorcontrib><collection>CrossRef</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Mechanical &amp; Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Fusion engineering and design</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Castro, R.</au><au>Vega, J.</au><au>Ruiz, M.</au><au>De Arcas, G.</au><au>Barrera, E.</au><au>López, J.M.</au><au>Sanz, D.</au><au>Gonçalves, B.</au><au>Santos, B.</au><au>Utzel, N.</au><au>Makijarvi, P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</atitle><jtitle>Fusion engineering and design</jtitle><date>2012-12</date><risdate>2012</risdate><volume>87</volume><issue>12</issue><spage>2223</spage><epage>2228</epage><pages>2223-2228</pages><issn>0920-3796</issn><eissn>1873-7196</eissn><abstract>► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving. EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control. The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency. In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.</abstract><pub>Elsevier B.V</pub><doi>10.1016/j.fusengdes.2012.05.003</doi><tpages>6</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0920-3796
ispartof Fusion engineering and design, 2012-12, Vol.87 (12), p.2223-2228
issn 0920-3796
1873-7196
language eng
recordid cdi_proquest_miscellaneous_1671517817
source Elsevier ScienceDirect Journals Complete
subjects Archiving
Cluster
Control
Control systems
EPICS
Fault tolerance
Format
Management
Mathematical models
NetCDF
Networks
Prototypes
title NetCDF based data archiving system applied to ITER Fast Plant System Control prototype
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T03%3A53%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=NetCDF%20based%20data%20archiving%20system%20applied%20to%20ITER%20Fast%20Plant%20System%20Control%20prototype&rft.jtitle=Fusion%20engineering%20and%20design&rft.au=Castro,%20R.&rft.date=2012-12&rft.volume=87&rft.issue=12&rft.spage=2223&rft.epage=2228&rft.pages=2223-2228&rft.issn=0920-3796&rft.eissn=1873-7196&rft_id=info:doi/10.1016/j.fusengdes.2012.05.003&rft_dat=%3Cproquest_cross%3E1671517817%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1671517817&rft_id=info:pmid/&rft_els_id=S0920379612002906&rfr_iscdi=true