NetCDF based data archiving system applied to ITER Fast Plant System Control prototype
► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and cluste...
Gespeichert in:
Veröffentlicht in: | Fusion engineering and design 2012-12, Vol.87 (12), p.2223-2228 |
---|---|
Hauptverfasser: | , , , , , , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2228 |
---|---|
container_issue | 12 |
container_start_page | 2223 |
container_title | Fusion engineering and design |
container_volume | 87 |
creator | Castro, R. Vega, J. Ruiz, M. De Arcas, G. Barrera, E. López, J.M. Sanz, D. Gonçalves, B. Santos, B. Utzel, N. Makijarvi, P. |
description | ► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving.
EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control.
The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency.
In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies. |
doi_str_mv | 10.1016/j.fusengdes.2012.05.003 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1671517817</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0920379612002906</els_id><sourcerecordid>1671517817</sourcerecordid><originalsourceid>FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</originalsourceid><addsrcrecordid>eNqFkE1LAzEQhoMoWD9-gzl62XWyH8nmKNVqoaho9RpiMqsp2901SYX-e1MqXoWBOcz7vjPzEHLBIGfA-NUqbzcB-w-LIS-AFTnUOUB5QCasEWUmmOSHZAKygKwUkh-TkxBWAEykmpC3B4zTmxl91wEttTpqqr35dN-u_6BhGyKuqR7HzqVpHOh8eftMZzpE-tTpPtKXvWI69NEPHR39EIe4HfGMHLW6C3j-20_J6-x2Ob3PFo938-n1IjOlFDHjjYXWiLJiwKXkramglgCF4VoKAU3TYFGAaThvW1u2spTYVLW0WNQ2WarylFzuc9Pmrw2GqNYuGOzScThsgmJcsJqJhokkFXup8UMIHls1erfWfqsYqB1JtVJ_JNWOpIJaJZLJeb13Yvrk26FXwTjsDVrn0URlB_dvxg9BN3-0</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1671517817</pqid></control><display><type>article</type><title>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</title><source>Elsevier ScienceDirect Journals Complete</source><creator>Castro, R. ; Vega, J. ; Ruiz, M. ; De Arcas, G. ; Barrera, E. ; López, J.M. ; Sanz, D. ; Gonçalves, B. ; Santos, B. ; Utzel, N. ; Makijarvi, P.</creator><creatorcontrib>Castro, R. ; Vega, J. ; Ruiz, M. ; De Arcas, G. ; Barrera, E. ; López, J.M. ; Sanz, D. ; Gonçalves, B. ; Santos, B. ; Utzel, N. ; Makijarvi, P.</creatorcontrib><description>► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving.
EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control.
The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency.
In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.</description><identifier>ISSN: 0920-3796</identifier><identifier>EISSN: 1873-7196</identifier><identifier>DOI: 10.1016/j.fusengdes.2012.05.003</identifier><language>eng</language><publisher>Elsevier B.V</publisher><subject>Archiving ; Cluster ; Control ; Control systems ; EPICS ; Fault tolerance ; Format ; Management ; Mathematical models ; NetCDF ; Networks ; Prototypes</subject><ispartof>Fusion engineering and design, 2012-12, Vol.87 (12), p.2223-2228</ispartof><rights>2012 Elsevier B.V.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</citedby><cites>FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.fusengdes.2012.05.003$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>314,780,784,3550,27924,27925,45995</link.rule.ids></links><search><creatorcontrib>Castro, R.</creatorcontrib><creatorcontrib>Vega, J.</creatorcontrib><creatorcontrib>Ruiz, M.</creatorcontrib><creatorcontrib>De Arcas, G.</creatorcontrib><creatorcontrib>Barrera, E.</creatorcontrib><creatorcontrib>López, J.M.</creatorcontrib><creatorcontrib>Sanz, D.</creatorcontrib><creatorcontrib>Gonçalves, B.</creatorcontrib><creatorcontrib>Santos, B.</creatorcontrib><creatorcontrib>Utzel, N.</creatorcontrib><creatorcontrib>Makijarvi, P.</creatorcontrib><title>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</title><title>Fusion engineering and design</title><description>► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving.
EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control.
The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency.
In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.</description><subject>Archiving</subject><subject>Cluster</subject><subject>Control</subject><subject>Control systems</subject><subject>EPICS</subject><subject>Fault tolerance</subject><subject>Format</subject><subject>Management</subject><subject>Mathematical models</subject><subject>NetCDF</subject><subject>Networks</subject><subject>Prototypes</subject><issn>0920-3796</issn><issn>1873-7196</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><recordid>eNqFkE1LAzEQhoMoWD9-gzl62XWyH8nmKNVqoaho9RpiMqsp2901SYX-e1MqXoWBOcz7vjPzEHLBIGfA-NUqbzcB-w-LIS-AFTnUOUB5QCasEWUmmOSHZAKygKwUkh-TkxBWAEykmpC3B4zTmxl91wEttTpqqr35dN-u_6BhGyKuqR7HzqVpHOh8eftMZzpE-tTpPtKXvWI69NEPHR39EIe4HfGMHLW6C3j-20_J6-x2Ob3PFo938-n1IjOlFDHjjYXWiLJiwKXkramglgCF4VoKAU3TYFGAaThvW1u2spTYVLW0WNQ2WarylFzuc9Pmrw2GqNYuGOzScThsgmJcsJqJhokkFXup8UMIHls1erfWfqsYqB1JtVJ_JNWOpIJaJZLJeb13Yvrk26FXwTjsDVrn0URlB_dvxg9BN3-0</recordid><startdate>201212</startdate><enddate>201212</enddate><creator>Castro, R.</creator><creator>Vega, J.</creator><creator>Ruiz, M.</creator><creator>De Arcas, G.</creator><creator>Barrera, E.</creator><creator>López, J.M.</creator><creator>Sanz, D.</creator><creator>Gonçalves, B.</creator><creator>Santos, B.</creator><creator>Utzel, N.</creator><creator>Makijarvi, P.</creator><general>Elsevier B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SP</scope><scope>7TB</scope><scope>7U5</scope><scope>8FD</scope><scope>FR3</scope><scope>KR7</scope><scope>L7M</scope></search><sort><creationdate>201212</creationdate><title>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</title><author>Castro, R. ; Vega, J. ; Ruiz, M. ; De Arcas, G. ; Barrera, E. ; López, J.M. ; Sanz, D. ; Gonçalves, B. ; Santos, B. ; Utzel, N. ; Makijarvi, P.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c397t-68d0fc734106996fc4059002c6a9770888e220c866ffd3f939e8459de25d10643</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Archiving</topic><topic>Cluster</topic><topic>Control</topic><topic>Control systems</topic><topic>EPICS</topic><topic>Fault tolerance</topic><topic>Format</topic><topic>Management</topic><topic>Mathematical models</topic><topic>NetCDF</topic><topic>Networks</topic><topic>Prototypes</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Castro, R.</creatorcontrib><creatorcontrib>Vega, J.</creatorcontrib><creatorcontrib>Ruiz, M.</creatorcontrib><creatorcontrib>De Arcas, G.</creatorcontrib><creatorcontrib>Barrera, E.</creatorcontrib><creatorcontrib>López, J.M.</creatorcontrib><creatorcontrib>Sanz, D.</creatorcontrib><creatorcontrib>Gonçalves, B.</creatorcontrib><creatorcontrib>Santos, B.</creatorcontrib><creatorcontrib>Utzel, N.</creatorcontrib><creatorcontrib>Makijarvi, P.</creatorcontrib><collection>CrossRef</collection><collection>Electronics & Communications Abstracts</collection><collection>Mechanical & Transportation Engineering Abstracts</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>Technology Research Database</collection><collection>Engineering Research Database</collection><collection>Civil Engineering Abstracts</collection><collection>Advanced Technologies Database with Aerospace</collection><jtitle>Fusion engineering and design</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Castro, R.</au><au>Vega, J.</au><au>Ruiz, M.</au><au>De Arcas, G.</au><au>Barrera, E.</au><au>López, J.M.</au><au>Sanz, D.</au><au>Gonçalves, B.</au><au>Santos, B.</au><au>Utzel, N.</au><au>Makijarvi, P.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>NetCDF based data archiving system applied to ITER Fast Plant System Control prototype</atitle><jtitle>Fusion engineering and design</jtitle><date>2012-12</date><risdate>2012</risdate><volume>87</volume><issue>12</issue><spage>2223</spage><epage>2228</epage><pages>2223-2228</pages><issn>0920-3796</issn><eissn>1873-7196</eissn><abstract>► Implementation of a data archiving solution for a Fast Plant System Controller (FPSC) for ITER CODAC. ► Data archiving solution based on scientific NetCDF-4 file format and Lustre storage clustering. ► EPICS control based solution. ► Tests results and detailed analysis of using NetCDF-4 and clustering technologies on fast acquisition data archiving.
EURATOM/CIEMAT and Technical University of Madrid (UPM) have been involved in the development of a FPSC [1] (Fast Plant System Control) prototype for ITER, based on PXIe (PCI eXtensions for Instrumentation). One of the main focuses of this project has been data acquisition and all the related issues, including scientific data archiving. Additionally, a new data archiving solution has been developed to demonstrate the obtainable performances and possible bottlenecks of scientific data archiving in Fast Plant System Control.
The presented system implements a fault tolerant architecture over a GEthernet network where FPSC data are reliably archived on remote, while remaining accessible to be redistributed, within the duration of a pulse. The storing service is supported by a clustering solution to guaranty scalability, so that FPSC management and configuration may be simplified, and a unique view of all archived data provided. All the involved components have been integrated under EPICS [2] (Experimental Physics and Industrial Control System), implementing in each case the necessary extensions, state machines and configuration process variables. The prototyped solution is based on the NetCDF-4 [3,4] (Network Common Data Format) file format in order to incorporate important features, such as scientific data models support, huge size files management, platform independent codification, or single-writer/multiple-readers concurrency.
In this contribution, a complete description of the above mentioned solution is presented, together with the most relevant results of the tests performed, while focusing in the benefits and limitations of the applied technologies.</abstract><pub>Elsevier B.V</pub><doi>10.1016/j.fusengdes.2012.05.003</doi><tpages>6</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0920-3796 |
ispartof | Fusion engineering and design, 2012-12, Vol.87 (12), p.2223-2228 |
issn | 0920-3796 1873-7196 |
language | eng |
recordid | cdi_proquest_miscellaneous_1671517817 |
source | Elsevier ScienceDirect Journals Complete |
subjects | Archiving Cluster Control Control systems EPICS Fault tolerance Format Management Mathematical models NetCDF Networks Prototypes |
title | NetCDF based data archiving system applied to ITER Fast Plant System Control prototype |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-27T03%3A53%3A16IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=NetCDF%20based%20data%20archiving%20system%20applied%20to%20ITER%20Fast%20Plant%20System%20Control%20prototype&rft.jtitle=Fusion%20engineering%20and%20design&rft.au=Castro,%20R.&rft.date=2012-12&rft.volume=87&rft.issue=12&rft.spage=2223&rft.epage=2228&rft.pages=2223-2228&rft.issn=0920-3796&rft.eissn=1873-7196&rft_id=info:doi/10.1016/j.fusengdes.2012.05.003&rft_dat=%3Cproquest_cross%3E1671517817%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1671517817&rft_id=info:pmid/&rft_els_id=S0920379612002906&rfr_iscdi=true |