Online Meta-data Collection and Monitoring Framework for the STAR Experiment at RHIC
The STAR Experiment further exploits scalable message-oriented model principles to achieve a high level of control over online data streams. In this paper we present an AMQP-powered Message Interface and Reliable Architecture framework (MIRA), which allows STAR to orchestrate the activities of Meta-...
Gespeichert in:
| Veröffentlicht in: | Journal of physics. Conference series 2012-01, Vol.396 (1), p.12002-6 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 6 |
|---|---|
| container_issue | 1 |
| container_start_page | 12002 |
| container_title | Journal of physics. Conference series |
| container_volume | 396 |
| creator | Arkhipkin, D Lauret, J Betts, W Van Buren, G |
| description | The STAR Experiment further exploits scalable message-oriented model principles to achieve a high level of control over online data streams. In this paper we present an AMQP-powered Message Interface and Reliable Architecture framework (MIRA), which allows STAR to orchestrate the activities of Meta-data Collection, Monitoring, Online QA and several Run-Time and Data Acquisition system components in a very efficient manner. The very nature of the reliable message bus suggests parallel usage of multiple independent storage mechanisms for our meta-data. We describe our experience with a robust data-taking setup employing MySQL- and HyperTable-based archivers for meta-data processing. In addition, MIRA has an AJAX-enabled web GUI, which allows real-time visualisation of online process flow and detector subsystem states, and doubles as a sophisticated alarm system when combined with complex event processing engines like Esper, Borealis or Cayuga. The performance data and our planned path forward are based on our experience during the 2011-2012 running of STAR. |
| doi_str_mv | 10.1088/1742-6596/396/1/012002 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1770271130</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2578252809</sourcerecordid><originalsourceid>FETCH-LOGICAL-c364t-c6a5a700e7fb244998f4b6b9078ad6818ac933edd0173e4e2a34837f61d5f8973</originalsourceid><addsrcrecordid>eNqFkE1LAzEQhoMoWKt_QQJevKzNx26SBS-lWFtoKdR6DuluVlO3SU1S1H9vlopILw4MMzDvO8w8AFxjdIeREAPMc5KxomQDmhIPECYIkRPQ-x2c_unPwUUIG4RoCt4Dq4VtjdVwrqPKahUVHLm21VU0zkJlazh31kTnjX2BY6-2-sP5N9g4D-Orhk-r4RI-fO60N1ttI1QRLifT0SU4a1Qb9NVP7YPn8cNqNMlmi8fpaDjLKsrymFVMFYojpHmzJnlelqLJ12xdIi5UzQQWqiop1XWNMKc610TRXFDeMFwXjSg57YPbw96dd-97HaLcmlDptlVWu32QmHNEOMYUJenNkXTj9t6m6yQpuCAFEahMKnZQVd6F4HUjd-kz5b8kRrKDLTuOsuMoE2yJ5QF2Mt4fGSsTVQcxemXa_-zf5b-Cuw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2578252809</pqid></control><display><type>article</type><title>Online Meta-data Collection and Monitoring Framework for the STAR Experiment at RHIC</title><source>Institute of Physics IOPscience extra</source><source>IOP Journals (Institute Of Physics)</source><source>Alma/SFX Local Collection</source><source>Free Full-Text Journals in Chemistry</source><source>EZB Electronic Journals Library</source><creator>Arkhipkin, D ; Lauret, J ; Betts, W ; Van Buren, G</creator><creatorcontrib>Arkhipkin, D ; Lauret, J ; Betts, W ; Van Buren, G</creatorcontrib><description>The STAR Experiment further exploits scalable message-oriented model principles to achieve a high level of control over online data streams. In this paper we present an AMQP-powered Message Interface and Reliable Architecture framework (MIRA), which allows STAR to orchestrate the activities of Meta-data Collection, Monitoring, Online QA and several Run-Time and Data Acquisition system components in a very efficient manner. The very nature of the reliable message bus suggests parallel usage of multiple independent storage mechanisms for our meta-data. We describe our experience with a robust data-taking setup employing MySQL- and HyperTable-based archivers for meta-data processing. In addition, MIRA has an AJAX-enabled web GUI, which allows real-time visualisation of online process flow and detector subsystem states, and doubles as a sophisticated alarm system when combined with complex event processing engines like Esper, Borealis or Cayuga. The performance data and our planned path forward are based on our experience during the 2011-2012 running of STAR.</description><identifier>ISSN: 1742-6596</identifier><identifier>ISSN: 1742-6588</identifier><identifier>EISSN: 1742-6596</identifier><identifier>DOI: 10.1088/1742-6596/396/1/012002</identifier><language>eng</language><publisher>Bristol: IOP Publishing</publisher><subject>Ajax furnaces ; Alarm systems ; Collection ; Data collection ; Data processing ; Data transmission ; Graphical user interface ; Messages ; Monitoring ; Online ; Physics ; Real time ; Run time (computers) ; Running ; Stars ; Subsystems</subject><ispartof>Journal of physics. Conference series, 2012-01, Vol.396 (1), p.12002-6</ispartof><rights>Copyright IOP Publishing Dec 2012</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c364t-c6a5a700e7fb244998f4b6b9078ad6818ac933edd0173e4e2a34837f61d5f8973</citedby><cites>FETCH-LOGICAL-c364t-c6a5a700e7fb244998f4b6b9078ad6818ac933edd0173e4e2a34837f61d5f8973</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,776,780,27901,27902</link.rule.ids></links><search><creatorcontrib>Arkhipkin, D</creatorcontrib><creatorcontrib>Lauret, J</creatorcontrib><creatorcontrib>Betts, W</creatorcontrib><creatorcontrib>Van Buren, G</creatorcontrib><title>Online Meta-data Collection and Monitoring Framework for the STAR Experiment at RHIC</title><title>Journal of physics. Conference series</title><description>The STAR Experiment further exploits scalable message-oriented model principles to achieve a high level of control over online data streams. In this paper we present an AMQP-powered Message Interface and Reliable Architecture framework (MIRA), which allows STAR to orchestrate the activities of Meta-data Collection, Monitoring, Online QA and several Run-Time and Data Acquisition system components in a very efficient manner. The very nature of the reliable message bus suggests parallel usage of multiple independent storage mechanisms for our meta-data. We describe our experience with a robust data-taking setup employing MySQL- and HyperTable-based archivers for meta-data processing. In addition, MIRA has an AJAX-enabled web GUI, which allows real-time visualisation of online process flow and detector subsystem states, and doubles as a sophisticated alarm system when combined with complex event processing engines like Esper, Borealis or Cayuga. The performance data and our planned path forward are based on our experience during the 2011-2012 running of STAR.</description><subject>Ajax furnaces</subject><subject>Alarm systems</subject><subject>Collection</subject><subject>Data collection</subject><subject>Data processing</subject><subject>Data transmission</subject><subject>Graphical user interface</subject><subject>Messages</subject><subject>Monitoring</subject><subject>Online</subject><subject>Physics</subject><subject>Real time</subject><subject>Run time (computers)</subject><subject>Running</subject><subject>Stars</subject><subject>Subsystems</subject><issn>1742-6596</issn><issn>1742-6588</issn><issn>1742-6596</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNqFkE1LAzEQhoMoWKt_QQJevKzNx26SBS-lWFtoKdR6DuluVlO3SU1S1H9vlopILw4MMzDvO8w8AFxjdIeREAPMc5KxomQDmhIPECYIkRPQ-x2c_unPwUUIG4RoCt4Dq4VtjdVwrqPKahUVHLm21VU0zkJlazh31kTnjX2BY6-2-sP5N9g4D-Orhk-r4RI-fO60N1ttI1QRLifT0SU4a1Qb9NVP7YPn8cNqNMlmi8fpaDjLKsrymFVMFYojpHmzJnlelqLJ12xdIi5UzQQWqiop1XWNMKc610TRXFDeMFwXjSg57YPbw96dd-97HaLcmlDptlVWu32QmHNEOMYUJenNkXTj9t6m6yQpuCAFEahMKnZQVd6F4HUjd-kz5b8kRrKDLTuOsuMoE2yJ5QF2Mt4fGSsTVQcxemXa_-zf5b-Cuw</recordid><startdate>20120101</startdate><enddate>20120101</enddate><creator>Arkhipkin, D</creator><creator>Lauret, J</creator><creator>Betts, W</creator><creator>Van Buren, G</creator><general>IOP Publishing</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>H8D</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PHGZM</scope><scope>PHGZT</scope><scope>PIMPY</scope><scope>PKEHL</scope><scope>PQEST</scope><scope>PQGLB</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7U5</scope><scope>8BQ</scope><scope>JG9</scope></search><sort><creationdate>20120101</creationdate><title>Online Meta-data Collection and Monitoring Framework for the STAR Experiment at RHIC</title><author>Arkhipkin, D ; Lauret, J ; Betts, W ; Van Buren, G</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c364t-c6a5a700e7fb244998f4b6b9078ad6818ac933edd0173e4e2a34837f61d5f8973</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Ajax furnaces</topic><topic>Alarm systems</topic><topic>Collection</topic><topic>Data collection</topic><topic>Data processing</topic><topic>Data transmission</topic><topic>Graphical user interface</topic><topic>Messages</topic><topic>Monitoring</topic><topic>Online</topic><topic>Physics</topic><topic>Real time</topic><topic>Run time (computers)</topic><topic>Running</topic><topic>Stars</topic><topic>Subsystems</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Arkhipkin, D</creatorcontrib><creatorcontrib>Lauret, J</creatorcontrib><creatorcontrib>Betts, W</creatorcontrib><creatorcontrib>Van Buren, G</creatorcontrib><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Database (1962 - current)</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Aerospace Database</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>ProQuest advanced technologies & aerospace journals</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central (New)</collection><collection>ProQuest One Academic (New)</collection><collection>Publicly Available Content (ProQuest)</collection><collection>ProQuest One Academic Middle East (New)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Applied & Life Sciences</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Materials Research Database</collection><jtitle>Journal of physics. Conference series</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Arkhipkin, D</au><au>Lauret, J</au><au>Betts, W</au><au>Van Buren, G</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Online Meta-data Collection and Monitoring Framework for the STAR Experiment at RHIC</atitle><jtitle>Journal of physics. Conference series</jtitle><date>2012-01-01</date><risdate>2012</risdate><volume>396</volume><issue>1</issue><spage>12002</spage><epage>6</epage><pages>12002-6</pages><issn>1742-6596</issn><issn>1742-6588</issn><eissn>1742-6596</eissn><abstract>The STAR Experiment further exploits scalable message-oriented model principles to achieve a high level of control over online data streams. In this paper we present an AMQP-powered Message Interface and Reliable Architecture framework (MIRA), which allows STAR to orchestrate the activities of Meta-data Collection, Monitoring, Online QA and several Run-Time and Data Acquisition system components in a very efficient manner. The very nature of the reliable message bus suggests parallel usage of multiple independent storage mechanisms for our meta-data. We describe our experience with a robust data-taking setup employing MySQL- and HyperTable-based archivers for meta-data processing. In addition, MIRA has an AJAX-enabled web GUI, which allows real-time visualisation of online process flow and detector subsystem states, and doubles as a sophisticated alarm system when combined with complex event processing engines like Esper, Borealis or Cayuga. The performance data and our planned path forward are based on our experience during the 2011-2012 running of STAR.</abstract><cop>Bristol</cop><pub>IOP Publishing</pub><doi>10.1088/1742-6596/396/1/012002</doi><tpages>6</tpages><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1742-6596 |
| ispartof | Journal of physics. Conference series, 2012-01, Vol.396 (1), p.12002-6 |
| issn | 1742-6596 1742-6588 1742-6596 |
| language | eng |
| recordid | cdi_proquest_miscellaneous_1770271130 |
| source | Institute of Physics IOPscience extra; IOP Journals (Institute Of Physics); Alma/SFX Local Collection; Free Full-Text Journals in Chemistry; EZB Electronic Journals Library |
| subjects | Ajax furnaces Alarm systems Collection Data collection Data processing Data transmission Graphical user interface Messages Monitoring Online Physics Real time Run time (computers) Running Stars Subsystems |
| title | Online Meta-data Collection and Monitoring Framework for the STAR Experiment at RHIC |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T13%3A20%3A00IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Online%20Meta-data%20Collection%20and%20Monitoring%20Framework%20for%20the%20STAR%20Experiment%20at%20RHIC&rft.jtitle=Journal%20of%20physics.%20Conference%20series&rft.au=Arkhipkin,%20D&rft.date=2012-01-01&rft.volume=396&rft.issue=1&rft.spage=12002&rft.epage=6&rft.pages=12002-6&rft.issn=1742-6596&rft.eissn=1742-6596&rft_id=info:doi/10.1088/1742-6596/396/1/012002&rft_dat=%3Cproquest_cross%3E2578252809%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2578252809&rft_id=info:pmid/&rfr_iscdi=true |