A PROOF Analysis Framework

The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of physics. Conference series 2012-01, Vol.396 (2), p.22017-9, Article 022017
Hauptverfasser: González Caballero, I, Rodríguez Marrero, A, Fernández del Castillo, E, Cuesta Noriega, A
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 9
container_issue 2
container_start_page 22017
container_title Journal of physics. Conference series
container_volume 396
creator González Caballero, I
Rodríguez Marrero, A
Fernández del Castillo, E
Cuesta Noriega, A
description The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.
doi_str_mv 10.1088/1742-6596/396/2/022017
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1770270934</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2578248577</sourcerecordid><originalsourceid>FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</originalsourceid><addsrcrecordid>eNqFkF1LwzAUhoMoOKd_wAsZeONN3cl3A96UYVUYTESvQ9qk0Nm1M-mQ_fulVER2YyDkQJ738PIgdIPhHkOazrFkJBFciTmNl8yBEMDyBE1-P07_zOfoIoQ1AI1HTtB1Nnt9W63yWdaaZh_qMMu92bjvzn9eorPKNMFd_bxT9JE_vi-ek-Xq6WWRLZOSAfSJoJYJp5xSCnjJMTDKC0wUdmALK1klFC1iTyhSyaGoLDZWUFelUBlrQNEpuhv3bn33tXOh15s6lK5pTOu6XdBYSiAygiyit0foutv52DxowmVKWMqljJQYqdJ3IXhX6a2vN8bvNQY9KNODDT3Y0FGZJnpUFoMPR8Gy7k1fd23vTd38Fz8AJdht0g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2578248577</pqid></control><display><type>article</type><title>A PROOF Analysis Framework</title><source>Institute of Physics IOPscience extra</source><source>Full-Text Journals in Chemistry (Open access)</source><source>IOP Publishing</source><source>Alma/SFX Local Collection</source><source>EZB Electronic Journals Library</source><creator>González Caballero, I ; Rodríguez Marrero, A ; Fernández del Castillo, E ; Cuesta Noriega, A</creator><creatorcontrib>González Caballero, I ; Rodríguez Marrero, A ; Fernández del Castillo, E ; Cuesta Noriega, A</creatorcontrib><description>The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.</description><identifier>ISSN: 1742-6596</identifier><identifier>ISSN: 1742-6588</identifier><identifier>EISSN: 1742-6596</identifier><identifier>DOI: 10.1088/1742-6596/396/2/022017</identifier><language>eng</language><publisher>Bristol: IOP Publishing</publisher><subject>Central processing units ; Clusters ; Computer programs ; Construction equipment ; Demand analysis ; Loads (forces) ; Physicists ; Physics ; Proving</subject><ispartof>Journal of physics. Conference series, 2012-01, Vol.396 (2), p.22017-9, Article 022017</ispartof><rights>Copyright IOP Publishing Dec 2012</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</citedby><cites>FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924</link.rule.ids></links><search><creatorcontrib>González Caballero, I</creatorcontrib><creatorcontrib>Rodríguez Marrero, A</creatorcontrib><creatorcontrib>Fernández del Castillo, E</creatorcontrib><creatorcontrib>Cuesta Noriega, A</creatorcontrib><title>A PROOF Analysis Framework</title><title>Journal of physics. Conference series</title><description>The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.</description><subject>Central processing units</subject><subject>Clusters</subject><subject>Computer programs</subject><subject>Construction equipment</subject><subject>Demand analysis</subject><subject>Loads (forces)</subject><subject>Physicists</subject><subject>Physics</subject><subject>Proving</subject><issn>1742-6596</issn><issn>1742-6588</issn><issn>1742-6596</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNqFkF1LwzAUhoMoOKd_wAsZeONN3cl3A96UYVUYTESvQ9qk0Nm1M-mQ_fulVER2YyDkQJ738PIgdIPhHkOazrFkJBFciTmNl8yBEMDyBE1-P07_zOfoIoQ1AI1HTtB1Nnt9W63yWdaaZh_qMMu92bjvzn9eorPKNMFd_bxT9JE_vi-ek-Xq6WWRLZOSAfSJoJYJp5xSCnjJMTDKC0wUdmALK1klFC1iTyhSyaGoLDZWUFelUBlrQNEpuhv3bn33tXOh15s6lK5pTOu6XdBYSiAygiyit0foutv52DxowmVKWMqljJQYqdJ3IXhX6a2vN8bvNQY9KNODDT3Y0FGZJnpUFoMPR8Gy7k1fd23vTd38Fz8AJdht0g</recordid><startdate>20120101</startdate><enddate>20120101</enddate><creator>González Caballero, I</creator><creator>Rodríguez Marrero, A</creator><creator>Fernández del Castillo, E</creator><creator>Cuesta Noriega, A</creator><general>IOP Publishing</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>H8D</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7U5</scope><scope>8BQ</scope><scope>JG9</scope></search><sort><creationdate>20120101</creationdate><title>A PROOF Analysis Framework</title><author>González Caballero, I ; Rodríguez Marrero, A ; Fernández del Castillo, E ; Cuesta Noriega, A</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Central processing units</topic><topic>Clusters</topic><topic>Computer programs</topic><topic>Construction equipment</topic><topic>Demand analysis</topic><topic>Loads (forces)</topic><topic>Physicists</topic><topic>Physics</topic><topic>Proving</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>González Caballero, I</creatorcontrib><creatorcontrib>Rodríguez Marrero, A</creatorcontrib><creatorcontrib>Fernández del Castillo, E</creatorcontrib><creatorcontrib>Cuesta Noriega, A</creatorcontrib><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Aerospace Database</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Materials Research Database</collection><jtitle>Journal of physics. Conference series</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>González Caballero, I</au><au>Rodríguez Marrero, A</au><au>Fernández del Castillo, E</au><au>Cuesta Noriega, A</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A PROOF Analysis Framework</atitle><jtitle>Journal of physics. Conference series</jtitle><date>2012-01-01</date><risdate>2012</risdate><volume>396</volume><issue>2</issue><spage>22017</spage><epage>9</epage><pages>22017-9</pages><artnum>022017</artnum><issn>1742-6596</issn><issn>1742-6588</issn><eissn>1742-6596</eissn><abstract>The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.</abstract><cop>Bristol</cop><pub>IOP Publishing</pub><doi>10.1088/1742-6596/396/2/022017</doi><tpages>9</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1742-6596
ispartof Journal of physics. Conference series, 2012-01, Vol.396 (2), p.22017-9, Article 022017
issn 1742-6596
1742-6588
1742-6596
language eng
recordid cdi_proquest_miscellaneous_1770270934
source Institute of Physics IOPscience extra; Full-Text Journals in Chemistry (Open access); IOP Publishing; Alma/SFX Local Collection; EZB Electronic Journals Library
subjects Central processing units
Clusters
Computer programs
Construction equipment
Demand analysis
Loads (forces)
Physicists
Physics
Proving
title A PROOF Analysis Framework
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T17%3A00%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20PROOF%20Analysis%20Framework&rft.jtitle=Journal%20of%20physics.%20Conference%20series&rft.au=Gonz%C3%A1lez%20Caballero,%20I&rft.date=2012-01-01&rft.volume=396&rft.issue=2&rft.spage=22017&rft.epage=9&rft.pages=22017-9&rft.artnum=022017&rft.issn=1742-6596&rft.eissn=1742-6596&rft_id=info:doi/10.1088/1742-6596/396/2/022017&rft_dat=%3Cproquest_cross%3E2578248577%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2578248577&rft_id=info:pmid/&rfr_iscdi=true