A PROOF Analysis Framework
The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a...
Gespeichert in:
Veröffentlicht in: | Journal of physics. Conference series 2012-01, Vol.396 (2), p.22017-9, Article 022017 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 9 |
---|---|
container_issue | 2 |
container_start_page | 22017 |
container_title | Journal of physics. Conference series |
container_volume | 396 |
creator | González Caballero, I Rodríguez Marrero, A Fernández del Castillo, E Cuesta Noriega, A |
description | The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework. |
doi_str_mv | 10.1088/1742-6596/396/2/022017 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1770270934</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2578248577</sourcerecordid><originalsourceid>FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</originalsourceid><addsrcrecordid>eNqFkF1LwzAUhoMoOKd_wAsZeONN3cl3A96UYVUYTESvQ9qk0Nm1M-mQ_fulVER2YyDkQJ738PIgdIPhHkOazrFkJBFciTmNl8yBEMDyBE1-P07_zOfoIoQ1AI1HTtB1Nnt9W63yWdaaZh_qMMu92bjvzn9eorPKNMFd_bxT9JE_vi-ek-Xq6WWRLZOSAfSJoJYJp5xSCnjJMTDKC0wUdmALK1klFC1iTyhSyaGoLDZWUFelUBlrQNEpuhv3bn33tXOh15s6lK5pTOu6XdBYSiAygiyit0foutv52DxowmVKWMqljJQYqdJ3IXhX6a2vN8bvNQY9KNODDT3Y0FGZJnpUFoMPR8Gy7k1fd23vTd38Fz8AJdht0g</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2578248577</pqid></control><display><type>article</type><title>A PROOF Analysis Framework</title><source>Institute of Physics IOPscience extra</source><source>Full-Text Journals in Chemistry (Open access)</source><source>IOP Publishing</source><source>Alma/SFX Local Collection</source><source>EZB Electronic Journals Library</source><creator>González Caballero, I ; Rodríguez Marrero, A ; Fernández del Castillo, E ; Cuesta Noriega, A</creator><creatorcontrib>González Caballero, I ; Rodríguez Marrero, A ; Fernández del Castillo, E ; Cuesta Noriega, A</creatorcontrib><description>The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.</description><identifier>ISSN: 1742-6596</identifier><identifier>ISSN: 1742-6588</identifier><identifier>EISSN: 1742-6596</identifier><identifier>DOI: 10.1088/1742-6596/396/2/022017</identifier><language>eng</language><publisher>Bristol: IOP Publishing</publisher><subject>Central processing units ; Clusters ; Computer programs ; Construction equipment ; Demand analysis ; Loads (forces) ; Physicists ; Physics ; Proving</subject><ispartof>Journal of physics. Conference series, 2012-01, Vol.396 (2), p.22017-9, Article 022017</ispartof><rights>Copyright IOP Publishing Dec 2012</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</citedby><cites>FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,780,784,27923,27924</link.rule.ids></links><search><creatorcontrib>González Caballero, I</creatorcontrib><creatorcontrib>Rodríguez Marrero, A</creatorcontrib><creatorcontrib>Fernández del Castillo, E</creatorcontrib><creatorcontrib>Cuesta Noriega, A</creatorcontrib><title>A PROOF Analysis Framework</title><title>Journal of physics. Conference series</title><description>The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.</description><subject>Central processing units</subject><subject>Clusters</subject><subject>Computer programs</subject><subject>Construction equipment</subject><subject>Demand analysis</subject><subject>Loads (forces)</subject><subject>Physicists</subject><subject>Physics</subject><subject>Proving</subject><issn>1742-6596</issn><issn>1742-6588</issn><issn>1742-6596</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2012</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNqFkF1LwzAUhoMoOKd_wAsZeONN3cl3A96UYVUYTESvQ9qk0Nm1M-mQ_fulVER2YyDkQJ738PIgdIPhHkOazrFkJBFciTmNl8yBEMDyBE1-P07_zOfoIoQ1AI1HTtB1Nnt9W63yWdaaZh_qMMu92bjvzn9eorPKNMFd_bxT9JE_vi-ek-Xq6WWRLZOSAfSJoJYJp5xSCnjJMTDKC0wUdmALK1klFC1iTyhSyaGoLDZWUFelUBlrQNEpuhv3bn33tXOh15s6lK5pTOu6XdBYSiAygiyit0foutv52DxowmVKWMqljJQYqdJ3IXhX6a2vN8bvNQY9KNODDT3Y0FGZJnpUFoMPR8Gy7k1fd23vTd38Fz8AJdht0g</recordid><startdate>20120101</startdate><enddate>20120101</enddate><creator>González Caballero, I</creator><creator>Rodríguez Marrero, A</creator><creator>Fernández del Castillo, E</creator><creator>Cuesta Noriega, A</creator><general>IOP Publishing</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>H8D</scope><scope>HCIFZ</scope><scope>L7M</scope><scope>P5Z</scope><scope>P62</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7U5</scope><scope>8BQ</scope><scope>JG9</scope></search><sort><creationdate>20120101</creationdate><title>A PROOF Analysis Framework</title><author>González Caballero, I ; Rodríguez Marrero, A ; Fernández del Castillo, E ; Cuesta Noriega, A</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c400t-63d46e9e99905c510435b1291e0dbd74f693b0880b8750bfd1ad63ef80fada093</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2012</creationdate><topic>Central processing units</topic><topic>Clusters</topic><topic>Computer programs</topic><topic>Construction equipment</topic><topic>Demand analysis</topic><topic>Loads (forces)</topic><topic>Physicists</topic><topic>Physics</topic><topic>Proving</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>González Caballero, I</creatorcontrib><creatorcontrib>Rodríguez Marrero, A</creatorcontrib><creatorcontrib>Fernández del Castillo, E</creatorcontrib><creatorcontrib>Cuesta Noriega, A</creatorcontrib><collection>CrossRef</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni)</collection><collection>ProQuest Central</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central</collection><collection>Aerospace Database</collection><collection>SciTech Premium Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Solid State and Superconductivity Abstracts</collection><collection>METADEX</collection><collection>Materials Research Database</collection><jtitle>Journal of physics. Conference series</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>González Caballero, I</au><au>Rodríguez Marrero, A</au><au>Fernández del Castillo, E</au><au>Cuesta Noriega, A</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A PROOF Analysis Framework</atitle><jtitle>Journal of physics. Conference series</jtitle><date>2012-01-01</date><risdate>2012</risdate><volume>396</volume><issue>2</issue><spage>22017</spage><epage>9</epage><pages>22017-9</pages><artnum>022017</artnum><issn>1742-6596</issn><issn>1742-6588</issn><eissn>1742-6596</eissn><abstract>The analysis of the complex LHC data usually follows a standard path that aims at minimizing not only the amount of data but also the number of observables used. After a number of steps of slimming and skimming the data, the remaining few terabytes of ROOT files hold a selection of the events and a flat structure for the variables needed that can be more easily inspected and traversed in the final stages of the analysis. PROOF arises at this point as an efficient mechanism to distribute the analysis load by taking advantage of all the cores in modern CPUs through PROOF Lite, or by using PROOF Cluster or PROOF on Demand tools to build dynamic PROOF cluster on computing facilities with spare CPUs. However using PROOF at the level required for a serious analysis introduces some difficulties that may scare new adopters. We have developed the PROOF Analysis Framework (PAF) to facilitate the development of new analysis by uniformly exposing the PROOF related configurations across technologies and by taking care of the routine tasks as much as possible. We describe the details of the PAF implementation as well as how we succeeded in engaging a group of CMS physicists to use PAF as their daily analysis framework.</abstract><cop>Bristol</cop><pub>IOP Publishing</pub><doi>10.1088/1742-6596/396/2/022017</doi><tpages>9</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1742-6596 |
ispartof | Journal of physics. Conference series, 2012-01, Vol.396 (2), p.22017-9, Article 022017 |
issn | 1742-6596 1742-6588 1742-6596 |
language | eng |
recordid | cdi_proquest_miscellaneous_1770270934 |
source | Institute of Physics IOPscience extra; Full-Text Journals in Chemistry (Open access); IOP Publishing; Alma/SFX Local Collection; EZB Electronic Journals Library |
subjects | Central processing units Clusters Computer programs Construction equipment Demand analysis Loads (forces) Physicists Physics Proving |
title | A PROOF Analysis Framework |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T17%3A00%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20PROOF%20Analysis%20Framework&rft.jtitle=Journal%20of%20physics.%20Conference%20series&rft.au=Gonz%C3%A1lez%20Caballero,%20I&rft.date=2012-01-01&rft.volume=396&rft.issue=2&rft.spage=22017&rft.epage=9&rft.pages=22017-9&rft.artnum=022017&rft.issn=1742-6596&rft.eissn=1742-6596&rft_id=info:doi/10.1088/1742-6596/396/2/022017&rft_dat=%3Cproquest_cross%3E2578248577%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2578248577&rft_id=info:pmid/&rfr_iscdi=true |