Organizational determinants of evaluation practice in Australian prevention agencies

Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the org...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Health education research 2018-06, Vol.33 (3), p.243-255
Hauptverfasser: Schwarzman, J., Bauman, A., Gabbe, B., Rissel, C., Shilton, T., Smith, B. J.
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 255
container_issue 3
container_start_page 243
container_title Health education research
container_volume 33
creator Schwarzman, J.
Bauman, A.
Gabbe, B.
Rissel, C.
Shilton, T.
Smith, B. J.
description Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the organization as central to evaluation capacity. Australian prevention organizations recognize limitations to current evaluation effectiveness and are seeking guidance to build evaluation capacity. This qualitative study identifies organizational facilitators and barriers to evaluation practice, and explores their interactions in Australian prevention organizations. We conducted semi-structured interviews with 40 experienced practitioners from government and non-government organizations. Using thematic analysis, we identified seven key themes that influence evaluation practice: leadership, organizational culture, organizational systems and structures, partnerships, resources, workforce development and training and recruitment and skills mix. We found organizational determinants of evaluation to have multi-level interactions. Leadership and organizational culture influenced organizational systems, resource allocation and support of staff. Partnerships were important to overcome resource deficits, and systems were critical to embed evaluation within the organization. Organizational factors also influenced the opportunities for staff to develop skills and confidence. We argue that investment to improve these factors would allow organizations to address evaluation capacity at multiple levels, and ultimately facilitate effective evaluation practice.
doi_str_mv 10.1093/her/cyy015
format Article
fullrecord <record><control><sourceid>jstor_proqu</sourceid><recordid>TN_cdi_proquest_miscellaneous_2038263443</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><jstor_id>48509841</jstor_id><oup_id>10.1093/her/cyy015</oup_id><sourcerecordid>48509841</sourcerecordid><originalsourceid>FETCH-LOGICAL-c375t-41c34c93fb34ff03518d4ef1f552c7614e3a71fab8415b83b1715ba6f93662f23</originalsourceid><addsrcrecordid>eNp90M9LwzAUB_AgipvTi3elF0GEuqT50fY4hr9gsMs8lzR7mRltOpN0MP96u3Xu6OnBex--8L4I3RL8THBOx1_gxmq3w4SfoSFhgsdUsOwcDXEispgQTgfoyvs1xkTkJL1EgyRPmRAsH6LF3K2kNT8ymMbKKlpCAFcbK23wUaMj2MqqPRyjjZMqGAWRsdGk9cHJysj9GrZgD0KuwCoD_hpdaFl5uDnOEfp8fVlM3-PZ_O1jOpnFiqY8xIwoylROdUmZ1phyki0ZaKI5T1QqCAMqU6JlmTHCy4yWJO2mFDqnQiQ6oSP02OduXPPdgg9FbbyCqpIWmtYXCaZZIihjtKNPPVWu8d6BLjbO1NLtCoKLfYtF12LRt9jh-2NuW9awPNG_2jrw0IOm3fwfdNe7tQ-NO0mWcZx3T9FfoR6Fuw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2038263443</pqid></control><display><type>article</type><title>Organizational determinants of evaluation practice in Australian prevention agencies</title><source>JSTOR Archive Collection A-Z Listing</source><source>Oxford University Press Journals All Titles (1996-Current)</source><source>Alma/SFX Local Collection</source><creator>Schwarzman, J. ; Bauman, A. ; Gabbe, B. ; Rissel, C. ; Shilton, T. ; Smith, B. J.</creator><creatorcontrib>Schwarzman, J. ; Bauman, A. ; Gabbe, B. ; Rissel, C. ; Shilton, T. ; Smith, B. J.</creatorcontrib><description>Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the organization as central to evaluation capacity. Australian prevention organizations recognize limitations to current evaluation effectiveness and are seeking guidance to build evaluation capacity. This qualitative study identifies organizational facilitators and barriers to evaluation practice, and explores their interactions in Australian prevention organizations. We conducted semi-structured interviews with 40 experienced practitioners from government and non-government organizations. Using thematic analysis, we identified seven key themes that influence evaluation practice: leadership, organizational culture, organizational systems and structures, partnerships, resources, workforce development and training and recruitment and skills mix. We found organizational determinants of evaluation to have multi-level interactions. Leadership and organizational culture influenced organizational systems, resource allocation and support of staff. Partnerships were important to overcome resource deficits, and systems were critical to embed evaluation within the organization. Organizational factors also influenced the opportunities for staff to develop skills and confidence. We argue that investment to improve these factors would allow organizations to address evaluation capacity at multiple levels, and ultimately facilitate effective evaluation practice.</description><identifier>ISSN: 0268-1153</identifier><identifier>EISSN: 1465-3648</identifier><identifier>DOI: 10.1093/her/cyy015</identifier><identifier>PMID: 29746649</identifier><language>eng</language><publisher>England: Oxford University Press</publisher><subject>Health technology assessment ; ORIGINAL ARTICLES</subject><ispartof>Health education research, 2018-06, Vol.33 (3), p.243-255</ispartof><rights>The Author(s) 2018</rights><rights>The Author(s) 2018. Published by Oxford University Press. All rights reserved. For permissions, please email: journals.permissions@oup.com 2018</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c375t-41c34c93fb34ff03518d4ef1f552c7614e3a71fab8415b83b1715ba6f93662f23</citedby><cites>FETCH-LOGICAL-c375t-41c34c93fb34ff03518d4ef1f552c7614e3a71fab8415b83b1715ba6f93662f23</cites><orcidid>0000-0003-1209-2523</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.jstor.org/stable/pdf/48509841$$EPDF$$P50$$Gjstor$$H</linktopdf><linktohtml>$$Uhttps://www.jstor.org/stable/48509841$$EHTML$$P50$$Gjstor$$H</linktohtml><link.rule.ids>314,780,784,803,1583,27922,27923,58015,58248</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/29746649$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Schwarzman, J.</creatorcontrib><creatorcontrib>Bauman, A.</creatorcontrib><creatorcontrib>Gabbe, B.</creatorcontrib><creatorcontrib>Rissel, C.</creatorcontrib><creatorcontrib>Shilton, T.</creatorcontrib><creatorcontrib>Smith, B. J.</creatorcontrib><title>Organizational determinants of evaluation practice in Australian prevention agencies</title><title>Health education research</title><addtitle>Health Educ Res</addtitle><description>Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the organization as central to evaluation capacity. Australian prevention organizations recognize limitations to current evaluation effectiveness and are seeking guidance to build evaluation capacity. This qualitative study identifies organizational facilitators and barriers to evaluation practice, and explores their interactions in Australian prevention organizations. We conducted semi-structured interviews with 40 experienced practitioners from government and non-government organizations. Using thematic analysis, we identified seven key themes that influence evaluation practice: leadership, organizational culture, organizational systems and structures, partnerships, resources, workforce development and training and recruitment and skills mix. We found organizational determinants of evaluation to have multi-level interactions. Leadership and organizational culture influenced organizational systems, resource allocation and support of staff. Partnerships were important to overcome resource deficits, and systems were critical to embed evaluation within the organization. Organizational factors also influenced the opportunities for staff to develop skills and confidence. We argue that investment to improve these factors would allow organizations to address evaluation capacity at multiple levels, and ultimately facilitate effective evaluation practice.</description><subject>Health technology assessment</subject><subject>ORIGINAL ARTICLES</subject><issn>0268-1153</issn><issn>1465-3648</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><recordid>eNp90M9LwzAUB_AgipvTi3elF0GEuqT50fY4hr9gsMs8lzR7mRltOpN0MP96u3Xu6OnBex--8L4I3RL8THBOx1_gxmq3w4SfoSFhgsdUsOwcDXEispgQTgfoyvs1xkTkJL1EgyRPmRAsH6LF3K2kNT8ymMbKKlpCAFcbK23wUaMj2MqqPRyjjZMqGAWRsdGk9cHJysj9GrZgD0KuwCoD_hpdaFl5uDnOEfp8fVlM3-PZ_O1jOpnFiqY8xIwoylROdUmZ1phyki0ZaKI5T1QqCAMqU6JlmTHCy4yWJO2mFDqnQiQ6oSP02OduXPPdgg9FbbyCqpIWmtYXCaZZIihjtKNPPVWu8d6BLjbO1NLtCoKLfYtF12LRt9jh-2NuW9awPNG_2jrw0IOm3fwfdNe7tQ-NO0mWcZx3T9FfoR6Fuw</recordid><startdate>20180601</startdate><enddate>20180601</enddate><creator>Schwarzman, J.</creator><creator>Bauman, A.</creator><creator>Gabbe, B.</creator><creator>Rissel, C.</creator><creator>Shilton, T.</creator><creator>Smith, B. J.</creator><general>Oxford University Press</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><orcidid>https://orcid.org/0000-0003-1209-2523</orcidid></search><sort><creationdate>20180601</creationdate><title>Organizational determinants of evaluation practice in Australian prevention agencies</title><author>Schwarzman, J. ; Bauman, A. ; Gabbe, B. ; Rissel, C. ; Shilton, T. ; Smith, B. J.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c375t-41c34c93fb34ff03518d4ef1f552c7614e3a71fab8415b83b1715ba6f93662f23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Health technology assessment</topic><topic>ORIGINAL ARTICLES</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Schwarzman, J.</creatorcontrib><creatorcontrib>Bauman, A.</creatorcontrib><creatorcontrib>Gabbe, B.</creatorcontrib><creatorcontrib>Rissel, C.</creatorcontrib><creatorcontrib>Shilton, T.</creatorcontrib><creatorcontrib>Smith, B. J.</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Health education research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Schwarzman, J.</au><au>Bauman, A.</au><au>Gabbe, B.</au><au>Rissel, C.</au><au>Shilton, T.</au><au>Smith, B. J.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Organizational determinants of evaluation practice in Australian prevention agencies</atitle><jtitle>Health education research</jtitle><addtitle>Health Educ Res</addtitle><date>2018-06-01</date><risdate>2018</risdate><volume>33</volume><issue>3</issue><spage>243</spage><epage>255</epage><pages>243-255</pages><issn>0268-1153</issn><eissn>1465-3648</eissn><abstract>Program evaluation is essential to inform decision making, contribute to the evidence base for strategies, and facilitate learning in health promotion and disease prevention organizations. Theoretical frameworks of organizational learning, and studies of evaluation capacity building describe the organization as central to evaluation capacity. Australian prevention organizations recognize limitations to current evaluation effectiveness and are seeking guidance to build evaluation capacity. This qualitative study identifies organizational facilitators and barriers to evaluation practice, and explores their interactions in Australian prevention organizations. We conducted semi-structured interviews with 40 experienced practitioners from government and non-government organizations. Using thematic analysis, we identified seven key themes that influence evaluation practice: leadership, organizational culture, organizational systems and structures, partnerships, resources, workforce development and training and recruitment and skills mix. We found organizational determinants of evaluation to have multi-level interactions. Leadership and organizational culture influenced organizational systems, resource allocation and support of staff. Partnerships were important to overcome resource deficits, and systems were critical to embed evaluation within the organization. Organizational factors also influenced the opportunities for staff to develop skills and confidence. We argue that investment to improve these factors would allow organizations to address evaluation capacity at multiple levels, and ultimately facilitate effective evaluation practice.</abstract><cop>England</cop><pub>Oxford University Press</pub><pmid>29746649</pmid><doi>10.1093/her/cyy015</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0003-1209-2523</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 0268-1153
ispartof Health education research, 2018-06, Vol.33 (3), p.243-255
issn 0268-1153
1465-3648
language eng
recordid cdi_proquest_miscellaneous_2038263443
source JSTOR Archive Collection A-Z Listing; Oxford University Press Journals All Titles (1996-Current); Alma/SFX Local Collection
subjects Health technology assessment
ORIGINAL ARTICLES
title Organizational determinants of evaluation practice in Australian prevention agencies
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-14T11%3A40%3A31IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-jstor_proqu&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Organizational%20determinants%20of%20evaluation%20practice%20in%20Australian%20prevention%20agencies&rft.jtitle=Health%20education%20research&rft.au=Schwarzman,%20J.&rft.date=2018-06-01&rft.volume=33&rft.issue=3&rft.spage=243&rft.epage=255&rft.pages=243-255&rft.issn=0268-1153&rft.eissn=1465-3648&rft_id=info:doi/10.1093/her/cyy015&rft_dat=%3Cjstor_proqu%3E48509841%3C/jstor_proqu%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2038263443&rft_id=info:pmid/29746649&rft_jstor_id=48509841&rft_oup_id=10.1093/her/cyy015&rfr_iscdi=true