Efficacy vs Effectiveness Trial Results of an Indicated "Model" Substance Abuse Program: Implications for Public Health
The US Department of Education requires schools to choose substance abuse and violence prevention programs that meet standards of effectiveness. The Substance Abuse and Mental Health Services Agency certifies "model" programs that meet this standard. We compared findings from a large, mult...
Gespeichert in:
Veröffentlicht in: | American journal of public health (1971) 2006-12, Vol.96 (12), p.2254-2259 |
---|---|
Hauptverfasser: | , , , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 2259 |
---|---|
container_issue | 12 |
container_start_page | 2254 |
container_title | American journal of public health (1971) |
container_volume | 96 |
creator | Hallfors, Denise Cho, Hyunsan Sanchez, Victoria Khatapoush, Shereen Kim, Hyung Min Bauer, Daniel |
description | The US Department of Education requires schools to choose substance abuse and violence prevention programs that meet standards of effectiveness. The Substance Abuse and Mental Health Services Agency certifies "model" programs that meet this standard. We compared findings from a large, multisite effectiveness trial of 1 model program to its efficacy trial findings, upon which the certification was based.
1370 high-risk youths were randomized to experimental or control groups across 9 high schools in 2 large urban school districts. We used intent-to-treat and on-treatment approaches to examine baseline equivalence, attrition, and group differences in outcomes at the end of the program and at a 6-month follow-up.
Positive efficacy trial findings were not replicated in the effectiveness trial. All main effects were either null or worse for the experimental than for the control group.
These findings suggest that small efficacy trials conducted by developers provide insufficient evidence of effectiveness. Federal agencies and public health scientists must work together to raise the standards of evidence and ensure that data from new trials are incorporated into ongoing assessments of program effects. |
doi_str_mv | 10.2105/AJPH.2005.067462 |
format | Article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_1698156</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1178242101</sourcerecordid><originalsourceid>FETCH-LOGICAL-c515t-f17a0dcd99c1f8f0a81369b629ce183d824f740badb09ad605c9768b62ce331b3</originalsourceid><addsrcrecordid>eNpdksGPEyEUh4nRuHX17smQJhovrTxmoMMeTJrNamvW2Oh6JgwDHRpmqDDTzf730rRx1RMv8PHLe3wg9BrInAJhH5ZfNqs5JYTNCV-UnD5BE2AlzAgpq6doQogguS74BXqR0o4QAMHgOboAXhHBBEzQ_Y21Tiv9gA8J59rowR1Mb1LCd9Epj7-bNPoh4WCx6vG6bzI9mAZPv4bG-Cn-MdZpUL02eFmPyeBNDNuouiu87vb-yLrQJ2xDxJuxzht4ZZQf2pfomVU-mVfn9RL9_HRzd72a3X77vL5e3s40AzbMLCwUaXQjhAZbWaIqKLioORXaQFU0FS3toiS1amoiVMMJ02LBqwxoUxRQF5fo4yl3P9adabTph6i83EfXqfggg3Ly35PetXIbDhK4qIDxHPDuHBDDr9GkQXYuaeO96k0Yk8wvSoGKMoPT_8BdGGOfh5MUGMmdVkWGyAnSMaQUjf3TCRB5VCqPSuVRqTwpzVfe_D3B44Wzwwy8PQMqaeVtzDZceuSqgvL8ITL3_sS1btveu2hk6pT3ORak2u1bwSVQSSkri9-asLfc</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>215082483</pqid></control><display><type>article</type><title>Efficacy vs Effectiveness Trial Results of an Indicated "Model" Substance Abuse Program: Implications for Public Health</title><source>MEDLINE</source><source>PAIS Index</source><source>Business Source Complete</source><source>PubMed Central</source><source>Alma/SFX Local Collection</source><creator>Hallfors, Denise ; Cho, Hyunsan ; Sanchez, Victoria ; Khatapoush, Shereen ; Kim, Hyung Min ; Bauer, Daniel</creator><creatorcontrib>Hallfors, Denise ; Cho, Hyunsan ; Sanchez, Victoria ; Khatapoush, Shereen ; Kim, Hyung Min ; Bauer, Daniel</creatorcontrib><description>The US Department of Education requires schools to choose substance abuse and violence prevention programs that meet standards of effectiveness. The Substance Abuse and Mental Health Services Agency certifies "model" programs that meet this standard. We compared findings from a large, multisite effectiveness trial of 1 model program to its efficacy trial findings, upon which the certification was based.
1370 high-risk youths were randomized to experimental or control groups across 9 high schools in 2 large urban school districts. We used intent-to-treat and on-treatment approaches to examine baseline equivalence, attrition, and group differences in outcomes at the end of the program and at a 6-month follow-up.
Positive efficacy trial findings were not replicated in the effectiveness trial. All main effects were either null or worse for the experimental than for the control group.
These findings suggest that small efficacy trials conducted by developers provide insufficient evidence of effectiveness. Federal agencies and public health scientists must work together to raise the standards of evidence and ensure that data from new trials are incorporated into ongoing assessments of program effects.</description><identifier>ISSN: 0090-0036</identifier><identifier>EISSN: 1541-0048</identifier><identifier>DOI: 10.2105/AJPH.2005.067462</identifier><identifier>PMID: 16809591</identifier><identifier>CODEN: AJPEAG</identifier><language>eng</language><publisher>Washington, DC: Am Public Health Assoc</publisher><subject>Academic achievement ; Adolescent ; Behavior ; Bias ; Biological and medical sciences ; Certification ; Children & youth ; Drug abuse ; Drug use ; Education policy ; Effectiveness ; Federal government ; Female ; Health promotion ; Health services ; Humans ; Intervention ; Juvenile delinquency ; Learning ; Male ; Medical sciences ; Medical treatment ; Mental health ; Mental health care ; Miscellaneous ; Models, Organizational ; Outcome Assessment (Health Care) ; Peer Group ; Prevention programs ; Program Evaluation ; Public health ; Public Health Administration ; Public health. Hygiene ; Public health. Hygiene-occupational medicine ; Research and Practice ; Risk factors ; Sample size ; School districts ; School Health Services - organization & administration ; School Health Services - standards ; Secondary schools ; Student Dropouts - psychology ; Students ; Studies ; Substance abuse treatment ; Substance-Related Disorders - ethnology ; Substance-Related Disorders - prevention & control ; United States ; United States Substance Abuse and Mental Health Services Administration ; Urban Health Services - organization & administration ; Urban Health Services - standards</subject><ispartof>American journal of public health (1971), 2006-12, Vol.96 (12), p.2254-2259</ispartof><rights>2007 INIST-CNRS</rights><rights>Copyright American Public Health Association Dec 2006</rights><rights>American Journal of Public Health 2006 2006</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c515t-f17a0dcd99c1f8f0a81369b629ce183d824f740badb09ad605c9768b62ce331b3</citedby><cites>FETCH-LOGICAL-c515t-f17a0dcd99c1f8f0a81369b629ce183d824f740badb09ad605c9768b62ce331b3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC1698156/pdf/$$EPDF$$P50$$Gpubmedcentral$$H</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC1698156/$$EHTML$$P50$$Gpubmedcentral$$H</linktohtml><link.rule.ids>230,314,723,776,780,881,27843,27901,27902,53766,53768</link.rule.ids><backlink>$$Uhttp://pascal-francis.inist.fr/vibad/index.php?action=getRecordDetail&idt=18326004$$DView record in Pascal Francis$$Hfree_for_read</backlink><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/16809591$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Hallfors, Denise</creatorcontrib><creatorcontrib>Cho, Hyunsan</creatorcontrib><creatorcontrib>Sanchez, Victoria</creatorcontrib><creatorcontrib>Khatapoush, Shereen</creatorcontrib><creatorcontrib>Kim, Hyung Min</creatorcontrib><creatorcontrib>Bauer, Daniel</creatorcontrib><title>Efficacy vs Effectiveness Trial Results of an Indicated "Model" Substance Abuse Program: Implications for Public Health</title><title>American journal of public health (1971)</title><addtitle>Am J Public Health</addtitle><description>The US Department of Education requires schools to choose substance abuse and violence prevention programs that meet standards of effectiveness. The Substance Abuse and Mental Health Services Agency certifies "model" programs that meet this standard. We compared findings from a large, multisite effectiveness trial of 1 model program to its efficacy trial findings, upon which the certification was based.
1370 high-risk youths were randomized to experimental or control groups across 9 high schools in 2 large urban school districts. We used intent-to-treat and on-treatment approaches to examine baseline equivalence, attrition, and group differences in outcomes at the end of the program and at a 6-month follow-up.
Positive efficacy trial findings were not replicated in the effectiveness trial. All main effects were either null or worse for the experimental than for the control group.
These findings suggest that small efficacy trials conducted by developers provide insufficient evidence of effectiveness. Federal agencies and public health scientists must work together to raise the standards of evidence and ensure that data from new trials are incorporated into ongoing assessments of program effects.</description><subject>Academic achievement</subject><subject>Adolescent</subject><subject>Behavior</subject><subject>Bias</subject><subject>Biological and medical sciences</subject><subject>Certification</subject><subject>Children & youth</subject><subject>Drug abuse</subject><subject>Drug use</subject><subject>Education policy</subject><subject>Effectiveness</subject><subject>Federal government</subject><subject>Female</subject><subject>Health promotion</subject><subject>Health services</subject><subject>Humans</subject><subject>Intervention</subject><subject>Juvenile delinquency</subject><subject>Learning</subject><subject>Male</subject><subject>Medical sciences</subject><subject>Medical treatment</subject><subject>Mental health</subject><subject>Mental health care</subject><subject>Miscellaneous</subject><subject>Models, Organizational</subject><subject>Outcome Assessment (Health Care)</subject><subject>Peer Group</subject><subject>Prevention programs</subject><subject>Program Evaluation</subject><subject>Public health</subject><subject>Public Health Administration</subject><subject>Public health. Hygiene</subject><subject>Public health. Hygiene-occupational medicine</subject><subject>Research and Practice</subject><subject>Risk factors</subject><subject>Sample size</subject><subject>School districts</subject><subject>School Health Services - organization & administration</subject><subject>School Health Services - standards</subject><subject>Secondary schools</subject><subject>Student Dropouts - psychology</subject><subject>Students</subject><subject>Studies</subject><subject>Substance abuse treatment</subject><subject>Substance-Related Disorders - ethnology</subject><subject>Substance-Related Disorders - prevention & control</subject><subject>United States</subject><subject>United States Substance Abuse and Mental Health Services Administration</subject><subject>Urban Health Services - organization & administration</subject><subject>Urban Health Services - standards</subject><issn>0090-0036</issn><issn>1541-0048</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2006</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>7TQ</sourceid><sourceid>8G5</sourceid><sourceid>BEC</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNpdksGPEyEUh4nRuHX17smQJhovrTxmoMMeTJrNamvW2Oh6JgwDHRpmqDDTzf730rRx1RMv8PHLe3wg9BrInAJhH5ZfNqs5JYTNCV-UnD5BE2AlzAgpq6doQogguS74BXqR0o4QAMHgOboAXhHBBEzQ_Y21Tiv9gA8J59rowR1Mb1LCd9Epj7-bNPoh4WCx6vG6bzI9mAZPv4bG-Cn-MdZpUL02eFmPyeBNDNuouiu87vb-yLrQJ2xDxJuxzht4ZZQf2pfomVU-mVfn9RL9_HRzd72a3X77vL5e3s40AzbMLCwUaXQjhAZbWaIqKLioORXaQFU0FS3toiS1amoiVMMJ02LBqwxoUxRQF5fo4yl3P9adabTph6i83EfXqfggg3Ly35PetXIbDhK4qIDxHPDuHBDDr9GkQXYuaeO96k0Yk8wvSoGKMoPT_8BdGGOfh5MUGMmdVkWGyAnSMaQUjf3TCRB5VCqPSuVRqTwpzVfe_D3B44Wzwwy8PQMqaeVtzDZceuSqgvL8ITL3_sS1btveu2hk6pT3ORak2u1bwSVQSSkri9-asLfc</recordid><startdate>20061201</startdate><enddate>20061201</enddate><creator>Hallfors, Denise</creator><creator>Cho, Hyunsan</creator><creator>Sanchez, Victoria</creator><creator>Khatapoush, Shereen</creator><creator>Kim, Hyung Min</creator><creator>Bauer, Daniel</creator><general>Am Public Health Assoc</general><general>American Public Health Association</general><general>American Journal of Public Health 2006</general><scope>IQODW</scope><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>0-V</scope><scope>0U~</scope><scope>1-H</scope><scope>3V.</scope><scope>7RV</scope><scope>7TQ</scope><scope>7WY</scope><scope>7WZ</scope><scope>7X7</scope><scope>7XB</scope><scope>87Z</scope><scope>88A</scope><scope>88C</scope><scope>88E</scope><scope>88G</scope><scope>88I</scope><scope>88J</scope><scope>8AF</scope><scope>8AO</scope><scope>8C1</scope><scope>8FE</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AEUYN</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BHPHI</scope><scope>CCPQU</scope><scope>DHY</scope><scope>DON</scope><scope>DPSOV</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>FYUFA</scope><scope>F~G</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>K60</scope><scope>K6~</scope><scope>K9-</scope><scope>K9.</scope><scope>KB0</scope><scope>KC-</scope><scope>L.-</scope><scope>L.0</scope><scope>LK8</scope><scope>M0C</scope><scope>M0R</scope><scope>M0S</scope><scope>M0T</scope><scope>M1P</scope><scope>M2L</scope><scope>M2M</scope><scope>M2O</scope><scope>M2P</scope><scope>M2R</scope><scope>M7P</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>PATMY</scope><scope>PHGZM</scope><scope>PHGZT</scope><scope>PJZUB</scope><scope>PKEHL</scope><scope>POGQB</scope><scope>PPXIY</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQGLB</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PRQQA</scope><scope>PSYQQ</scope><scope>PYCSY</scope><scope>Q9U</scope><scope>S0X</scope><scope>7T2</scope><scope>7U1</scope><scope>7U2</scope><scope>C1K</scope><scope>5PM</scope></search><sort><creationdate>20061201</creationdate><title>Efficacy vs Effectiveness Trial Results of an Indicated "Model" Substance Abuse Program: Implications for Public Health</title><author>Hallfors, Denise ; Cho, Hyunsan ; Sanchez, Victoria ; Khatapoush, Shereen ; Kim, Hyung Min ; Bauer, Daniel</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c515t-f17a0dcd99c1f8f0a81369b629ce183d824f740badb09ad605c9768b62ce331b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2006</creationdate><topic>Academic achievement</topic><topic>Adolescent</topic><topic>Behavior</topic><topic>Bias</topic><topic>Biological and medical sciences</topic><topic>Certification</topic><topic>Children & youth</topic><topic>Drug abuse</topic><topic>Drug use</topic><topic>Education policy</topic><topic>Effectiveness</topic><topic>Federal government</topic><topic>Female</topic><topic>Health promotion</topic><topic>Health services</topic><topic>Humans</topic><topic>Intervention</topic><topic>Juvenile delinquency</topic><topic>Learning</topic><topic>Male</topic><topic>Medical sciences</topic><topic>Medical treatment</topic><topic>Mental health</topic><topic>Mental health care</topic><topic>Miscellaneous</topic><topic>Models, Organizational</topic><topic>Outcome Assessment (Health Care)</topic><topic>Peer Group</topic><topic>Prevention programs</topic><topic>Program Evaluation</topic><topic>Public health</topic><topic>Public Health Administration</topic><topic>Public health. Hygiene</topic><topic>Public health. Hygiene-occupational medicine</topic><topic>Research and Practice</topic><topic>Risk factors</topic><topic>Sample size</topic><topic>School districts</topic><topic>School Health Services - organization & administration</topic><topic>School Health Services - standards</topic><topic>Secondary schools</topic><topic>Student Dropouts - psychology</topic><topic>Students</topic><topic>Studies</topic><topic>Substance abuse treatment</topic><topic>Substance-Related Disorders - ethnology</topic><topic>Substance-Related Disorders - prevention & control</topic><topic>United States</topic><topic>United States Substance Abuse and Mental Health Services Administration</topic><topic>Urban Health Services - organization & administration</topic><topic>Urban Health Services - standards</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hallfors, Denise</creatorcontrib><creatorcontrib>Cho, Hyunsan</creatorcontrib><creatorcontrib>Sanchez, Victoria</creatorcontrib><creatorcontrib>Khatapoush, Shereen</creatorcontrib><creatorcontrib>Kim, Hyung Min</creatorcontrib><creatorcontrib>Bauer, Daniel</creatorcontrib><collection>Pascal-Francis</collection><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>ProQuest Social Sciences Premium Collection</collection><collection>Global News & ABI/Inform Professional</collection><collection>Trade PRO</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing & Allied Health Database</collection><collection>PAIS Index</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Biology Database (Alumni Edition)</collection><collection>Healthcare Administration Database (Alumni)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Psychology Database (Alumni)</collection><collection>Science Database (Alumni Edition)</collection><collection>Social Science Database (Alumni Edition)</collection><collection>STEM Database</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest One Sustainability</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>eLibrary</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Natural Science Collection</collection><collection>ProQuest One Community College</collection><collection>PAIS International</collection><collection>PAIS International (Ovid)</collection><collection>Politics Collection</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>Health Research Premium Collection</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Consumer Health Database (Alumni Edition)</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>ProQuest Politics Collection</collection><collection>ABI/INFORM Professional Advanced</collection><collection>ABI/INFORM Professional Standard</collection><collection>ProQuest Biological Science Collection</collection><collection>ABI/INFORM Global</collection><collection>Consumer Health Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Healthcare Administration Database</collection><collection>Medical Database</collection><collection>Political Science Database</collection><collection>ProQuest Psychology</collection><collection>Research Library</collection><collection>Science Database</collection><collection>Social Science Database</collection><collection>Biological Science Database</collection><collection>Research Library (Corporate)</collection><collection>Nursing & Allied Health Premium</collection><collection>Environmental Science Database</collection><collection>ProQuest Central (New)</collection><collection>ProQuest One Academic (New)</collection><collection>ProQuest Health & Medical Research Collection</collection><collection>ProQuest One Academic Middle East (New)</collection><collection>ProQuest Sociology & Social Sciences Collection</collection><collection>ProQuest One Health & Nursing</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Applied & Life Sciences</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>ProQuest One Social Sciences</collection><collection>ProQuest One Psychology</collection><collection>Environmental Science Collection</collection><collection>ProQuest Central Basic</collection><collection>SIRS Editorial</collection><collection>Health and Safety Science Abstracts (Full archive)</collection><collection>Risk Abstracts</collection><collection>Safety Science and Risk</collection><collection>Environmental Sciences and Pollution Management</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>American journal of public health (1971)</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hallfors, Denise</au><au>Cho, Hyunsan</au><au>Sanchez, Victoria</au><au>Khatapoush, Shereen</au><au>Kim, Hyung Min</au><au>Bauer, Daniel</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Efficacy vs Effectiveness Trial Results of an Indicated "Model" Substance Abuse Program: Implications for Public Health</atitle><jtitle>American journal of public health (1971)</jtitle><addtitle>Am J Public Health</addtitle><date>2006-12-01</date><risdate>2006</risdate><volume>96</volume><issue>12</issue><spage>2254</spage><epage>2259</epage><pages>2254-2259</pages><issn>0090-0036</issn><eissn>1541-0048</eissn><coden>AJPEAG</coden><abstract>The US Department of Education requires schools to choose substance abuse and violence prevention programs that meet standards of effectiveness. The Substance Abuse and Mental Health Services Agency certifies "model" programs that meet this standard. We compared findings from a large, multisite effectiveness trial of 1 model program to its efficacy trial findings, upon which the certification was based.
1370 high-risk youths were randomized to experimental or control groups across 9 high schools in 2 large urban school districts. We used intent-to-treat and on-treatment approaches to examine baseline equivalence, attrition, and group differences in outcomes at the end of the program and at a 6-month follow-up.
Positive efficacy trial findings were not replicated in the effectiveness trial. All main effects were either null or worse for the experimental than for the control group.
These findings suggest that small efficacy trials conducted by developers provide insufficient evidence of effectiveness. Federal agencies and public health scientists must work together to raise the standards of evidence and ensure that data from new trials are incorporated into ongoing assessments of program effects.</abstract><cop>Washington, DC</cop><pub>Am Public Health Assoc</pub><pmid>16809591</pmid><doi>10.2105/AJPH.2005.067462</doi><tpages>6</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0090-0036 |
ispartof | American journal of public health (1971), 2006-12, Vol.96 (12), p.2254-2259 |
issn | 0090-0036 1541-0048 |
language | eng |
recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_1698156 |
source | MEDLINE; PAIS Index; Business Source Complete; PubMed Central; Alma/SFX Local Collection |
subjects | Academic achievement Adolescent Behavior Bias Biological and medical sciences Certification Children & youth Drug abuse Drug use Education policy Effectiveness Federal government Female Health promotion Health services Humans Intervention Juvenile delinquency Learning Male Medical sciences Medical treatment Mental health Mental health care Miscellaneous Models, Organizational Outcome Assessment (Health Care) Peer Group Prevention programs Program Evaluation Public health Public Health Administration Public health. Hygiene Public health. Hygiene-occupational medicine Research and Practice Risk factors Sample size School districts School Health Services - organization & administration School Health Services - standards Secondary schools Student Dropouts - psychology Students Studies Substance abuse treatment Substance-Related Disorders - ethnology Substance-Related Disorders - prevention & control United States United States Substance Abuse and Mental Health Services Administration Urban Health Services - organization & administration Urban Health Services - standards |
title | Efficacy vs Effectiveness Trial Results of an Indicated "Model" Substance Abuse Program: Implications for Public Health |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-16T09%3A24%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Efficacy%20vs%20Effectiveness%20Trial%20Results%20of%20an%20Indicated%20%22Model%22%20Substance%20Abuse%20Program:%20Implications%20for%20Public%20Health&rft.jtitle=American%20journal%20of%20public%20health%20(1971)&rft.au=Hallfors,%20Denise&rft.date=2006-12-01&rft.volume=96&rft.issue=12&rft.spage=2254&rft.epage=2259&rft.pages=2254-2259&rft.issn=0090-0036&rft.eissn=1541-0048&rft.coden=AJPEAG&rft_id=info:doi/10.2105/AJPH.2005.067462&rft_dat=%3Cproquest_pubme%3E1178242101%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=215082483&rft_id=info:pmid/16809591&rfr_iscdi=true |