Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review
Abstract This article aims to identify studies that developed quality indicator for the management of the National School Feeding Program (PNAE, in Brazilian context) and to critically appraise the properties of their instruments. Systematic review using Scopus, Lilacs, Pubmed and Web of Science for...
Gespeichert in:
Veröffentlicht in: | Ciência & saude coletiva 2021-08, Vol.26 (8), p.3099-3110 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 3110 |
---|---|
container_issue | 8 |
container_start_page | 3099 |
container_title | Ciência & saude coletiva |
container_volume | 26 |
creator | Bicalho, Daniela Santos, Thanise Sabrina Souza Slater, Betzabeth Lima, Tácio Mendonça |
description | Abstract This article aims to identify studies that developed quality indicator for the management of the National School Feeding Program (PNAE, in Brazilian context) and to critically appraise the properties of their instruments. Systematic review using Scopus, Lilacs, Pubmed and Web of Science for data collection. The search was limited to studies between 2009 and 2019. The search strategy included search terms related to school feeding, program evaluation, and indicator. The indicators were evaluated using the Appraisal of Indicators through Research and Evaluation instrument. The search identified 1,355 studies, of which 14 were potentially relevant records and 10 met the inclusion criteria. Most studies used a literature review with consensus techniques in the development of the instrument and a frame work format to evaluate the PNAE. None of them presented evidence of validity of the instrument. The highest level was achieved on the domain ‘Purpose, relevance and organizational context’, followed by ‘Stakeholder involvement’, ‘Additional evidence, formulation and usage’, and ‘Scientific evidence’. This review found gaps in the methodology of studies that had developed quality indicators for the management of PNAE. Future development of these instruments should include validity evidence.
Resumo O objetivo deste artigo é identificar estudos que desenvolveram indicador de qualidade para gestão do Programa Nacional de Alimentação Escolar (PNAE), e avaliar criticamente as propriedades de seus instrumentos. Revisão sistemática utilizando Scopus, Lilacs, Pubmed e Web of Science para coleta de dados. A busca foi limitada aos estudos realizados entre 2009 e 2019. A estratégia de pesquisa incluiu termos relacionados à alimentação escolar, avaliação de programas e indicador. Os indicadores foram avaliados pelo instrumento Avaliação de Indicadores por Pesquisa e Avaliação. A pesquisa identificou 1.355 estudos, dos quais 14 eram registros potencialmente relevantes e dez preencheram os critérios de inclusão. A maioria dos estudos utilizou uma revisão de literatura com técnicas de consenso no desenvolvimento do instrumento e um formato de matriz para avaliar o PNAE. Nenhum estudo apresentou evidência de validade do instrumento. As melhores pontuações foram obtidas nos domínios “Finalidade, relevância e contexto organizacional”, seguido de “Envolvimento das partes interessadas”, “Evidência, formulação e uso adicionais” e “Evidência científica”. Esta revisão encontro |
doi_str_mv | 10.1590/1413-81232021268.03802020 |
format | Article |
fullrecord | <record><control><sourceid>proquest_sciel</sourceid><recordid>TN_cdi_scielo_journals_S1413_81232021000803099</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><scielo_id>S1413_81232021000803099</scielo_id><sourcerecordid>2818893979</sourcerecordid><originalsourceid>FETCH-LOGICAL-c412t-85fdc4a59f45030c6903a4cd8c6bfcac7d3ce4118147ebec9bf194dcd3c477293</originalsourceid><addsrcrecordid>eNpdkctKxDAUhosoeH2HiBs3HXNrm7hT8QaDCqPrkElPx0jaaNIq49ObOo6gqxzC938czp9lhwRPSCHxCeGE5YJQRjEltBQTzAROM97IdkhZiZwXJdlM85rbznZjfMGYVozTnWy4fNdu0L31HfINehu0s_0S2a62Rvc-RNT4gFrd6QW00PUj1D8DuvuOaIdm5tl7h64Aatst0EPwi6DbJEDnQX9ad4o0isvYQ5sSBgV4t_Cxn2012kU4-Hn3sqery8eLm3x6f317cTbNDSe0z0XR1IbrQja8wAybUmKmuamFKeeN0aaqmQFOiCC8gjkYOW-I5LVJ37yqqGR72WTljcaC8-rFDyEtHdVsvIda3w1jLJJfjoHjVeA1-LcBYq9aGw04pzvwQ1S0KDGVsqI0oUf_0F87FUQIyWQ1CuWKMsHHGKBRr8G2OiwVwWpsUP3ZJDWo1g2yL5jejOo</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2818893979</pqid></control><display><type>article</type><title>Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review</title><source>EZB-FREE-00999 freely available EZB journals</source><creator>Bicalho, Daniela ; Santos, Thanise Sabrina Souza ; Slater, Betzabeth ; Lima, Tácio Mendonça</creator><creatorcontrib>Bicalho, Daniela ; Santos, Thanise Sabrina Souza ; Slater, Betzabeth ; Lima, Tácio Mendonça</creatorcontrib><description>Abstract This article aims to identify studies that developed quality indicator for the management of the National School Feeding Program (PNAE, in Brazilian context) and to critically appraise the properties of their instruments. Systematic review using Scopus, Lilacs, Pubmed and Web of Science for data collection. The search was limited to studies between 2009 and 2019. The search strategy included search terms related to school feeding, program evaluation, and indicator. The indicators were evaluated using the Appraisal of Indicators through Research and Evaluation instrument. The search identified 1,355 studies, of which 14 were potentially relevant records and 10 met the inclusion criteria. Most studies used a literature review with consensus techniques in the development of the instrument and a frame work format to evaluate the PNAE. None of them presented evidence of validity of the instrument. The highest level was achieved on the domain ‘Purpose, relevance and organizational context’, followed by ‘Stakeholder involvement’, ‘Additional evidence, formulation and usage’, and ‘Scientific evidence’. This review found gaps in the methodology of studies that had developed quality indicators for the management of PNAE. Future development of these instruments should include validity evidence.
Resumo O objetivo deste artigo é identificar estudos que desenvolveram indicador de qualidade para gestão do Programa Nacional de Alimentação Escolar (PNAE), e avaliar criticamente as propriedades de seus instrumentos. Revisão sistemática utilizando Scopus, Lilacs, Pubmed e Web of Science para coleta de dados. A busca foi limitada aos estudos realizados entre 2009 e 2019. A estratégia de pesquisa incluiu termos relacionados à alimentação escolar, avaliação de programas e indicador. Os indicadores foram avaliados pelo instrumento Avaliação de Indicadores por Pesquisa e Avaliação. A pesquisa identificou 1.355 estudos, dos quais 14 eram registros potencialmente relevantes e dez preencheram os critérios de inclusão. A maioria dos estudos utilizou uma revisão de literatura com técnicas de consenso no desenvolvimento do instrumento e um formato de matriz para avaliar o PNAE. Nenhum estudo apresentou evidência de validade do instrumento. As melhores pontuações foram obtidas nos domínios “Finalidade, relevância e contexto organizacional”, seguido de “Envolvimento das partes interessadas”, “Evidência, formulação e uso adicionais” e “Evidência científica”. Esta revisão encontrou lacunas na metodologia de estudos que desenvolveram indicadores de qualidade da gestão do PNAE. O desenvolvimento futuro desses instrumentos deve incluir evidências de validade.</description><identifier>ISSN: 1413-8123</identifier><identifier>ISSN: 1678-4561</identifier><identifier>EISSN: 1678-4561</identifier><identifier>DOI: 10.1590/1413-81232021268.03802020</identifier><language>eng</language><publisher>Rio de Janeiro: Associação Brasileira de Saúde Coletiva</publisher><subject>Childrens health ; Food programs ; Indicators ; Literature reviews ; Organizational aspects ; Program evaluation ; PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH ; Quality of service ; Schools ; Systematic review</subject><ispartof>Ciência & saude coletiva, 2021-08, Vol.26 (8), p.3099-3110</ispartof><rights>Copyright © 2021. This work is licensed under https://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>This work is licensed under a Creative Commons Attribution 4.0 International License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c412t-85fdc4a59f45030c6903a4cd8c6bfcac7d3ce4118147ebec9bf194dcd3c477293</citedby><cites>FETCH-LOGICAL-c412t-85fdc4a59f45030c6903a4cd8c6bfcac7d3ce4118147ebec9bf194dcd3c477293</cites><orcidid>0000-0003-4484-6975 ; 0000-0003-4395-2098 ; 0000-0003-4087-1815 ; 0000-0003-2511-1770</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,776,780,881,27901,27902</link.rule.ids></links><search><creatorcontrib>Bicalho, Daniela</creatorcontrib><creatorcontrib>Santos, Thanise Sabrina Souza</creatorcontrib><creatorcontrib>Slater, Betzabeth</creatorcontrib><creatorcontrib>Lima, Tácio Mendonça</creatorcontrib><title>Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review</title><title>Ciência & saude coletiva</title><addtitle>Ciênc. saúde coletiva</addtitle><description>Abstract This article aims to identify studies that developed quality indicator for the management of the National School Feeding Program (PNAE, in Brazilian context) and to critically appraise the properties of their instruments. Systematic review using Scopus, Lilacs, Pubmed and Web of Science for data collection. The search was limited to studies between 2009 and 2019. The search strategy included search terms related to school feeding, program evaluation, and indicator. The indicators were evaluated using the Appraisal of Indicators through Research and Evaluation instrument. The search identified 1,355 studies, of which 14 were potentially relevant records and 10 met the inclusion criteria. Most studies used a literature review with consensus techniques in the development of the instrument and a frame work format to evaluate the PNAE. None of them presented evidence of validity of the instrument. The highest level was achieved on the domain ‘Purpose, relevance and organizational context’, followed by ‘Stakeholder involvement’, ‘Additional evidence, formulation and usage’, and ‘Scientific evidence’. This review found gaps in the methodology of studies that had developed quality indicators for the management of PNAE. Future development of these instruments should include validity evidence.
Resumo O objetivo deste artigo é identificar estudos que desenvolveram indicador de qualidade para gestão do Programa Nacional de Alimentação Escolar (PNAE), e avaliar criticamente as propriedades de seus instrumentos. Revisão sistemática utilizando Scopus, Lilacs, Pubmed e Web of Science para coleta de dados. A busca foi limitada aos estudos realizados entre 2009 e 2019. A estratégia de pesquisa incluiu termos relacionados à alimentação escolar, avaliação de programas e indicador. Os indicadores foram avaliados pelo instrumento Avaliação de Indicadores por Pesquisa e Avaliação. A pesquisa identificou 1.355 estudos, dos quais 14 eram registros potencialmente relevantes e dez preencheram os critérios de inclusão. A maioria dos estudos utilizou uma revisão de literatura com técnicas de consenso no desenvolvimento do instrumento e um formato de matriz para avaliar o PNAE. Nenhum estudo apresentou evidência de validade do instrumento. As melhores pontuações foram obtidas nos domínios “Finalidade, relevância e contexto organizacional”, seguido de “Envolvimento das partes interessadas”, “Evidência, formulação e uso adicionais” e “Evidência científica”. Esta revisão encontrou lacunas na metodologia de estudos que desenvolveram indicadores de qualidade da gestão do PNAE. O desenvolvimento futuro desses instrumentos deve incluir evidências de validade.</description><subject>Childrens health</subject><subject>Food programs</subject><subject>Indicators</subject><subject>Literature reviews</subject><subject>Organizational aspects</subject><subject>Program evaluation</subject><subject>PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH</subject><subject>Quality of service</subject><subject>Schools</subject><subject>Systematic review</subject><issn>1413-8123</issn><issn>1678-4561</issn><issn>1678-4561</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNpdkctKxDAUhosoeH2HiBs3HXNrm7hT8QaDCqPrkElPx0jaaNIq49ObOo6gqxzC938czp9lhwRPSCHxCeGE5YJQRjEltBQTzAROM97IdkhZiZwXJdlM85rbznZjfMGYVozTnWy4fNdu0L31HfINehu0s_0S2a62Rvc-RNT4gFrd6QW00PUj1D8DuvuOaIdm5tl7h64Aatst0EPwi6DbJEDnQX9ad4o0isvYQ5sSBgV4t_Cxn2012kU4-Hn3sqery8eLm3x6f317cTbNDSe0z0XR1IbrQja8wAybUmKmuamFKeeN0aaqmQFOiCC8gjkYOW-I5LVJ37yqqGR72WTljcaC8-rFDyEtHdVsvIda3w1jLJJfjoHjVeA1-LcBYq9aGw04pzvwQ1S0KDGVsqI0oUf_0F87FUQIyWQ1CuWKMsHHGKBRr8G2OiwVwWpsUP3ZJDWo1g2yL5jejOo</recordid><startdate>20210801</startdate><enddate>20210801</enddate><creator>Bicalho, Daniela</creator><creator>Santos, Thanise Sabrina Souza</creator><creator>Slater, Betzabeth</creator><creator>Lima, Tácio Mendonça</creator><general>Associação Brasileira de Saúde Coletiva</general><general>ABRASCO - Associação Brasileira de Saúde Coletiva</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8C1</scope><scope>8FE</scope><scope>8FG</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>8G5</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB0</scope><scope>L6V</scope><scope>M0S</scope><scope>M1P</scope><scope>M2O</scope><scope>M7S</scope><scope>MBDVC</scope><scope>NAPCQ</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>Q9U</scope><scope>7X8</scope><scope>GPN</scope><orcidid>https://orcid.org/0000-0003-4484-6975</orcidid><orcidid>https://orcid.org/0000-0003-4395-2098</orcidid><orcidid>https://orcid.org/0000-0003-4087-1815</orcidid><orcidid>https://orcid.org/0000-0003-2511-1770</orcidid></search><sort><creationdate>20210801</creationdate><title>Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review</title><author>Bicalho, Daniela ; Santos, Thanise Sabrina Souza ; Slater, Betzabeth ; Lima, Tácio Mendonça</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c412t-85fdc4a59f45030c6903a4cd8c6bfcac7d3ce4118147ebec9bf194dcd3c477293</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Childrens health</topic><topic>Food programs</topic><topic>Indicators</topic><topic>Literature reviews</topic><topic>Organizational aspects</topic><topic>Program evaluation</topic><topic>PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH</topic><topic>Quality of service</topic><topic>Schools</topic><topic>Systematic review</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Bicalho, Daniela</creatorcontrib><creatorcontrib>Santos, Thanise Sabrina Souza</creatorcontrib><creatorcontrib>Slater, Betzabeth</creatorcontrib><creatorcontrib>Lima, Tácio Mendonça</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Proquest Nursing & Allied Health Source</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>Public Health Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Research Library (Alumni Edition)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>ProQuest Engineering Collection</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Research Library</collection><collection>Engineering Database</collection><collection>Research Library (Corporate)</collection><collection>Nursing & Allied Health Premium</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>ProQuest Central Basic</collection><collection>MEDLINE - Academic</collection><collection>SciELO</collection><jtitle>Ciência & saude coletiva</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Bicalho, Daniela</au><au>Santos, Thanise Sabrina Souza</au><au>Slater, Betzabeth</au><au>Lima, Tácio Mendonça</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review</atitle><jtitle>Ciência & saude coletiva</jtitle><addtitle>Ciênc. saúde coletiva</addtitle><date>2021-08-01</date><risdate>2021</risdate><volume>26</volume><issue>8</issue><spage>3099</spage><epage>3110</epage><pages>3099-3110</pages><issn>1413-8123</issn><issn>1678-4561</issn><eissn>1678-4561</eissn><abstract>Abstract This article aims to identify studies that developed quality indicator for the management of the National School Feeding Program (PNAE, in Brazilian context) and to critically appraise the properties of their instruments. Systematic review using Scopus, Lilacs, Pubmed and Web of Science for data collection. The search was limited to studies between 2009 and 2019. The search strategy included search terms related to school feeding, program evaluation, and indicator. The indicators were evaluated using the Appraisal of Indicators through Research and Evaluation instrument. The search identified 1,355 studies, of which 14 were potentially relevant records and 10 met the inclusion criteria. Most studies used a literature review with consensus techniques in the development of the instrument and a frame work format to evaluate the PNAE. None of them presented evidence of validity of the instrument. The highest level was achieved on the domain ‘Purpose, relevance and organizational context’, followed by ‘Stakeholder involvement’, ‘Additional evidence, formulation and usage’, and ‘Scientific evidence’. This review found gaps in the methodology of studies that had developed quality indicators for the management of PNAE. Future development of these instruments should include validity evidence.
Resumo O objetivo deste artigo é identificar estudos que desenvolveram indicador de qualidade para gestão do Programa Nacional de Alimentação Escolar (PNAE), e avaliar criticamente as propriedades de seus instrumentos. Revisão sistemática utilizando Scopus, Lilacs, Pubmed e Web of Science para coleta de dados. A busca foi limitada aos estudos realizados entre 2009 e 2019. A estratégia de pesquisa incluiu termos relacionados à alimentação escolar, avaliação de programas e indicador. Os indicadores foram avaliados pelo instrumento Avaliação de Indicadores por Pesquisa e Avaliação. A pesquisa identificou 1.355 estudos, dos quais 14 eram registros potencialmente relevantes e dez preencheram os critérios de inclusão. A maioria dos estudos utilizou uma revisão de literatura com técnicas de consenso no desenvolvimento do instrumento e um formato de matriz para avaliar o PNAE. Nenhum estudo apresentou evidência de validade do instrumento. As melhores pontuações foram obtidas nos domínios “Finalidade, relevância e contexto organizacional”, seguido de “Envolvimento das partes interessadas”, “Evidência, formulação e uso adicionais” e “Evidência científica”. Esta revisão encontrou lacunas na metodologia de estudos que desenvolveram indicadores de qualidade da gestão do PNAE. O desenvolvimento futuro desses instrumentos deve incluir evidências de validade.</abstract><cop>Rio de Janeiro</cop><pub>Associação Brasileira de Saúde Coletiva</pub><doi>10.1590/1413-81232021268.03802020</doi><tpages>12</tpages><orcidid>https://orcid.org/0000-0003-4484-6975</orcidid><orcidid>https://orcid.org/0000-0003-4395-2098</orcidid><orcidid>https://orcid.org/0000-0003-4087-1815</orcidid><orcidid>https://orcid.org/0000-0003-2511-1770</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1413-8123 |
ispartof | Ciência & saude coletiva, 2021-08, Vol.26 (8), p.3099-3110 |
issn | 1413-8123 1678-4561 1678-4561 |
language | eng |
recordid | cdi_scielo_journals_S1413_81232021000803099 |
source | EZB-FREE-00999 freely available EZB journals |
subjects | Childrens health Food programs Indicators Literature reviews Organizational aspects Program evaluation PUBLIC, ENVIRONMENTAL & OCCUPATIONAL HEALTH Quality of service Schools Systematic review |
title | Evaluation of quality indicators for management of the National School Feeding Program in Brazil: a systematic review |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-30T16%3A29%3A57IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_sciel&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Evaluation%20of%20quality%20indicators%20for%20management%20of%20the%20National%20School%20Feeding%20Program%20in%20Brazil:%20a%20systematic%20review&rft.jtitle=Ci%C3%AAncia%20&%20saude%20coletiva&rft.au=Bicalho,%20Daniela&rft.date=2021-08-01&rft.volume=26&rft.issue=8&rft.spage=3099&rft.epage=3110&rft.pages=3099-3110&rft.issn=1413-8123&rft.eissn=1678-4561&rft_id=info:doi/10.1590/1413-81232021268.03802020&rft_dat=%3Cproquest_sciel%3E2818893979%3C/proquest_sciel%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2818893979&rft_id=info:pmid/&rft_scielo_id=S1413_81232021000803099&rfr_iscdi=true |