Applying Multiple Methods to Comprehensively Evaluate a Patient Portal's Effectiveness to Convey Information to Patients

Patient portals have yet to achieve their full potential for enhancing health communication and improving health outcomes. Although the Patient Protection and Affordable Care Act in the United States mandates the utilization of patient portals, and usage continues to rise, their impact has not been...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of medical Internet research 2016-05, Vol.18 (5), p.e112-e112
Hauptverfasser: Alpert, Jordan M, Krist, Alex H, Aycock, Rebecca A, Kreps, Gary L
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page e112
container_issue 5
container_start_page e112
container_title Journal of medical Internet research
container_volume 18
creator Alpert, Jordan M
Krist, Alex H
Aycock, Rebecca A
Kreps, Gary L
description Patient portals have yet to achieve their full potential for enhancing health communication and improving health outcomes. Although the Patient Protection and Affordable Care Act in the United States mandates the utilization of patient portals, and usage continues to rise, their impact has not been as profound as anticipated. The objective of our case study was to evaluate how well portals convey information to patients. To demonstrate how multiple methodologies could be used to evaluate and improve the design of patient-centered portals, we conducted an in-depth evaluation of an exemplar patient-centered portal designed to promote preventive care to consumers. We used 31 critical incident patient interviews, 2 clinician focus groups, and a thematic content analysis to understand patients' and clinicians' perspectives, as well as theoretical understandings of the portal's use. We gathered over 140 critical incidents, 71.8% (102/142) negative and 28.2% (40/142) positive. Positive incident categories were (1) instant medical information access, (2) clear health information, and (3) patient vigilance. Negative incident categories were (1) standardized content, (2) desire for direct communication, (3) website functionality, and (4) difficulty interpreting laboratory data. Thematic analysis of the portal's immediacy resulted in high scores in the attributes enhances understanding (18/23, 78%), personalization (18/24, 75%), and motivates behavior (17/24, 71%), but low levels of interactivity (7/24, 29%) and engagement (2/24, 8%). Two overarching themes emerged to guide portal refinements: (1) communication can be improved with directness and interactivity and (2) perceived personalization must be greater to engage patients. Results suggest that simple modifications, such as increased interactivity and personalized messages, can make portals customized, robust, easily accessible, and trusted information sources.
doi_str_mv 10.2196/jmir.5451
format Article
fullrecord <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_4887660</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1790020147</sourcerecordid><originalsourceid>FETCH-LOGICAL-c431t-9da88baf7116262c331e6a421843c72e9ebc87521b1fbad780e4c25fc56cd8383</originalsourceid><addsrcrecordid>eNp9kU1v1DAQhiMEoh9w4A8gSxwohy0Zx06cC1K1WqBSK3qAs-U4k65Xjh1sZ8X-exx1qQoHTmONn3nn4y2KN1BeUmjrj7vRhEvOODwrToFVYiVEA8-fvE-Ksxh3ZUlL1sLL4oQ2IETLq9Pi19U02YNx9-R2tslMFsktpq3vI0merP04Bdyii2aP9kA2e2VnlZAocqeSQZfInQ9J2feRbIYBdcqcw3gsdns8kGs3-DBm2rsle6yLr4oXg7IRXx_jefHj8-b7-uvq5tuX6_XVzUqzCtKq7ZUQnRoagJrWVFcVYK0YBcEq3VBssdOi4RQ6GDrVN6JEpikfNK91LypRnRefHnSnuRux17l3UFZOwYwqHKRXRv7948xW3vu9ZPlwdV1mgYujQPA_Z4xJjiZqtFY59HOU0LTLYYE1GX33D7rzc3B5PUk5UEE5h_J_FOSJKWelaDP14YHSwccYcHgcGUq5uC4X1-XiembfPt3xkfxjc_UbvUmqCA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2512825510</pqid></control><display><type>article</type><title>Applying Multiple Methods to Comprehensively Evaluate a Patient Portal's Effectiveness to Convey Information to Patients</title><source>MEDLINE</source><source>DOAJ Directory of Open Access Journals</source><source>PubMed Central Open Access</source><source>Applied Social Sciences Index &amp; Abstracts (ASSIA)</source><source>EZB-FREE-00999 freely available EZB journals</source><source>PubMed Central</source><creator>Alpert, Jordan M ; Krist, Alex H ; Aycock, Rebecca A ; Kreps, Gary L</creator><creatorcontrib>Alpert, Jordan M ; Krist, Alex H ; Aycock, Rebecca A ; Kreps, Gary L</creatorcontrib><description>Patient portals have yet to achieve their full potential for enhancing health communication and improving health outcomes. Although the Patient Protection and Affordable Care Act in the United States mandates the utilization of patient portals, and usage continues to rise, their impact has not been as profound as anticipated. The objective of our case study was to evaluate how well portals convey information to patients. To demonstrate how multiple methodologies could be used to evaluate and improve the design of patient-centered portals, we conducted an in-depth evaluation of an exemplar patient-centered portal designed to promote preventive care to consumers. We used 31 critical incident patient interviews, 2 clinician focus groups, and a thematic content analysis to understand patients' and clinicians' perspectives, as well as theoretical understandings of the portal's use. We gathered over 140 critical incidents, 71.8% (102/142) negative and 28.2% (40/142) positive. Positive incident categories were (1) instant medical information access, (2) clear health information, and (3) patient vigilance. Negative incident categories were (1) standardized content, (2) desire for direct communication, (3) website functionality, and (4) difficulty interpreting laboratory data. Thematic analysis of the portal's immediacy resulted in high scores in the attributes enhances understanding (18/23, 78%), personalization (18/24, 75%), and motivates behavior (17/24, 71%), but low levels of interactivity (7/24, 29%) and engagement (2/24, 8%). Two overarching themes emerged to guide portal refinements: (1) communication can be improved with directness and interactivity and (2) perceived personalization must be greater to engage patients. Results suggest that simple modifications, such as increased interactivity and personalized messages, can make portals customized, robust, easily accessible, and trusted information sources.</description><identifier>ISSN: 1438-8871</identifier><identifier>ISSN: 1439-4456</identifier><identifier>EISSN: 1438-8871</identifier><identifier>DOI: 10.2196/jmir.5451</identifier><identifier>PMID: 27188953</identifier><language>eng</language><publisher>Canada: Gunther Eysenbach MD MPH, Associate Professor</publisher><subject>Access to Information ; Adolescent ; Adult ; Aged ; Ambulatory care ; Clinical information ; Clinical outcomes ; Communication ; Consumers ; Content analysis ; Critical incidents ; Design ; Electronic Health Records - statistics &amp; numerical data ; Female ; Focus Groups ; Health Communication - methods ; Health education ; Health information ; Health status ; Humans ; Information sources ; Interviews ; Laboratories ; Male ; Medical practices ; Medical records ; Medical research ; Middle Aged ; Original Paper ; Patient Portals - statistics &amp; numerical data ; Patient Protection &amp; Affordable Care Act 2010-US ; Patient Protection and Affordable Care Act - statistics &amp; numerical data ; Patient-centered care ; Patients ; Physicians ; Preventive medicine ; Research methodology ; Researchers ; Usability ; Vigilance ; Web portals ; Young Adult</subject><ispartof>Journal of medical Internet research, 2016-05, Vol.18 (5), p.e112-e112</ispartof><rights>Copyright Gunther Eysenbach MD MPH, Associate Professor May 2016</rights><rights>2016. This work is licensed under http://creativecommons.org/licenses/by/2.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>Jordan M Alpert, Alex H Krist, Rebecca A Aycock, Gary L Kreps. Originally published in the Journal of Medical Internet Research (http://www.jmir.org), 17.05.2016. 2016</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c431t-9da88baf7116262c331e6a421843c72e9ebc87521b1fbad780e4c25fc56cd8383</citedby><cites>FETCH-LOGICAL-c431t-9da88baf7116262c331e6a421843c72e9ebc87521b1fbad780e4c25fc56cd8383</cites><orcidid>0000-0001-5980-129X ; 0000-0003-4060-9155 ; 0000-0002-4726-4359 ; 0000-0002-7066-4748</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,724,777,781,861,882,12827,27905,27906,30980</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/27188953$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Alpert, Jordan M</creatorcontrib><creatorcontrib>Krist, Alex H</creatorcontrib><creatorcontrib>Aycock, Rebecca A</creatorcontrib><creatorcontrib>Kreps, Gary L</creatorcontrib><title>Applying Multiple Methods to Comprehensively Evaluate a Patient Portal's Effectiveness to Convey Information to Patients</title><title>Journal of medical Internet research</title><addtitle>J Med Internet Res</addtitle><description>Patient portals have yet to achieve their full potential for enhancing health communication and improving health outcomes. Although the Patient Protection and Affordable Care Act in the United States mandates the utilization of patient portals, and usage continues to rise, their impact has not been as profound as anticipated. The objective of our case study was to evaluate how well portals convey information to patients. To demonstrate how multiple methodologies could be used to evaluate and improve the design of patient-centered portals, we conducted an in-depth evaluation of an exemplar patient-centered portal designed to promote preventive care to consumers. We used 31 critical incident patient interviews, 2 clinician focus groups, and a thematic content analysis to understand patients' and clinicians' perspectives, as well as theoretical understandings of the portal's use. We gathered over 140 critical incidents, 71.8% (102/142) negative and 28.2% (40/142) positive. Positive incident categories were (1) instant medical information access, (2) clear health information, and (3) patient vigilance. Negative incident categories were (1) standardized content, (2) desire for direct communication, (3) website functionality, and (4) difficulty interpreting laboratory data. Thematic analysis of the portal's immediacy resulted in high scores in the attributes enhances understanding (18/23, 78%), personalization (18/24, 75%), and motivates behavior (17/24, 71%), but low levels of interactivity (7/24, 29%) and engagement (2/24, 8%). Two overarching themes emerged to guide portal refinements: (1) communication can be improved with directness and interactivity and (2) perceived personalization must be greater to engage patients. Results suggest that simple modifications, such as increased interactivity and personalized messages, can make portals customized, robust, easily accessible, and trusted information sources.</description><subject>Access to Information</subject><subject>Adolescent</subject><subject>Adult</subject><subject>Aged</subject><subject>Ambulatory care</subject><subject>Clinical information</subject><subject>Clinical outcomes</subject><subject>Communication</subject><subject>Consumers</subject><subject>Content analysis</subject><subject>Critical incidents</subject><subject>Design</subject><subject>Electronic Health Records - statistics &amp; numerical data</subject><subject>Female</subject><subject>Focus Groups</subject><subject>Health Communication - methods</subject><subject>Health education</subject><subject>Health information</subject><subject>Health status</subject><subject>Humans</subject><subject>Information sources</subject><subject>Interviews</subject><subject>Laboratories</subject><subject>Male</subject><subject>Medical practices</subject><subject>Medical records</subject><subject>Medical research</subject><subject>Middle Aged</subject><subject>Original Paper</subject><subject>Patient Portals - statistics &amp; numerical data</subject><subject>Patient Protection &amp; Affordable Care Act 2010-US</subject><subject>Patient Protection and Affordable Care Act - statistics &amp; numerical data</subject><subject>Patient-centered care</subject><subject>Patients</subject><subject>Physicians</subject><subject>Preventive medicine</subject><subject>Research methodology</subject><subject>Researchers</subject><subject>Usability</subject><subject>Vigilance</subject><subject>Web portals</subject><subject>Young Adult</subject><issn>1438-8871</issn><issn>1439-4456</issn><issn>1438-8871</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><sourceid>7QJ</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><recordid>eNp9kU1v1DAQhiMEoh9w4A8gSxwohy0Zx06cC1K1WqBSK3qAs-U4k65Xjh1sZ8X-exx1qQoHTmONn3nn4y2KN1BeUmjrj7vRhEvOODwrToFVYiVEA8-fvE-Ksxh3ZUlL1sLL4oQ2IETLq9Pi19U02YNx9-R2tslMFsktpq3vI0merP04Bdyii2aP9kA2e2VnlZAocqeSQZfInQ9J2feRbIYBdcqcw3gsdns8kGs3-DBm2rsle6yLr4oXg7IRXx_jefHj8-b7-uvq5tuX6_XVzUqzCtKq7ZUQnRoagJrWVFcVYK0YBcEq3VBssdOi4RQ6GDrVN6JEpikfNK91LypRnRefHnSnuRux17l3UFZOwYwqHKRXRv7948xW3vu9ZPlwdV1mgYujQPA_Z4xJjiZqtFY59HOU0LTLYYE1GX33D7rzc3B5PUk5UEE5h_J_FOSJKWelaDP14YHSwccYcHgcGUq5uC4X1-XiembfPt3xkfxjc_UbvUmqCA</recordid><startdate>20160517</startdate><enddate>20160517</enddate><creator>Alpert, Jordan M</creator><creator>Krist, Alex H</creator><creator>Aycock, Rebecca A</creator><creator>Kreps, Gary L</creator><general>Gunther Eysenbach MD MPH, Associate Professor</general><general>JMIR Publications Inc</general><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7QJ</scope><scope>E3H</scope><scope>F2A</scope><scope>K9.</scope><scope>NAPCQ</scope><scope>3V.</scope><scope>7RV</scope><scope>7X7</scope><scope>7XB</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ALSLI</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>CCPQU</scope><scope>CNYFK</scope><scope>DWQXO</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>KB0</scope><scope>M0S</scope><scope>M1O</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>7X8</scope><scope>5PM</scope><orcidid>https://orcid.org/0000-0001-5980-129X</orcidid><orcidid>https://orcid.org/0000-0003-4060-9155</orcidid><orcidid>https://orcid.org/0000-0002-4726-4359</orcidid><orcidid>https://orcid.org/0000-0002-7066-4748</orcidid></search><sort><creationdate>20160517</creationdate><title>Applying Multiple Methods to Comprehensively Evaluate a Patient Portal's Effectiveness to Convey Information to Patients</title><author>Alpert, Jordan M ; Krist, Alex H ; Aycock, Rebecca A ; Kreps, Gary L</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c431t-9da88baf7116262c331e6a421843c72e9ebc87521b1fbad780e4c25fc56cd8383</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Access to Information</topic><topic>Adolescent</topic><topic>Adult</topic><topic>Aged</topic><topic>Ambulatory care</topic><topic>Clinical information</topic><topic>Clinical outcomes</topic><topic>Communication</topic><topic>Consumers</topic><topic>Content analysis</topic><topic>Critical incidents</topic><topic>Design</topic><topic>Electronic Health Records - statistics &amp; numerical data</topic><topic>Female</topic><topic>Focus Groups</topic><topic>Health Communication - methods</topic><topic>Health education</topic><topic>Health information</topic><topic>Health status</topic><topic>Humans</topic><topic>Information sources</topic><topic>Interviews</topic><topic>Laboratories</topic><topic>Male</topic><topic>Medical practices</topic><topic>Medical records</topic><topic>Medical research</topic><topic>Middle Aged</topic><topic>Original Paper</topic><topic>Patient Portals - statistics &amp; numerical data</topic><topic>Patient Protection &amp; Affordable Care Act 2010-US</topic><topic>Patient Protection and Affordable Care Act - statistics &amp; numerical data</topic><topic>Patient-centered care</topic><topic>Patients</topic><topic>Physicians</topic><topic>Preventive medicine</topic><topic>Research methodology</topic><topic>Researchers</topic><topic>Usability</topic><topic>Vigilance</topic><topic>Web portals</topic><topic>Young Adult</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Alpert, Jordan M</creatorcontrib><creatorcontrib>Krist, Alex H</creatorcontrib><creatorcontrib>Aycock, Rebecca A</creatorcontrib><creatorcontrib>Kreps, Gary L</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>Applied Social Sciences Index &amp; Abstracts (ASSIA)</collection><collection>Library &amp; Information Sciences Abstracts (LISA)</collection><collection>Library &amp; Information Science Abstracts (LISA)</collection><collection>ProQuest Health &amp; Medical Complete (Alumni)</collection><collection>Nursing &amp; Allied Health Premium</collection><collection>ProQuest Central (Corporate)</collection><collection>Nursing &amp; Allied Health Database</collection><collection>Health &amp; Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Social Science Premium Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>ProQuest One Community College</collection><collection>Library &amp; Information Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>Nursing &amp; Allied Health Database (Alumni Edition)</collection><collection>Health &amp; Medical Collection (Alumni Edition)</collection><collection>Library Science Database</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Journal of medical Internet research</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Alpert, Jordan M</au><au>Krist, Alex H</au><au>Aycock, Rebecca A</au><au>Kreps, Gary L</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Applying Multiple Methods to Comprehensively Evaluate a Patient Portal's Effectiveness to Convey Information to Patients</atitle><jtitle>Journal of medical Internet research</jtitle><addtitle>J Med Internet Res</addtitle><date>2016-05-17</date><risdate>2016</risdate><volume>18</volume><issue>5</issue><spage>e112</spage><epage>e112</epage><pages>e112-e112</pages><issn>1438-8871</issn><issn>1439-4456</issn><eissn>1438-8871</eissn><abstract>Patient portals have yet to achieve their full potential for enhancing health communication and improving health outcomes. Although the Patient Protection and Affordable Care Act in the United States mandates the utilization of patient portals, and usage continues to rise, their impact has not been as profound as anticipated. The objective of our case study was to evaluate how well portals convey information to patients. To demonstrate how multiple methodologies could be used to evaluate and improve the design of patient-centered portals, we conducted an in-depth evaluation of an exemplar patient-centered portal designed to promote preventive care to consumers. We used 31 critical incident patient interviews, 2 clinician focus groups, and a thematic content analysis to understand patients' and clinicians' perspectives, as well as theoretical understandings of the portal's use. We gathered over 140 critical incidents, 71.8% (102/142) negative and 28.2% (40/142) positive. Positive incident categories were (1) instant medical information access, (2) clear health information, and (3) patient vigilance. Negative incident categories were (1) standardized content, (2) desire for direct communication, (3) website functionality, and (4) difficulty interpreting laboratory data. Thematic analysis of the portal's immediacy resulted in high scores in the attributes enhances understanding (18/23, 78%), personalization (18/24, 75%), and motivates behavior (17/24, 71%), but low levels of interactivity (7/24, 29%) and engagement (2/24, 8%). Two overarching themes emerged to guide portal refinements: (1) communication can be improved with directness and interactivity and (2) perceived personalization must be greater to engage patients. Results suggest that simple modifications, such as increased interactivity and personalized messages, can make portals customized, robust, easily accessible, and trusted information sources.</abstract><cop>Canada</cop><pub>Gunther Eysenbach MD MPH, Associate Professor</pub><pmid>27188953</pmid><doi>10.2196/jmir.5451</doi><orcidid>https://orcid.org/0000-0001-5980-129X</orcidid><orcidid>https://orcid.org/0000-0003-4060-9155</orcidid><orcidid>https://orcid.org/0000-0002-4726-4359</orcidid><orcidid>https://orcid.org/0000-0002-7066-4748</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1438-8871
ispartof Journal of medical Internet research, 2016-05, Vol.18 (5), p.e112-e112
issn 1438-8871
1439-4456
1438-8871
language eng
recordid cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_4887660
source MEDLINE; DOAJ Directory of Open Access Journals; PubMed Central Open Access; Applied Social Sciences Index & Abstracts (ASSIA); EZB-FREE-00999 freely available EZB journals; PubMed Central
subjects Access to Information
Adolescent
Adult
Aged
Ambulatory care
Clinical information
Clinical outcomes
Communication
Consumers
Content analysis
Critical incidents
Design
Electronic Health Records - statistics & numerical data
Female
Focus Groups
Health Communication - methods
Health education
Health information
Health status
Humans
Information sources
Interviews
Laboratories
Male
Medical practices
Medical records
Medical research
Middle Aged
Original Paper
Patient Portals - statistics & numerical data
Patient Protection & Affordable Care Act 2010-US
Patient Protection and Affordable Care Act - statistics & numerical data
Patient-centered care
Patients
Physicians
Preventive medicine
Research methodology
Researchers
Usability
Vigilance
Web portals
Young Adult
title Applying Multiple Methods to Comprehensively Evaluate a Patient Portal's Effectiveness to Convey Information to Patients
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T11%3A35%3A12IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Applying%20Multiple%20Methods%20to%20Comprehensively%20Evaluate%20a%20Patient%20Portal's%20Effectiveness%20to%20Convey%20Information%20to%20Patients&rft.jtitle=Journal%20of%20medical%20Internet%20research&rft.au=Alpert,%20Jordan%20M&rft.date=2016-05-17&rft.volume=18&rft.issue=5&rft.spage=e112&rft.epage=e112&rft.pages=e112-e112&rft.issn=1438-8871&rft.eissn=1438-8871&rft_id=info:doi/10.2196/jmir.5451&rft_dat=%3Cproquest_pubme%3E1790020147%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2512825510&rft_id=info:pmid/27188953&rfr_iscdi=true