Performance evaluation of blood glucose monitoring devices

Many new technologies are being applied to measure blood glucose concentrations, but there is a lack of a standardized approach to evaluate performance of these devices. We sought to identify the key elements in evaluating the performance of devices for measuring blood glucose. We examined these ele...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Diabetes technology & therapeutics 2003, Vol.5 (5), p.749-768
Hauptverfasser: Chen, Ellen T, Nichols, James H, Duh, Show-Hong, Hortin, Glen
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 768
container_issue 5
container_start_page 749
container_title Diabetes technology & therapeutics
container_volume 5
creator Chen, Ellen T
Nichols, James H
Duh, Show-Hong
Hortin, Glen
description Many new technologies are being applied to measure blood glucose concentrations, but there is a lack of a standardized approach to evaluate performance of these devices. We sought to identify the key elements in evaluating the performance of devices for measuring blood glucose. We examined these elements in a multicenter study of four brands of glucose meters that are commonly used by diabetic patients. We tested control materials, spiked whole blood specimens, and 461 heparinized whole blood specimens in triplicate by each of the four brand glucose meters, and analyzed the plasma glucose concentrations of these specimens by a hexokinase (HK) method that incorporated reference materials developed by National Institute of Standards and Technology. Testing with glucose meters was performed at three sites, with multiple operators, meters, and representative lots of reagents. We evaluated the systematic bias, random error, and clinical significance of glucose meters. Meters were precise with a coefficient of variation of 0.98 and standard error of estimation S(y/x)
doi_str_mv 10.1089/152091503322526969
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_71399417</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>71399417</sourcerecordid><originalsourceid>FETCH-LOGICAL-c214t-c8329f5e41c6aa72e3600d415c7a8312d772314ba9e3844a097454d8f4b9367a3</originalsourceid><addsrcrecordid>eNplkDtPwzAUhS0EolD4AwwoE1vA19ePmA1VvKRKMMAcOc5NFZTExU4q8e9p1UoMTOcM3znDx9gV8Fvghb0DJbgFxRGFUEJbbY_YGShl8kJZPN51wfMtoWfsPKUvzrlBAadsBlIjooQzdv9OsQmxd4OnjDaum9zYhiELTVZ1IdTZqpt8SJT1YWjHENthldW0aT2lC3bSuC7R5SHn7PPp8WPxki_fnl8XD8vcC5Bj7gsUtlEkwWvnjCDUnNcSlDeuQBC1MQJBVs4SFlI6bo1Usi4aWVnUxuGc3ex_1zF8T5TGsm-Tp65zA4UplQbQWglmC4o96GNIKVJTrmPbu_hTAi93xsr_xraj68P7VPVU_00OivAX-8dkxw</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>71399417</pqid></control><display><type>article</type><title>Performance evaluation of blood glucose monitoring devices</title><source>Mary Ann Liebert Online Subscription</source><source>MEDLINE</source><creator>Chen, Ellen T ; Nichols, James H ; Duh, Show-Hong ; Hortin, Glen</creator><creatorcontrib>Chen, Ellen T ; Nichols, James H ; Duh, Show-Hong ; Hortin, Glen</creatorcontrib><description>Many new technologies are being applied to measure blood glucose concentrations, but there is a lack of a standardized approach to evaluate performance of these devices. We sought to identify the key elements in evaluating the performance of devices for measuring blood glucose. We examined these elements in a multicenter study of four brands of glucose meters that are commonly used by diabetic patients. We tested control materials, spiked whole blood specimens, and 461 heparinized whole blood specimens in triplicate by each of the four brand glucose meters, and analyzed the plasma glucose concentrations of these specimens by a hexokinase (HK) method that incorporated reference materials developed by National Institute of Standards and Technology. Testing with glucose meters was performed at three sites, with multiple operators, meters, and representative lots of reagents. We evaluated the systematic bias, random error, and clinical significance of glucose meters. Meters were precise with a coefficient of variation of &lt;4% across a wide range of glucose concentrations. Slopes significantly different from 1.0 were observed for two meters with 11-13% and -11% to -13% at the 95% confidence interval level by the linear regression of meter results versus the HK method from 33 to 481 mg/dL (correlation coefficient &gt;0.98 and standard error of estimation S(y/x) &lt;13 mg/dL for both meters). Analysis of the clinical significance of bias by Clarke Error Grid showed that results of the four meters were outside the accurate zone (26.5%, 2.4%, 1.5%, and 5.6%). Only a small number of the results showed clinically significant bias, mostly in the hypoglycemic range. Meters performed consistently throughout the study and, generally, were precise, although precision varied at extremely high or low glucose concentrations. Two of the glucose meters had substantial systematic bias when compared with an HK method, indicating a need for improving calibration and standardization. Analytical performance varied over the physiological range of glucose values so that separate accuracy and precision goals should be defined for hypoglycemic, normoglycemic, and hyperglycemic ranges. This study describes the current state of performance of blood glucose monitoring devices and points out those factors that should be assessed during evaluation of new devices.</description><identifier>ISSN: 1520-9156</identifier><identifier>EISSN: 1557-8593</identifier><identifier>DOI: 10.1089/152091503322526969</identifier><identifier>PMID: 14633341</identifier><language>eng</language><publisher>United States</publisher><subject>Blood Chemical Analysis - instrumentation ; Blood Chemical Analysis - standards ; Blood Chemical Analysis - statistics &amp; numerical data ; Blood Glucose - analysis ; Chromatography, Gas ; Evaluation Studies as Topic ; Humans ; Linear Models ; Quality Control ; Reference Values ; Reproducibility of Results ; Sensitivity and Specificity ; United States ; United States Food and Drug Administration</subject><ispartof>Diabetes technology &amp; therapeutics, 2003, Vol.5 (5), p.749-768</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c214t-c8329f5e41c6aa72e3600d415c7a8312d772314ba9e3844a097454d8f4b9367a3</citedby><cites>FETCH-LOGICAL-c214t-c8329f5e41c6aa72e3600d415c7a8312d772314ba9e3844a097454d8f4b9367a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>315,782,786,3044,4026,27930,27931,27932</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/14633341$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Chen, Ellen T</creatorcontrib><creatorcontrib>Nichols, James H</creatorcontrib><creatorcontrib>Duh, Show-Hong</creatorcontrib><creatorcontrib>Hortin, Glen</creatorcontrib><title>Performance evaluation of blood glucose monitoring devices</title><title>Diabetes technology &amp; therapeutics</title><addtitle>Diabetes Technol Ther</addtitle><description>Many new technologies are being applied to measure blood glucose concentrations, but there is a lack of a standardized approach to evaluate performance of these devices. We sought to identify the key elements in evaluating the performance of devices for measuring blood glucose. We examined these elements in a multicenter study of four brands of glucose meters that are commonly used by diabetic patients. We tested control materials, spiked whole blood specimens, and 461 heparinized whole blood specimens in triplicate by each of the four brand glucose meters, and analyzed the plasma glucose concentrations of these specimens by a hexokinase (HK) method that incorporated reference materials developed by National Institute of Standards and Technology. Testing with glucose meters was performed at three sites, with multiple operators, meters, and representative lots of reagents. We evaluated the systematic bias, random error, and clinical significance of glucose meters. Meters were precise with a coefficient of variation of &lt;4% across a wide range of glucose concentrations. Slopes significantly different from 1.0 were observed for two meters with 11-13% and -11% to -13% at the 95% confidence interval level by the linear regression of meter results versus the HK method from 33 to 481 mg/dL (correlation coefficient &gt;0.98 and standard error of estimation S(y/x) &lt;13 mg/dL for both meters). Analysis of the clinical significance of bias by Clarke Error Grid showed that results of the four meters were outside the accurate zone (26.5%, 2.4%, 1.5%, and 5.6%). Only a small number of the results showed clinically significant bias, mostly in the hypoglycemic range. Meters performed consistently throughout the study and, generally, were precise, although precision varied at extremely high or low glucose concentrations. Two of the glucose meters had substantial systematic bias when compared with an HK method, indicating a need for improving calibration and standardization. Analytical performance varied over the physiological range of glucose values so that separate accuracy and precision goals should be defined for hypoglycemic, normoglycemic, and hyperglycemic ranges. This study describes the current state of performance of blood glucose monitoring devices and points out those factors that should be assessed during evaluation of new devices.</description><subject>Blood Chemical Analysis - instrumentation</subject><subject>Blood Chemical Analysis - standards</subject><subject>Blood Chemical Analysis - statistics &amp; numerical data</subject><subject>Blood Glucose - analysis</subject><subject>Chromatography, Gas</subject><subject>Evaluation Studies as Topic</subject><subject>Humans</subject><subject>Linear Models</subject><subject>Quality Control</subject><subject>Reference Values</subject><subject>Reproducibility of Results</subject><subject>Sensitivity and Specificity</subject><subject>United States</subject><subject>United States Food and Drug Administration</subject><issn>1520-9156</issn><issn>1557-8593</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2003</creationdate><recordtype>article</recordtype><sourceid>EIF</sourceid><recordid>eNplkDtPwzAUhS0EolD4AwwoE1vA19ePmA1VvKRKMMAcOc5NFZTExU4q8e9p1UoMTOcM3znDx9gV8Fvghb0DJbgFxRGFUEJbbY_YGShl8kJZPN51wfMtoWfsPKUvzrlBAadsBlIjooQzdv9OsQmxd4OnjDaum9zYhiELTVZ1IdTZqpt8SJT1YWjHENthldW0aT2lC3bSuC7R5SHn7PPp8WPxki_fnl8XD8vcC5Bj7gsUtlEkwWvnjCDUnNcSlDeuQBC1MQJBVs4SFlI6bo1Usi4aWVnUxuGc3ex_1zF8T5TGsm-Tp65zA4UplQbQWglmC4o96GNIKVJTrmPbu_hTAi93xsr_xraj68P7VPVU_00OivAX-8dkxw</recordid><startdate>2003</startdate><enddate>2003</enddate><creator>Chen, Ellen T</creator><creator>Nichols, James H</creator><creator>Duh, Show-Hong</creator><creator>Hortin, Glen</creator><scope>CGR</scope><scope>CUY</scope><scope>CVF</scope><scope>ECM</scope><scope>EIF</scope><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope></search><sort><creationdate>2003</creationdate><title>Performance evaluation of blood glucose monitoring devices</title><author>Chen, Ellen T ; Nichols, James H ; Duh, Show-Hong ; Hortin, Glen</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c214t-c8329f5e41c6aa72e3600d415c7a8312d772314ba9e3844a097454d8f4b9367a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2003</creationdate><topic>Blood Chemical Analysis - instrumentation</topic><topic>Blood Chemical Analysis - standards</topic><topic>Blood Chemical Analysis - statistics &amp; numerical data</topic><topic>Blood Glucose - analysis</topic><topic>Chromatography, Gas</topic><topic>Evaluation Studies as Topic</topic><topic>Humans</topic><topic>Linear Models</topic><topic>Quality Control</topic><topic>Reference Values</topic><topic>Reproducibility of Results</topic><topic>Sensitivity and Specificity</topic><topic>United States</topic><topic>United States Food and Drug Administration</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chen, Ellen T</creatorcontrib><creatorcontrib>Nichols, James H</creatorcontrib><creatorcontrib>Duh, Show-Hong</creatorcontrib><creatorcontrib>Hortin, Glen</creatorcontrib><collection>Medline</collection><collection>MEDLINE</collection><collection>MEDLINE (Ovid)</collection><collection>MEDLINE</collection><collection>MEDLINE</collection><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><jtitle>Diabetes technology &amp; therapeutics</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Ellen T</au><au>Nichols, James H</au><au>Duh, Show-Hong</au><au>Hortin, Glen</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Performance evaluation of blood glucose monitoring devices</atitle><jtitle>Diabetes technology &amp; therapeutics</jtitle><addtitle>Diabetes Technol Ther</addtitle><date>2003</date><risdate>2003</risdate><volume>5</volume><issue>5</issue><spage>749</spage><epage>768</epage><pages>749-768</pages><issn>1520-9156</issn><eissn>1557-8593</eissn><abstract>Many new technologies are being applied to measure blood glucose concentrations, but there is a lack of a standardized approach to evaluate performance of these devices. We sought to identify the key elements in evaluating the performance of devices for measuring blood glucose. We examined these elements in a multicenter study of four brands of glucose meters that are commonly used by diabetic patients. We tested control materials, spiked whole blood specimens, and 461 heparinized whole blood specimens in triplicate by each of the four brand glucose meters, and analyzed the plasma glucose concentrations of these specimens by a hexokinase (HK) method that incorporated reference materials developed by National Institute of Standards and Technology. Testing with glucose meters was performed at three sites, with multiple operators, meters, and representative lots of reagents. We evaluated the systematic bias, random error, and clinical significance of glucose meters. Meters were precise with a coefficient of variation of &lt;4% across a wide range of glucose concentrations. Slopes significantly different from 1.0 were observed for two meters with 11-13% and -11% to -13% at the 95% confidence interval level by the linear regression of meter results versus the HK method from 33 to 481 mg/dL (correlation coefficient &gt;0.98 and standard error of estimation S(y/x) &lt;13 mg/dL for both meters). Analysis of the clinical significance of bias by Clarke Error Grid showed that results of the four meters were outside the accurate zone (26.5%, 2.4%, 1.5%, and 5.6%). Only a small number of the results showed clinically significant bias, mostly in the hypoglycemic range. Meters performed consistently throughout the study and, generally, were precise, although precision varied at extremely high or low glucose concentrations. Two of the glucose meters had substantial systematic bias when compared with an HK method, indicating a need for improving calibration and standardization. Analytical performance varied over the physiological range of glucose values so that separate accuracy and precision goals should be defined for hypoglycemic, normoglycemic, and hyperglycemic ranges. This study describes the current state of performance of blood glucose monitoring devices and points out those factors that should be assessed during evaluation of new devices.</abstract><cop>United States</cop><pmid>14633341</pmid><doi>10.1089/152091503322526969</doi><tpages>20</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1520-9156
ispartof Diabetes technology & therapeutics, 2003, Vol.5 (5), p.749-768
issn 1520-9156
1557-8593
language eng
recordid cdi_proquest_miscellaneous_71399417
source Mary Ann Liebert Online Subscription; MEDLINE
subjects Blood Chemical Analysis - instrumentation
Blood Chemical Analysis - standards
Blood Chemical Analysis - statistics & numerical data
Blood Glucose - analysis
Chromatography, Gas
Evaluation Studies as Topic
Humans
Linear Models
Quality Control
Reference Values
Reproducibility of Results
Sensitivity and Specificity
United States
United States Food and Drug Administration
title Performance evaluation of blood glucose monitoring devices
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-04T23%3A47%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Performance%20evaluation%20of%20blood%20glucose%20monitoring%20devices&rft.jtitle=Diabetes%20technology%20&%20therapeutics&rft.au=Chen,%20Ellen%20T&rft.date=2003&rft.volume=5&rft.issue=5&rft.spage=749&rft.epage=768&rft.pages=749-768&rft.issn=1520-9156&rft.eissn=1557-8593&rft_id=info:doi/10.1089/152091503322526969&rft_dat=%3Cproquest_cross%3E71399417%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=71399417&rft_id=info:pmid/14633341&rfr_iscdi=true