Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium

Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' cri...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:International Journal of Instruction 2018-07, Vol.11 (3), p.557-572
Hauptverfasser: Sadhu, Satya, Laksono, Endang W
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 572
container_issue 3
container_start_page 557
container_title International Journal of Instruction
container_volume 11
creator Sadhu, Satya
Laksono, Endang W
description Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.
doi_str_mv 10.12973/iji.2018.11338a
format Article
fullrecord <record><control><sourceid>eric_cross</sourceid><recordid>TN_cdi_eric_primary_EJ1183420</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1183420</ericid><sourcerecordid>EJ1183420</sourcerecordid><originalsourceid>FETCH-LOGICAL-c307t-84a838eab5954f6bba13ff7acd8b9495fc971240a1af8fb2039db94cad57c76e3</originalsourceid><addsrcrecordid>eNpFkD1PwzAURS0EElXpzoLkP5Bix07sjFUoUFTEUhBb9OLY7YN8gJ0ideeHk7YIpvd07tUdDiGXnE15nClxjW84jRnXU86F0HBCRlwwHXGp2Onwp5mMUpa9npNJCFgyKZXkTMkR-b6xX7buPhrb9hTair5AjRX02LW0cwOhi7a3aw-9regsBBvCoeo6Tx8thK3Hdk1zjz0aqOlqg-37nuyn8o1tDnSJvfVgdhTbfzj_3GKNpcdtc0HOHNTBTn7vmDzfzlf5fbR8ulvks2VkBFN9pCVooS2USZZIl5YlcOGcAlPpMpNZ4kymeCwZcHDalTETWTUEBqpEGZVaMSZXx13r0RQfHhvwu2L-wLkWcqiPCTvmxncheOv-OpwVB9HFILrYiy6OosUPKoFzwA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</title><source>ERIC - Full Text Only (Discovery)</source><source>Education Source</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Sadhu, Satya ; Laksono, Endang W</creator><creatorcontrib>Sadhu, Satya ; Laksono, Endang W ; Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id ; Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</creatorcontrib><description>Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.</description><identifier>ISSN: 1694-609X</identifier><identifier>EISSN: 1308-1470</identifier><identifier>DOI: 10.12973/iji.2018.11338a</identifier><language>eng</language><publisher>International Journal of Instruction</publisher><subject>Chemistry ; Construct Validity ; Correlation ; Critical Thinking ; Difficulty Level ; Expertise ; Factor Analysis ; Foreign Countries ; Grade 12 ; High School Students ; Integrated Activities ; Item Response Theory ; Measures (Individuals) ; Scientific Literacy ; Secondary School Science ; Test Construction ; Test Items ; Thinking Skills</subject><ispartof>International Journal of Instruction, 2018-07, Vol.11 (3), p.557-572</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c307t-84a838eab5954f6bba13ff7acd8b9495fc971240a1af8fb2039db94cad57c76e3</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,687,776,780,881,27901,27902</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1183420$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Sadhu, Satya</creatorcontrib><creatorcontrib>Laksono, Endang W</creatorcontrib><creatorcontrib>Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id</creatorcontrib><creatorcontrib>Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</creatorcontrib><title>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</title><title>International Journal of Instruction</title><description>Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.</description><subject>Chemistry</subject><subject>Construct Validity</subject><subject>Correlation</subject><subject>Critical Thinking</subject><subject>Difficulty Level</subject><subject>Expertise</subject><subject>Factor Analysis</subject><subject>Foreign Countries</subject><subject>Grade 12</subject><subject>High School Students</subject><subject>Integrated Activities</subject><subject>Item Response Theory</subject><subject>Measures (Individuals)</subject><subject>Scientific Literacy</subject><subject>Secondary School Science</subject><subject>Test Construction</subject><subject>Test Items</subject><subject>Thinking Skills</subject><issn>1694-609X</issn><issn>1308-1470</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>GA5</sourceid><recordid>eNpFkD1PwzAURS0EElXpzoLkP5Bix07sjFUoUFTEUhBb9OLY7YN8gJ0ideeHk7YIpvd07tUdDiGXnE15nClxjW84jRnXU86F0HBCRlwwHXGp2Onwp5mMUpa9npNJCFgyKZXkTMkR-b6xX7buPhrb9hTair5AjRX02LW0cwOhi7a3aw-9regsBBvCoeo6Tx8thK3Hdk1zjz0aqOlqg-37nuyn8o1tDnSJvfVgdhTbfzj_3GKNpcdtc0HOHNTBTn7vmDzfzlf5fbR8ulvks2VkBFN9pCVooS2USZZIl5YlcOGcAlPpMpNZ4kymeCwZcHDalTETWTUEBqpEGZVaMSZXx13r0RQfHhvwu2L-wLkWcqiPCTvmxncheOv-OpwVB9HFILrYiy6OosUPKoFzwA</recordid><startdate>20180701</startdate><enddate>20180701</enddate><creator>Sadhu, Satya</creator><creator>Laksono, Endang W</creator><general>International Journal of Instruction</general><scope>AAYXX</scope><scope>CITATION</scope><scope>ERI</scope><scope>GA5</scope></search><sort><creationdate>20180701</creationdate><title>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</title><author>Sadhu, Satya ; Laksono, Endang W</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c307t-84a838eab5954f6bba13ff7acd8b9495fc971240a1af8fb2039db94cad57c76e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Chemistry</topic><topic>Construct Validity</topic><topic>Correlation</topic><topic>Critical Thinking</topic><topic>Difficulty Level</topic><topic>Expertise</topic><topic>Factor Analysis</topic><topic>Foreign Countries</topic><topic>Grade 12</topic><topic>High School Students</topic><topic>Integrated Activities</topic><topic>Item Response Theory</topic><topic>Measures (Individuals)</topic><topic>Scientific Literacy</topic><topic>Secondary School Science</topic><topic>Test Construction</topic><topic>Test Items</topic><topic>Thinking Skills</topic><toplevel>online_resources</toplevel><creatorcontrib>Sadhu, Satya</creatorcontrib><creatorcontrib>Laksono, Endang W</creatorcontrib><creatorcontrib>Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id</creatorcontrib><creatorcontrib>Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</creatorcontrib><collection>CrossRef</collection><collection>ERIC</collection><collection>ERIC - Full Text Only (Discovery)</collection><jtitle>International Journal of Instruction</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sadhu, Satya</au><au>Laksono, Endang W</au><aucorp>Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id</aucorp><aucorp>Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1183420</ericid><atitle>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</atitle><jtitle>International Journal of Instruction</jtitle><date>2018-07-01</date><risdate>2018</risdate><volume>11</volume><issue>3</issue><spage>557</spage><epage>572</epage><pages>557-572</pages><issn>1694-609X</issn><eissn>1308-1470</eissn><abstract>Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.</abstract><pub>International Journal of Instruction</pub><doi>10.12973/iji.2018.11338a</doi><tpages>16</tpages><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 1694-609X
ispartof International Journal of Instruction, 2018-07, Vol.11 (3), p.557-572
issn 1694-609X
1308-1470
language eng
recordid cdi_eric_primary_EJ1183420
source ERIC - Full Text Only (Discovery); Education Source; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals
subjects Chemistry
Construct Validity
Correlation
Critical Thinking
Difficulty Level
Expertise
Factor Analysis
Foreign Countries
Grade 12
High School Students
Integrated Activities
Item Response Theory
Measures (Individuals)
Scientific Literacy
Secondary School Science
Test Construction
Test Items
Thinking Skills
title Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T23%3A47%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-eric_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Development%20and%20Validation%20of%20an%20Integrated%20Assessment%20for%20Measuring%20Critical%20Thinking%20and%20Chemical%20Literacy%20in%20Chemical%20Equilibrium&rft.jtitle=International%20Journal%20of%20Instruction&rft.au=Sadhu,%20Satya&rft.aucorp=Assoc.%20Prof.,%20Department%20of%20Chemistry%20Education,%20Faculty%20of%20Mathematics%20and%20Science,%20Yogyakarta%20State%20University,%20Indonesia,%20endang_widjajanti@uny.ac.id&rft.date=2018-07-01&rft.volume=11&rft.issue=3&rft.spage=557&rft.epage=572&rft.pages=557-572&rft.issn=1694-609X&rft.eissn=1308-1470&rft_id=info:doi/10.12973/iji.2018.11338a&rft_dat=%3Ceric_cross%3EEJ1183420%3C/eric_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ericid=EJ1183420&rfr_iscdi=true