Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium
Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' cri...
Gespeichert in:
Veröffentlicht in: | International Journal of Instruction 2018-07, Vol.11 (3), p.557-572 |
---|---|
Hauptverfasser: | , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 572 |
---|---|
container_issue | 3 |
container_start_page | 557 |
container_title | International Journal of Instruction |
container_volume | 11 |
creator | Sadhu, Satya Laksono, Endang W |
description | Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium. |
doi_str_mv | 10.12973/iji.2018.11338a |
format | Article |
fullrecord | <record><control><sourceid>eric_cross</sourceid><recordid>TN_cdi_eric_primary_EJ1183420</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ericid>EJ1183420</ericid><sourcerecordid>EJ1183420</sourcerecordid><originalsourceid>FETCH-LOGICAL-c307t-84a838eab5954f6bba13ff7acd8b9495fc971240a1af8fb2039db94cad57c76e3</originalsourceid><addsrcrecordid>eNpFkD1PwzAURS0EElXpzoLkP5Bix07sjFUoUFTEUhBb9OLY7YN8gJ0ideeHk7YIpvd07tUdDiGXnE15nClxjW84jRnXU86F0HBCRlwwHXGp2Onwp5mMUpa9npNJCFgyKZXkTMkR-b6xX7buPhrb9hTair5AjRX02LW0cwOhi7a3aw-9regsBBvCoeo6Tx8thK3Hdk1zjz0aqOlqg-37nuyn8o1tDnSJvfVgdhTbfzj_3GKNpcdtc0HOHNTBTn7vmDzfzlf5fbR8ulvks2VkBFN9pCVooS2USZZIl5YlcOGcAlPpMpNZ4kymeCwZcHDalTETWTUEBqpEGZVaMSZXx13r0RQfHhvwu2L-wLkWcqiPCTvmxncheOv-OpwVB9HFILrYiy6OosUPKoFzwA</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</title><source>ERIC - Full Text Only (Discovery)</source><source>Education Source</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><creator>Sadhu, Satya ; Laksono, Endang W</creator><creatorcontrib>Sadhu, Satya ; Laksono, Endang W ; Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id ; Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</creatorcontrib><description>Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.</description><identifier>ISSN: 1694-609X</identifier><identifier>EISSN: 1308-1470</identifier><identifier>DOI: 10.12973/iji.2018.11338a</identifier><language>eng</language><publisher>International Journal of Instruction</publisher><subject>Chemistry ; Construct Validity ; Correlation ; Critical Thinking ; Difficulty Level ; Expertise ; Factor Analysis ; Foreign Countries ; Grade 12 ; High School Students ; Integrated Activities ; Item Response Theory ; Measures (Individuals) ; Scientific Literacy ; Secondary School Science ; Test Construction ; Test Items ; Thinking Skills</subject><ispartof>International Journal of Instruction, 2018-07, Vol.11 (3), p.557-572</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c307t-84a838eab5954f6bba13ff7acd8b9495fc971240a1af8fb2039db94cad57c76e3</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>230,314,687,776,780,881,27901,27902</link.rule.ids><backlink>$$Uhttp://eric.ed.gov/ERICWebPortal/detail?accno=EJ1183420$$DView record in ERIC$$Hfree_for_read</backlink></links><search><creatorcontrib>Sadhu, Satya</creatorcontrib><creatorcontrib>Laksono, Endang W</creatorcontrib><creatorcontrib>Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id</creatorcontrib><creatorcontrib>Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</creatorcontrib><title>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</title><title>International Journal of Instruction</title><description>Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.</description><subject>Chemistry</subject><subject>Construct Validity</subject><subject>Correlation</subject><subject>Critical Thinking</subject><subject>Difficulty Level</subject><subject>Expertise</subject><subject>Factor Analysis</subject><subject>Foreign Countries</subject><subject>Grade 12</subject><subject>High School Students</subject><subject>Integrated Activities</subject><subject>Item Response Theory</subject><subject>Measures (Individuals)</subject><subject>Scientific Literacy</subject><subject>Secondary School Science</subject><subject>Test Construction</subject><subject>Test Items</subject><subject>Thinking Skills</subject><issn>1694-609X</issn><issn>1308-1470</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>GA5</sourceid><recordid>eNpFkD1PwzAURS0EElXpzoLkP5Bix07sjFUoUFTEUhBb9OLY7YN8gJ0ideeHk7YIpvd07tUdDiGXnE15nClxjW84jRnXU86F0HBCRlwwHXGp2Onwp5mMUpa9npNJCFgyKZXkTMkR-b6xX7buPhrb9hTair5AjRX02LW0cwOhi7a3aw-9regsBBvCoeo6Tx8thK3Hdk1zjz0aqOlqg-37nuyn8o1tDnSJvfVgdhTbfzj_3GKNpcdtc0HOHNTBTn7vmDzfzlf5fbR8ulvks2VkBFN9pCVooS2USZZIl5YlcOGcAlPpMpNZ4kymeCwZcHDalTETWTUEBqpEGZVaMSZXx13r0RQfHhvwu2L-wLkWcqiPCTvmxncheOv-OpwVB9HFILrYiy6OosUPKoFzwA</recordid><startdate>20180701</startdate><enddate>20180701</enddate><creator>Sadhu, Satya</creator><creator>Laksono, Endang W</creator><general>International Journal of Instruction</general><scope>AAYXX</scope><scope>CITATION</scope><scope>ERI</scope><scope>GA5</scope></search><sort><creationdate>20180701</creationdate><title>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</title><author>Sadhu, Satya ; Laksono, Endang W</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c307t-84a838eab5954f6bba13ff7acd8b9495fc971240a1af8fb2039db94cad57c76e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Chemistry</topic><topic>Construct Validity</topic><topic>Correlation</topic><topic>Critical Thinking</topic><topic>Difficulty Level</topic><topic>Expertise</topic><topic>Factor Analysis</topic><topic>Foreign Countries</topic><topic>Grade 12</topic><topic>High School Students</topic><topic>Integrated Activities</topic><topic>Item Response Theory</topic><topic>Measures (Individuals)</topic><topic>Scientific Literacy</topic><topic>Secondary School Science</topic><topic>Test Construction</topic><topic>Test Items</topic><topic>Thinking Skills</topic><toplevel>online_resources</toplevel><creatorcontrib>Sadhu, Satya</creatorcontrib><creatorcontrib>Laksono, Endang W</creatorcontrib><creatorcontrib>Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id</creatorcontrib><creatorcontrib>Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</creatorcontrib><collection>CrossRef</collection><collection>ERIC</collection><collection>ERIC - Full Text Only (Discovery)</collection><jtitle>International Journal of Instruction</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sadhu, Satya</au><au>Laksono, Endang W</au><aucorp>Assoc. Prof., Department of Chemistry Education, Faculty of Mathematics and Science, Yogyakarta State University, Indonesia, endang_widjajanti@uny.ac.id</aucorp><aucorp>Department of Chemistry Education, Post Graduate Programme, Yogyakarta State University, Indonesia, satya0185pasca2016@student.uny.ac.id</aucorp><format>journal</format><genre>article</genre><ristype>JOUR</ristype><ericid>EJ1183420</ericid><atitle>Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium</atitle><jtitle>International Journal of Instruction</jtitle><date>2018-07-01</date><risdate>2018</risdate><volume>11</volume><issue>3</issue><spage>557</spage><epage>572</epage><pages>557-572</pages><issn>1694-609X</issn><eissn>1308-1470</eissn><abstract>Although the development of critical thinking and chemical literacy is a major goal of science education, the adequate emphasis has not been given to the measurement of both skills. This study reports the development and validation of an integrated assessment instrument to measure students' critical thinking skill and chemical literacy together in chemical equilibrium. The development of the framework in this study was implemented based on 4-D model. The stage of development begins with define, design, develop, and disseminate. The initial integrated assessment consisted of 37 open-ended two-tier multiple-choice question items. The preliminary version of the integrated assessment was initially piloted on review with experts and the paper-pencil test was administered to a group of students. The data were analyzed using Item Response Theory (IRT). Analysis factor was involved to find out the construct validity and strengthen the finding of content validity with the experts. In additionally, PCM 1-PL model was conducted to examine the quality of parameter estimates of the test items. The findings of the content validity, construct validity and quality of the items, overall suggest that the integrated assessment has relatively high validity and reliability and can be used for measuring the 13 integrated skills can be measured in chemical equilibrium.</abstract><pub>International Journal of Instruction</pub><doi>10.12973/iji.2018.11338a</doi><tpages>16</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1694-609X |
ispartof | International Journal of Instruction, 2018-07, Vol.11 (3), p.557-572 |
issn | 1694-609X 1308-1470 |
language | eng |
recordid | cdi_eric_primary_EJ1183420 |
source | ERIC - Full Text Only (Discovery); Education Source; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals |
subjects | Chemistry Construct Validity Correlation Critical Thinking Difficulty Level Expertise Factor Analysis Foreign Countries Grade 12 High School Students Integrated Activities Item Response Theory Measures (Individuals) Scientific Literacy Secondary School Science Test Construction Test Items Thinking Skills |
title | Development and Validation of an Integrated Assessment for Measuring Critical Thinking and Chemical Literacy in Chemical Equilibrium |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-01T23%3A47%3A47IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-eric_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Development%20and%20Validation%20of%20an%20Integrated%20Assessment%20for%20Measuring%20Critical%20Thinking%20and%20Chemical%20Literacy%20in%20Chemical%20Equilibrium&rft.jtitle=International%20Journal%20of%20Instruction&rft.au=Sadhu,%20Satya&rft.aucorp=Assoc.%20Prof.,%20Department%20of%20Chemistry%20Education,%20Faculty%20of%20Mathematics%20and%20Science,%20Yogyakarta%20State%20University,%20Indonesia,%20endang_widjajanti@uny.ac.id&rft.date=2018-07-01&rft.volume=11&rft.issue=3&rft.spage=557&rft.epage=572&rft.pages=557-572&rft.issn=1694-609X&rft.eissn=1308-1470&rft_id=info:doi/10.12973/iji.2018.11338a&rft_dat=%3Ceric_cross%3EEJ1183420%3C/eric_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ericid=EJ1183420&rfr_iscdi=true |