Establishing Parallel Forms: Reliability of Two New Tasks on the Children’s Kitchen Task Assessment (CKTA)

PURPOSE: Executive function (EF) is a set of cognitive processes that impacts a child's ability to self-monitor and self-regulate in support of purposeful, goal-directed and problem-solving behavior. The most commonly used assessment tools that measure EF in children do not include direct observation of age-appropriate, functional tasks. To address this gap, the Children's Kitchen Task Assessment (CKTA) provides evaluators with the chance to observe children performing a recipe task using familiar items. However, because the CKTA includes only one task (playdough), it ideally cannot be used to measure changes in EF since task novelty is essential to assessment of EF. Thus, there is a need for more tasks to enable therapists to document outcomes of interventions targeting EF. To address this issue, two new tasks, chocolate popcorn and mug cake, have been developed. The present study examined the parallelism of all three tasks to determine if the new tasks may be implemented as valid additions to the CKTA set of tasks. DESIGN: The current study utilized a quasi-experimental repeated-measures design to determine if there was adequate parallel forms reliability between the three tasks of the CKTA. PARTICIPANTS: This convenience sample of eleven children (7-10 years; 55% female/45% male; & 45% African American & 55% Caucasian) were recruited through local afterschool programs. The primary study inclusion criteria were age (7-12 years), child assent, and parental consent to participate. Data on demographics, previous cooking experience, and basic reading ability were gathered, but children were not excluded based on this information, nor due to disability. METHOD: Children were assessed on the three tasks presented in random order at their afterschool sites. Children's performance on the tasks was assessed via the number & level of cue needed for successful completion of each recipe step (fewer cues = higher EF). Each child's performance was videotaped & rated by a second rater. The average of the two scores was calculated & converted into a percentage score (since tasks had slightly different number of steps in the recipes). The data was analyzed using a spearman's rho correlation to determine the relationship between individual participant scores on the mug cake & chocolate popcorn tasks compared to the established playdough task. Follow up analysis using spearman's correlations examined order effects and age impacts on CKTA scores. RESULTS: Participants' scor