Perhaps There Is Accounting for Taste: Evaluating the Creativity of Products

Ratings on a creativity rating scale of students' designs of a hands-free mobile phone holder were compared for 2 sets of raters: experts (professional art teachers) and novices (visual art students). Reliabilities of total creativity scores were high for both groups, and interjudge consistency on total creativity scores, as well as on grades, was high among novices, but not as high among experts. Correlations between grades and total functional creativity scores within and across groups of raters (experts and novices) were highly significant. Scores on the scale resembled those yielded by assessments using grades and the scale did not yield better consistency among judges than conventional grades. Nonetheless, it provided a differentiated assessment of products that made it possible to explain the basis of experts' opinions and the reasons for disagreement, and to discuss the strengths and weaknesses of students' designs in a systematic and differentiated way.