Marionette prototyping for evaluating conceptual ubicomp applications in their context

There are many methods for the evaluation of ubiquitous computing (ubicomp) applications. These evaluations usually require an autonomous system, or use scenarios or storyboards instead. We suggest Marionette Prototyping as a technique for ubicomp applications that can be used early in the design process. It allows participants to use a conceptual ubicomp application in a real-world context, followed by an evaluation that covers the participants understanding, experience and attitude with regard to the application. Marionette Prototyping is inspired by puppetry, especially the styles where the manipulator is in plain view. It combines principles from cardboard prototyping and Wizard-of-Oz and uses off-the-shelf tools and technology. We have used Marionette Prototyping in the evaluation of a ubicomp application. This evaluation has shown that Marionette Prototyping provides input on the understanding, experience and attitude of the user with regard to the ubicomp application in question. From this first step, we can continue to develop this method as a technique for early, in context evaluation of ubicomp applications. In this, Marionette Prototyping can overcome some of the issues with current evaluation methods for ubicomp applications