This book describes the process that takes a researcher from identifying a human–computer interaction (HCI) research idea that needs to be tested, to designing and conducting a test, and then analysing and reporting the results. This first chapter introduces the notion of an “HCI idea” and different approaches to testing.

Assessing the worth of an HCI idea

Imagine that you have an HCI idea, for example, a novel interaction method, a new way of visualising data, an innovative device for moving a cursor, or a new interactive system for building games. You can implement it, demonstrate it to a wide range of people, and even deploy it for use – but is it a “good” idea? Will the interaction method assist users with their tasks? Will the visualisation make it easier to spot data trends? Will the new device make cursor movement quicker? Will users like the new game building system?

It is your idea, so of course you believe that it is wonderful; however, your subjective judgement (or even the views of your friends in the research laboratory) is not sufficient to prove its general worth. An objective evaluation of the idea (using people not involved in the research) is required. As Zhai (2003) says in his controversial article, “Evaluation is the worst form of HCI research except all those other forms that have been tried,” the true value of the idea cannot be determined simply by “subjective opinion, authority, intimidation, fashion or fad.”