Timedora

Planning a Concept Evaluation

A practical framework for planning concept evaluations around decisions, appropriate participants and prototypes, realistic tasks, clear success criteria, and useful evidence.

From Decision to Evidence

Start with the decision

Concept testing asks whether an idea meets its requirements and works for the people it is intended to serve. It is not only a final check: early, repeated evaluation can reveal misunderstandings, usability problems, and unmet needs while changes are still less costly.

Begin by stating what the team needs to decide. Turn that decision into a question that observation or measurement can answer. For example, “Can new users find the emergency shutoff?” gives the evaluation a clearer focus than “Do people like the design?” Then identify the requirements and assumptions that matter, such as ease of use, safety, accessibility, durability, or cost.

Match the plan to the question

For each question, choose participants whose experience reflects the people who may use, operate, maintain, or be affected by the concept. Include relevant differences in ability and context. Select a prototype realistic enough to test the issue: a paper interface can expose confusing labels, but it cannot show whether a physical latch withstands repeated use.

Give participants a believable task without coaching them through it. The prompt “You need to stop the machine before clearing a jam” can test whether the emergency control is discoverable. Before testing, decide what counts as success—for example, completing the task without help or choosing the correct control.

Finally, choose evidence that fits the question: task completion, errors, time, questions, comments, or physical performance may be useful. Decide how it will be recorded, and obtain consent before recording. The central check is alignment: the participants, prototype, task, , and evidence should all help answer the team’s decision question.

  • : A question that can be answered through planned observation or measurement.