RUŌOD Lab

Level 8 · Performance Engineering and Evaluation

Consumer Testing: Study Guide

Read our consumer testing guide, then draft a small questionnaire and critique it for leading questions, poor scales and the wrong people before you use it.

Advanced 15 min study By the RUŌOD Lab team Updated

In short

Consumer testing asks real or representative users what they like. It is separate from trained evaluation, as the reference guide explains, along with methods and sample sizes. This study guide has you draft and critique a questionnaire, which is usually where a small test goes wrong.

What you will learn

  • Draft a neutral fragrance questionnaire
  • Identify what a small test can and cannot say about a market

Before this lesson: Evaluation Bias: How You Fool Yourself

What to look for as you read

  • The difference between who is convenient and who is your market.
  • Which question types suit which decisions.
  • What the guide says about sample size and how to read a small result.

Practical exercise: Draft and critique a questionnaire

About 30 minutes · You will have: a one-page questionnaire and a written critique of its weak points

  1. Write the decision this test should inform, in one sentence.
  2. Write who should answer, and how you would find them.
  3. Draft up to six neutral questions, including a balanced liking scale.
  4. Critique your own draft. Mark any leading wording, any question that nobody could answer, and anything that assumes the answer.
  5. State what result would change your decision.

You have done this well if each question feeds your decision. Do not ask anyone to wear a sample unless the formula has been properly assessed. Offering strips only is fine.

Knowledge check

1. Which question is neutral?
Show the answer

How much do you like or dislike this fragrance?. It uses a balanced scale and does not suggest an answer.

2. Why are friends a poor consumer panel?
Show the answer

They may want to please you, and may not be your market. They can still give feedback, but it should not be reported as market evidence.

3. Twelve people preferred B, 8 preferred A. What should you conclude?
Show the answer

That is weak evidence, and easily produced by chance. With 20 people, a 12 to 8 split is unremarkable. The chance of 12 or more of 20 by coin flip is about 25%.

Further reading and materials

Written and reviewed by the RUŌOD Lab team. This is general education, not legal, regulatory, medical or safety advice. Example dilutions and exercises are for learning, are not validated products, and have not been safety-assessed. Completing a lesson confers no qualification. How we check these lessons.