Specialist track · Research and Innovation

Controls, Randomization and Blinding

Design a fair fragrance test: real controls, randomized order, coded samples and a person who isn't you holding the key. Includes a worked assignment table.

In short

A blinded fragrance test compares versions under the same conditions, in a chance-assigned order, with coded samples, so that neither the assessor's expectations nor yours can decide the result. You've used versions of this informally since Level 2. Here you set it up properly, because the difference between "it seemed better to me" and "it came out better in a fair test" is the entire point of this track.

What you will learn

  • Choose suitable controls for a fragrance test
  • Randomize and balance sample order
  • Set up blinding with a sealed key

Before this lesson: Reading Fragrance Research Critically

Controls

Kinds of control in fragrance testing
ControlPurposeExample
ComparatorThe version you're measuring againstThe same accord, without the change
Solvent blankChecks what people report with nothing thereStrip with carrier alone
Positive controlShows your test can detect a known differenceA pair known to be clearly different
Identical pairShows the rate of false differencesThe same sample given twice

Make the control alongside the test sample, from a single batch where possible, and adjust so that total weight and solvent are equal. Age them together. Handle them identically. A difference in strip dipping or storage is a difference in the test.

Randomizing and balancing

People often judge the first sample differently, and they adapt to what they've just smelled. So order must be managed. For two samples, A and B, half the people get AB and half BA. For more samples, use a balanced set of orders, such as a Latin square, in which each sample appears in each position equally often. Assign people to orders by chance, using a random number tool or by drawing slips of paper.

A worked allocation for three samples and six orders. Assign each person by chance to a row, repeating the rows evenly.
SequenceFirstSecondThird
1ABC
2ACB
3BAC
4BCA
5CAB
6CBA

Blinding in practice

  1. Codes. Use three-digit random numbers, rather than A/B or 1/2, because people read meaning into labels.
  2. Key. A helper prepares the codes and seals the key. You open it only after scoring.
  3. Appearance. Same vials, same volume, and strips dipped to the same depth. Color differences can reveal a sample. A tinted vial may help.
  4. Instructions. Written, identical and neutral, so you don't lead anyone. Don't say what the study hopes to find.
  5. Your presence. If you can't be blind, stay out of the room, or at least silent.
  6. Analysis. Score the data before you unblind it, with the rule already written.

Controlling the environment

  • A well-ventilated, odor-free space, without perfume on anyone or nearby.
  • Consistent time of day, temperature and dose.
  • Breaks between samples, as you found with olfactory fatigue. State the interval.
  • Instructions on how to smell the strips, and how long to do it for.
  • No talking between assessors while testing.

Common design errors

Errors and fixes
ErrorFix
Coding and testing yourselfAsk someone else to hold the key
Always smelling the new one lastRandomize the order
Comparing fresh against old samplesMake and age them together
Testing until you see what you wantFix the number before you start
Excluding someone after seeing their answersSet the exclusion rules beforehand, and report any exclusions

Practical exercise: A complete test design with a dry run

About 90 minutes · You will have: a design sheet with a randomized allocation table, a key held by someone else and a dry-run report

  1. Take the question from your earlier file.
  2. Write a design sheet: versions, controls, medium, dose, order, codes, key-holder, instructions, environment and timing.
  3. Generate your allocation table with a stated random method.
  4. Do a dry run with one person, using strips only. Do not include their results in your final data. Note what confused them.
  5. Fix the design, and date the final version.

You have done this well if you could leave the sheet with a stranger and they could run it, you would not know which sample was which, and the dry run changed something.

Common mistakes

  • Calling a test blind while you know the code. It isn't.
  • Using A and B as labels. Use neutral numbers.
  • Telling participants your hypothesis. Save it for afterward.

Key terms

Randomization
Assigning samples or orders by chance, so that unknown influences are not systematically linked to any one version.
Blinding
Keeping those taking part, and ideally those scoring, from knowing which sample is which.
Carryover effect
An influence of an earlier sample on the judgment of a later one, such as adaptation from the first strip smelled.

Knowledge check

1. Why have someone else hold the code key?
Show the answer

You can't be blind to samples you coded yourself. You could otherwise influence results unintentionally, through memory or cues.

2. In a two-sample comparison, what does a balanced order mean?
Show the answer

About half smell A first, and half B first. This helps to separate any effect of order from the samples themselves.

3. Your control differs from the test by a dose of a material and also by less solvent. What's wrong?
Show the answer

You've changed two things. Match the total, or you can't attribute the difference.

Written and reviewed by the RUŌOD Lab team. This is general education, not legal, regulatory, medical or safety advice. Example dilutions and exercises are for learning, are not validated products, and have not been safety-assessed. Completing a lesson confers no qualification. How we check these lessons.