Back to List

From OFAT to DOE: What Changing One Thing at a Time Misses

Why one-factor-at-a-time experimentation misses interactions and optimal combinations, explained through factors, levels, responses, runs, and DOE geometry.

Intermediate
|
30min
|
Verified (2026-08-14)
DOEOFATfactorlevelresponseinteractiondesign spaceJMP
Progress0/28 (0%)

Choosing pH with temperature fixed at 30°C, then choosing agitation speed with that pH fixed, is familiar. Even if each graph is smooth, the final combination is not guaranteed to be good across the full range. The effect of one factor may change at another factor's level.

This unit asks one question.


Why can changing one thing at a time not reveal factor combinations and interactions?
primary factorinput that is changed or controlled by the experimenter
water levelActual conditions specified for factors
reactionOutput measured in experiment
interactionThe effect of one factor depends on the level of another factor

Align experimental language with four terms

  • factor: an input variable the experimenter changes or controls
  • level: the actual condition assigned to a factor
  • response: the output measured in a run
  • run: one application of a treatment combination to an independent experimental unit

Combining 30/37°C with pH 6.8/7.4 gives two factors, two levels each, and four treatment combinations. Reading several plate wells at each combination does not by itself create more independent runs. The design defines the experimental unit: independently treated culture, batch, donor, or another unit.

OFAT sees only axes extending from the reference point

OFAT changes A alone at a reference condition, then B alone again at that reference. With two factors at two levels, it sees the reference, A-high, and B-high corners, but not A-high/B-high.

U16 · Figure 01
OFAT follows the axes and factorial looks at the vertices of the combinatorial space.
benchmarkChange only AChange only B− −+ −− +
If there is an interaction, the effect seen on one axis cannot be transferred to the other axis level.

If response is additive, Y=β₀+βAA+βBB, the missing corner can be predicted from the two axis effects. But when βAB×A×B exists, the A effect changes with B's level. This is interaction.

  • no interaction: lines joining A low and high are parallel at B levels
  • interaction: slopes differ or cross

Interaction does not mean “both factors are individually significant.” It means one factor's effect depends on the other's condition.

A good OFAT R² does not create combination information

Even excellent line fits on each axis cannot tell whether the same slope holds at another factor level. The unmeasured high-high corner and interaction cannot be recovered from three OFAT regressions.

DOE is an information-allocation strategy, not a synonym for minimum runs

DOE starts by specifying the research objective and candidate model, then lays out treatment combinations and run order so effects can be separated. It is not a technique for reducing runs at any cost. Full factorial designs observe every combination; fractional factorial designs select some combinations while accepting assumptions that some effects are small and some terms are aliased.

A sound DOE plans all of the following:

  1. the question and measurement definition of the response
  2. controllable factors and realistic ranges
  3. candidate main effects, interactions, and curvature
  4. independent experimental units and replication
  5. randomization and blocking constraints
  6. analysis, diagnostics, and confirmation experiments

Distinguish statistical exploration space from regulatory design space

An area within factor ranges where a fitted model predicts the response criteria will be met may be called a “design space” in an educational setting. Regulatory design space in ICH Q8, or MODR in ICH Q14, however, are domain concepts with development evidence, multivariate understanding, and submission/approval context. Do not automatically call the inside of a simple contour a regulatory-approved design space.

This course calls it precisely a statistical exploration region within the experimented factor ranges. QbD terms such as CQA and CPP are not prerequisites for DOE mathematics and should not support process claims without domain validation.

In-Silico Lab: see one hidden process in two ways

The Lab's hidden response is Y=70+8A+5B+γAB.

  1. At γ=0, compare whether OFAT and factorial effects agree.
  2. At γ=6 or 10, inspect the high-high response that OFAT does not see.
  3. Consider under ±1 coding why the AB effect is twice γ.
  4. Answer whether γ can be calculated from only the three OFAT points.
In-Silico Lab · U16

Explore the same hidden process with OFAT and factorial

By changing the interaction between A and B, we check for high-high combinations and condition-dependent effects that the OFAT path does not see.

If this is your first time: What should I press?
  1. 1. Read the question firstIn the Lab title, check the one thing you will compare this time.
  2. 2. Change just one conditionInitially, change only one of the inputs: n, effect, or spread.
  3. 3. new composite specimen pressureNew synthetic data is created. The same conditions may vary depending on the sample.
  4. 4. Pictures and calculation results CompareWrite in one sentence what moves and what stays the same before and after the change.

If it gets stuckresetGo back to see the default results and change just one condition. This Lab is not a correct answer tester but a pattern observation tool.

Synthetic observations of the same settings

AB

calculation result

OFAT observation point3
factorial point4
AB effect12.0
high-high response89.0

Although OFAT's regression on each axis looks good, the interactions and other vertices in the combination space are unknown.

educational synthetic modelbjs-factorial-sequence-v1. Actual research judgments must separately reflect experimental units, missingness, distribution, multiplicity, pre-planning, and domain criteria.

JMP figures reveal DOE's purpose in advance

Interaction Plot

If the lines are not parallel, the effect of one factor depends on the condition.

Contour / Surface

It expresses the response in a combination space rather than one axis at a time.

Prediction Profiler

Preview only the role that connects DOE-created models to conditional exploration.

An Interaction Plot shows nonparallelism; contours and surfaces show combination space; a Prediction Profiler shows fitted-model predictions by condition. This unit is not a menu or optimization-clicking guide. A figure becomes meaningful only after understanding which points were measured and why.

DOE does not automatically turn observational data into an experiment

Having several factor columns in already-produced historical data does not make it DOE. Causal effect interpretation needs the experimenter to assign combinations and control run order, experimental units, and noise sources. Even within DOE, record and diagnose run failure, noncompliance, and measurement drift.

Takeaways

  • Define factor, level, response, and run together with the experimental unit.
  • OFAT observes only axes from a reference point.
  • Interaction means one factor's effect depends on another factor's level.
  • DOE arranges combinations to separate information for a candidate model.
  • Question, replication, and randomization come before minimizing runs.
  • Do not equate a statistical exploration region with regulatory design space.
OFAT shows changes in one axis but misses factor combinations and interactions. DOE is a strategy to place execution points such that information is separated in a combinatorial space.

The next unit reads 2² and 2³ full-factorial tables directly and calculates balance, orthogonality, main effects, and interactions.

Official supplementary resources

The process and Lab in this article are educational synthetic models.

💬 Questions & Comments

0 comments

You can post without signing in. Guest comments cannot be edited or deleted by their author.

0/2000

Loading...