Back to List

Connecting Screening Results to Follow-up Experiments

This explains the sequential DOE process of reading Pareto, half-normal, alias, and hierarchy in fractional factorial screening and separating effects using foldover and confirmation experiments.

Advanced
|
38min
|
Verified (2026-08-14)
screeningParetohalf-normaleffect hierarchypoolingfoldoverconfirmationJMP
Progress0/28 (0%)

In a fractional factorial design, if the A bar is the longest, can we simply conclude that "A has an effect on the response"? As seen in U20, if the A column is aliased with BC, that bar may represent the combined signal of A + BC.

The question for this section is as follows:


After identifying a potentially significant effect with a small number of runs, what else should be investigated?
screening적은 실행으로 후속 검토할 효과 후보를 찾는 단계
half-normal절대효과와 기준 분포를 비교하는 효과 그림
pooling일부 작은 효과를 오차로 묶는 가정 의존 결정
foldover부호를 뒤집은 실행을 더해 alias를 분리하는 후속설계

Screening is the first wave for reducing candidates

Screening is the process of identifying candidate factors from a large number of factors to focus on in subsequent experiments. The contrast, Pareto chart, and half-normal plot in the results table summarize which effects appear to be larger than the background noise. However, the length of the bar does not automatically resolve the following:

  • Is another effect aliased in that column?
  • Is there a lack of replication, making it difficult to estimate the error?
  • Was the same data looked at multiple times during the process of selecting effects?
  • Was the hierarchy of main effects and interactions maintained?
  • Is the magnitude significant in actual units?

Therefore, the results of screening are closer to a list of follow-up questions than a "list of confirmed effects."

The same A contrast can mask different causes

In a three-factor half fraction, if C=AB, then A=BC. If the hidden response equation contains a coded A coefficient of 6 and a BC coefficient of 5, the A contrast in the first fraction will be 22, which is the sum of the two effects. This is a value that has not yet separated the factorial effect of A (12) from the effect of BC (10).

U21 · Figure 01
첫 contrast가 뒤집히면 한 효과가 아니었습니다
첫 fractionA 열22BC 열22foldoverA 열2BC 열-2
첫 fraction에서 A와 BC는 같은 열입니다. foldover에서 둘의 부호 관계가 바뀌어 두 contrast를 합치면 각각을 분리할 수 있습니다.

Adding the opposite fraction, i.e., C=-AB, inverts the sign relationship between A and BC. In this foldover, the A contrast becomes 2. In the 8 runs combining the two folds, we can separately calculate the A effect as 12 and the BC effect as 10.

Analysis StepContrast labeled as AInterpretable range
First 4-run fraction22Combined signal of A and BC
4-run foldover2Signal of A and BC combined with opposite signs
Combining the two fractionsA=12, BC=10Teaching fixture separating the two effects

These numbers are a noise-free synthetic example to illustrate the structure. In real data, we need to consider the estimation uncertainty and run-to-run variation together.

Pareto and half-normal are not verdicts

A Pareto chart shows the absolute effects in descending order. A half-normal plot looks at whether many small effects are located near the baseline and whether large candidates deviate from the line. In designs without replication, we also rely on methods that assume that most of the small effects are inactive, such as Lenth-type pseudo standard errors.

If that assumption is broken, the baseline itself becomes unstable. If there are many effects or large aliased interactions, even small bars are not automatically errors. Do not delete terms based solely on p-values or bar rankings; instead, consider the design aliases and prespecified scientific questions together.

Pooling is an assumption, not a calculation button

Grouping insignificant terms into the error will change the tests for the remaining terms. Do not hide the selection process of choosing terms and creating the error from the same data; instead, document the hierarchy and sparsity assumptions, sensitivity analysis, and follow-up validation data.

Subsequent experiments are chosen to match the remaining ambiguity

Not every screening requires a full foldover. The next design depends on the remaining questions.

  1. If main effects and two-factor interactions are aliased, separate the columns with a foldover or selective runs.
  2. If the number of important factors has been reduced, perform a higher resolution or full factorial experiment with only those factors.
  3. If the center point is off the line, move to the curvature question of U22.
  4. If you are actually going to use the prediction conditions, perform confirmation runs in new independent units.

Additional runs are determined not by "more," but by "which alias, curvature, or prediction to resolve."

In-Silico Lab: Separate one column into two effects

  1. Starting with true A coefficient of 6 and true BC coefficient of 5, confirm the first A contrast.
  2. Change BC to 0 and see how the combined A effect approaches the first contrast.
  3. Set A to 0 and make only BC large to see if an "A bar" is created.
  4. After combining the foldover, see if A and BC are each restored.
In-Silico Lab · U21

첫 screening과 foldover를 이어서 보세요

C=AB인 4-run fraction에서는 A와 BC가 같은 열입니다. foldover 4개를 더해 두 contrast가 어떻게 분리되는지 확인합니다.

처음이라면: 무엇을 눌러야 하나요?
  1. 1. 질문을 먼저 읽기Lab 제목에서 이번에 비교할 한 가지를 확인합니다.
  2. 2. 조건 하나만 바꾸기처음에는 n, 효과, 산포 같은 입력 중 하나만 바꾸십시오.
  3. 3. 새 합성 표본 누르기새 합성 데이터가 만들어집니다. 같은 조건도 표본에 따라 달라질 수 있습니다.
  4. 4. 그림과 계산 결과 비교하기바꾸기 전후 무엇이 움직이고 무엇이 그대로인지 한 문장으로 적어보십시오.

막히면 초기화로 돌아가 기본 결과를 본 뒤 조건 하나만 바꾸십시오. 이 Lab은 정답 판정기가 아니라 패턴 관찰 도구입니다.

같은 설정의 합성 관측

첫 A contrast22.00foldover A contrast2.00결합 A effect12.00결합 BC effect10.00

계산 결과

첫 설계 run4
추가 run4
첫 A contrast22.0
분리 A / BC12.0 / 10.0

첫 막대만으로 A가 원인이라고 확정하면 BC를 놓칩니다. 효과선별 기준과 추가설계는 데이터를 본 뒤의 선택임을 기록해야 합니다.

교육용 synthetic model · bjs-screening-sequence-v1. 한 행은 별도 표시가 없는 한 하나의 독립 simulation 또는 설계 run입니다. 실제 연구·품질·규제 판단에는 사용할 수 없습니다.

Each row in the Lab represents a composite run of a coded treatment combination. The first four and the four foldover runs are different phases; in a real experiment, these would be designed as separate experimental units with a randomized run order.

Interpret JMP results in conjunction with design information

Screening Effect Plots

Pareto·half-normal은 효과 후보와 alias 정보를 함께 읽습니다.

Fit Model

선택항의 hierarchy·잔차·추정 불확실성을 다시 확인합니다.

Foldover / Augment Evaluation

추가 run이 어떤 혼동을 분리하는지 실행 전에 봅니다.

After finding candidate large effects in the Screening Effect Plots, check the Alias information and Design Evaluation to see what those bars are confounded with. In Fit Model, examine the hierarchy of selected terms, the uncertainty in the estimates, and the residuals. In the Foldover or Augment evaluation, check before running which columns the additional runs actually separate.

The goal is not to memorize the click sequence. The key is that the ambiguity left by the first result is connected to the new information provided by the next design.

Example of a result statement

In a 4-run half fraction, the A/BC alias contrast was significant. Instead of concluding that this is the main effect of A, we added the other four runs from the opposite fraction. In the combined analysis, the effects of A and BC were separated, and term selection maintained the hierarchy. This result is a candidate for further screening and requires independent confirmation experiments before applying it to actual conditions.

Concluding the module

  • Screening is a step to reduce the number of candidate important effects.
  • Pareto and half-normal plots do not replace alias and selection processes.
  • Pooling is an analytical decision that relies on sparsity.
  • Foldover changes the sign relationship to separate specific aliases.
  • Screening results are not the final cause or optimal condition until independent confirmation.
Screening의 큰 막대는 원인 확정이 아니라 후속 후보입니다. alias·hierarchy·선택과정을 기록하고 foldover나 확인실험으로 분리해야 합니다.

In the next module, we will see how the center points placed in the screening design reveal the limitations of the linear model.

Supplemental Materials

This article and the Lab are educational synthetic materials and should not be used as evidence for actual research, process, quality, or regulatory decisions.

💬 Questions & Comments

0 comments

You can post without signing in. Guest comments cannot be edited or deleted by their author.

0/2000

Loading...