Back to List

Analyzing Definitive Screening Design Step-by-Step

Read a Definitive Screening Design's three-level structure and correlation map, then stage the analysis of main effects, curvature, and interaction candidates.

Advanced
|
46min
|
Verified (2026-08-14)
definitive screening designthree-level designmain effectquadratic effectcorrelation mapsparsityhereditystaged analysisJMP
Progress0/28 (0%)

If you explore all six continuous factors with a full quadratic model, you will have 28 coefficients. If you don't have enough runs to precisely estimate all of those terms from the beginning, how can you find the most important factors and curvature candidates first?

The question for this section is:


Can we screen many continuous factors with a small number of runs while also exploring curvature?
DSD3-level screening connecting main effects and curvature search of many continuous factors
sparsityThe analytical assumption is that in reality, large effects are small numbers.
heredityThe assumption is that if there is an interaction, there is a high probability that there will also be a related main effect.
staged analysisStrategy to review curvature and interaction in order after main effect candidates

DSD looks at each continuous factor at three levels

In the Definitive Screening Design (DSD), the continuous factors are coded as −1, 0, and +1. Unlike a typical two-level screening design, each factor has a 0 level, which allows you to explore the curvature information of the individual quadratic terms.

The six-factor teaching design consists of 13 runs. It can be created by stacking the rows of the 6×6 conference matrix C, the rows of the sign-inverted matrix −C, and the all-center row. Each factor column is balanced, and the main effect columns are orthogonal to each other.

U28 · Figure 01
Thirteen three-level rows link the main effects and curvature questions
ABCDEF
Check the −1·0·+1 structure and correlation map of each column before step analysis. This structure does not mean that all interactions are automatically isolated.

This geometry provides an important advantage, but it does not mean that "all 28 full quadratic coefficients can be freely estimated with 13 runs." There may still be correlations between several two-factor interactions and quadratic term candidates.

Read the Correlation Map before looking at the response values

The correlation map of the design shows the correlations between the candidate model columns. In DSD, the main effects are designed to be separated from the two-factor interactions, but not all higher-order candidates are independent of each other.

Before obtaining the responses, check the following:

  • Are the main effects separated from the nuisance/block terms?
  • How much are the quadratic terms related to each other or to the 2FI?
  • How does the basic structure change when categorical factors are mixed in?
  • Which terms are reinforced by the center/extra runs?

We evaluate the actual model matrix, not just the name of the design.

Stepwise analysis uses sparsity and heredity

Since we cannot put all candidate terms into the 13 data points at once, we ask questions step by step.

  1. Stage 1 — Main Effects: We look at the linear signal candidates for each continuous factor.
  2. Stage 2 — Curvature: We review the promising factors and quadratic term candidates.
  3. Stage 3 — Interaction: We review the selected main effects and scientifically plausible 2FI in a hierarchy.
  4. Stage 4 — Augmentation: We determine additional runs to separate ambiguous terms or optimize.

This flow often relies on the assumptions that most effects are small (sparsity) and that important interactions are likely to involve related main effects (heredity). Both are useful analytical principles, but they are not facts guaranteed by the data.

The p-value after stepwise selection is different from a single test determined from the beginning

Selecting candidates from the same data and then testing them again creates selection bias. Keep a record of the steps, thresholds, and candidate terms, and verify the results with shrinkage, sensitivity analysis, additional runs, and independent confirmation.

Even if the main effects are small, the crossover interaction can be large.

Two factors may have opposing interactions, resulting in a mean main effect close to zero. If only strong heredity is assumed, such terms may be overlooked. Mechanistically important combinations can be included in the initial candidate set regardless of their main effect rank.

In small samples, if half-normal or stepwise-selection results vary with the seed or noise, report the stability of the selection rather than only one selected list.

If curvature candidates exist, move to RSM or augmentation

If the set of promising factors is reduced to 2–3 and there is evidence of curvature, evaluate whether an RSM can be fitted using those factors. If information is lacking, augment with axial points, center points, or selected candidate runs. If many factors remain promising or several interactions remain unresolved, do not force optimization with only 13 runs.

DSD is a bridge between screening and optimization, not a final design for all cases.

In-Silico Lab: Observe the fluctuation of stepwise candidates

  1. Change the true main effect factors between A and F, and check the top factors in Stage 1.
  2. Change the true curvature factors and see if the Stage 2 candidates follow.
  3. Increase the C×D interaction to see if the stepwise ranking fluctuates.
  4. Change the seed and noise to observe the selection stability.
In-Silico Lab · U28

Separate the main effect phase and curvature phase of DSD

In 6-factor 13-run synthetic DSD, we change the true main effect, curvature, interaction, and noise to see how stable the top candidates are at each stage.

If this is your first time: What should I press?
  1. 1. Read the question firstIn the Lab title, check the one thing you will compare this time.
  2. 2. Change just one conditionInitially, change only one of the inputs: n, effect, or spread.
  3. 3. new composite specimen pressureNew synthetic data is created. The same conditions may vary depending on the sample.
  4. 4. Pictures and calculation results CompareWrite in one sentence what moves and what stays the same before and after the change.

If it gets stuckresetGo back to see the default results and change just one condition. This Lab is not a correct answer tester but a pattern observation tool.

Synthetic observations of the same settings

A5.93B0.11C0.11D0.03E-0.13F0.03

calculation result

design run13
Stage 1 topA
Stage 2 Curvature UpperB
current noise0.40

The results of the steps are not the final model without selection bias. If sparsity/heredity is weak or interaction is strong, additional runs and independent confirmation are required.

educational synthetic modelbjs-advanced-design-sequence-v1. One row is one independent simulation or design run unless otherwise indicated. It cannot be used for actual research, quality, or regulatory decisions.

The Lab is a fixed 6-factor, 13-run teaching DSD created with a conference matrix. It is a simple stepwise example that only shows the main effect score and centered-square score, and does not reproduce the selection method or inference of JMP Fit Definitive Screening.

In JMP, leave both the design evaluation and analysis steps together

Definitive Screening Evaluation

View the correlation structure of 3-level coordinates and main effects and quadratic terms.

Correlation Map

Before step analysis, check which candidate terms are poorly differentiated.

Fit Definitive Screening

Record the impact of selection steps and hierarchy assumptions on the results.

In Definitive Screening evaluation, we first examine the three-level table and correlation map. The step-by-step results of Fit Definitive Screening record the threshold, selected main effects, quadratic terms, and interaction terms, as well as the hierarchy. Before calling the automatic selection results the final model, we review the full/alternative model and the possibility of augmentation.

Example of Result Statement

A 13-run DSD was used with 6 continuous factors. In the correlation map before the response, the main effect columns were orthogonal to each other, and the correlations of quadratic terms and 2FI candidates were recorded. As a pre-stage strategy, the main effects of A and D, and D², were selected as subsequent candidates, but since this depends on sparsity, heredity, and selection bias, we planned 4 augmentation runs and independent confirmation.

Concluding the Section

  • DSD continuous factors have a three-level structure of -1, 0, and +1.
  • Main effects and curvature exploration are linked in a small number of runs.
  • The correlation map shows which higher-order candidates are not separable.
  • Staged analysis depends on sparsity, heredity, and the selection process.
  • Promising effects and curvature are candidates until augmentation and confirmation.
DSD's three-level structure bridges main effects and curvature search, but does not eliminate the risks of sparsity/heredity and step selection. The selection result is the candidate before the reinforcement experiment.

In the final section, we package the design, analysis, confirmation, and constraints that have been carried out so far into a verifiable package that others can retrace.

Official Supplementary Materials

This article and the Lab are educational synthetic materials and should not be used as evidence for actual research, process, quality, or regulatory decisions.

💬 Questions & Comments

0 comments

You can post without signing in. Guest comments cannot be edited or deleted by their author.

0/2000

Loading...