Back to List

Analyzing Definitive Screening Design Step-by-Step

Read a Definitive Screening Design's three-level structure and correlation map, then stage the analysis of main effects, curvature, and interaction candidates.

Advanced
|
46min
|
Verified (2026-08-14)
definitive screening designthree-level designmain effectquadratic effectcorrelation mapsparsityhereditystaged analysisJMP
Progress0/28 (0%)

If you explore all six continuous factors with a full quadratic model, you will have 28 coefficients. If you don't have enough runs to precisely estimate all of those terms from the beginning, how can you find the most important factors and curvature candidates first?

The question for this section is:


Can we screen many continuous factors with a small number of runs while also exploring curvature?
DSD๋งŽ์€ ์—ฐ์†์š”์ธ์˜ ์ฃผํšจ๊ณผ์™€ ๊ณก๋ฅ  ํƒ์ƒ‰์„ ์ž‡๋Š” 3์ˆ˜์ค€ screening
sparsity์‹ค์ œ๋กœ ํฐ ํšจ๊ณผ๋Š” ์†Œ์ˆ˜๋ผ๋Š” ๋ถ„์„ ๊ฐ€์ •
heredity๊ตํ˜ธ์ž‘์šฉ์ด ์žˆ์œผ๋ฉด ๊ด€๋ จ ์ฃผํšจ๊ณผ๋„ ์žˆ์„ ๊ฐ€๋Šฅ์„ฑ์ด ๋†’๋‹ค๋Š” ๊ฐ€์ •
staged analysis์ฃผํšจ๊ณผ ํ›„๋ณด ๋’ค ๊ณก๋ฅ ยท๊ตํ˜ธ์ž‘์šฉ์„ ์ˆœ์„œ๋Œ€๋กœ ๊ฒ€ํ† ํ•˜๋Š” ์ „๋žต

DSD looks at each continuous factor at three levels

In the Definitive Screening Design (DSD), the continuous factors are coded as โˆ’1, 0, and +1. Unlike a typical two-level screening design, each factor has a 0 level, which allows you to explore the curvature information of the individual quadratic terms.

The six-factor teaching design consists of 13 runs. It can be created by stacking the rows of the 6ร—6 conference matrix C, the rows of the sign-inverted matrix โˆ’C, and the all-center row. Each factor column is balanced, and the main effect columns are orthogonal to each other.

U28 ยท Figure 01
13๊ฐœ์˜ 3์ˆ˜์ค€ ํ–‰์ด ์ฃผํšจ๊ณผ์™€ ๊ณก๋ฅ  ์งˆ๋ฌธ์„ ์—ฐ๊ฒฐํ•ฉ๋‹ˆ๋‹ค
ABCDEF
๊ฐ ์—ด์˜ โˆ’1ยท0ยท+1 ๊ตฌ์กฐ์™€ ์ƒ๊ด€ ์ง€๋„๋ฅผ ๋‹จ๊ณ„๋ถ„์„ ์ „์— ํ™•์ธํ•ฉ๋‹ˆ๋‹ค. ์ด ๊ตฌ์กฐ๊ฐ€ ๋ชจ๋“  ๊ตํ˜ธ์ž‘์šฉ์„ ์ž๋™ ๋ถ„๋ฆฌํ•œ๋‹ค๋Š” ๋œป์€ ์•„๋‹™๋‹ˆ๋‹ค.

This geometry provides an important advantage, but it does not mean that "all 28 full quadratic coefficients can be freely estimated with 13 runs." There may still be correlations between several two-factor interactions and quadratic term candidates.

Read the Correlation Map before looking at the response values

The correlation map of the design shows the correlations between the candidate model columns. In DSD, the main effects are designed to be separated from the two-factor interactions, but not all higher-order candidates are independent of each other.

Before obtaining the responses, check the following:

  • Are the main effects separated from the nuisance/block terms?
  • How much are the quadratic terms related to each other or to the 2FI?
  • How does the basic structure change when categorical factors are mixed in?
  • Which terms are reinforced by the center/extra runs?

We evaluate the actual model matrix, not just the name of the design.

Stepwise analysis uses sparsity and heredity

Since we cannot put all candidate terms into the 13 data points at once, we ask questions step by step.

  1. Stage 1 โ€” Main Effects: We look at the linear signal candidates for each continuous factor.
  2. Stage 2 โ€” Curvature: We review the promising factors and quadratic term candidates.
  3. Stage 3 โ€” Interaction: We review the selected main effects and scientifically plausible 2FI in a hierarchy.
  4. Stage 4 โ€” Augmentation: We determine additional runs to separate ambiguous terms or optimize.

This flow often relies on the assumptions that most effects are small (sparsity) and that important interactions are likely to involve related main effects (heredity). Both are useful analytical principles, but they are not facts guaranteed by the data.

The p-value after stepwise selection is different from a single test determined from the beginning

Selecting candidates from the same data and then testing them again creates selection bias. Keep a record of the steps, thresholds, and candidate terms, and verify the results with shrinkage, sensitivity analysis, additional runs, and independent confirmation.

Even if the main effects are small, the crossover interaction can be large.

Two factors may have opposing interactions, resulting in a mean main effect close to zero. If only strong heredity is assumed, such terms may be overlooked. Mechanistically important combinations can be included in the initial candidate set regardless of their main effect rank.

In small samples, if half-normal or stepwise-selection results vary with the seed or noise, report the stability of the selection rather than only one selected list.

If curvature candidates exist, move to RSM or augmentation

If the set of promising factors is reduced to 2โ€“3 and there is evidence of curvature, evaluate whether an RSM can be fitted using those factors. If information is lacking, augment with axial points, center points, or selected candidate runs. If many factors remain promising or several interactions remain unresolved, do not force optimization with only 13 runs.

DSD is a bridge between screening and optimization, not a final design for all cases.

In-Silico Lab: Observe the fluctuation of stepwise candidates

  1. Change the true main effect factors between A and F, and check the top factors in Stage 1.
  2. Change the true curvature factors and see if the Stage 2 candidates follow.
  3. Increase the Cร—D interaction to see if the stepwise ranking fluctuates.
  4. Change the seed and noise to observe the selection stability.
In-Silico Lab ยท U28

DSD์˜ ์ฃผํšจ๊ณผ ๋‹จ๊ณ„์™€ ๊ณก๋ฅ  ๋‹จ๊ณ„๋ฅผ ๋ถ„๋ฆฌํ•˜์„ธ์š”

6์š”์ธ 13-run ํ•ฉ์„ฑ DSD์—์„œ ์ฐธ ์ฃผํšจ๊ณผยท๊ณก๋ฅ ยท๊ตํ˜ธ์ž‘์šฉยทnoise๋ฅผ ๋ฐ”๊พธ๋ฉฐ ๋‹จ๊ณ„๋ณ„ ์ƒ์œ„ ํ›„๋ณด๊ฐ€ ์–ผ๋งˆ๋‚˜ ์•ˆ์ •์ ์ธ์ง€ ๋ด…๋‹ˆ๋‹ค.

์ฒ˜์Œ์ด๋ผ๋ฉด: ๋ฌด์—‡์„ ๋ˆŒ๋Ÿฌ์•ผ ํ•˜๋‚˜์š”?
  1. 1. ์งˆ๋ฌธ์„ ๋จผ์ € ์ฝ๊ธฐLab ์ œ๋ชฉ์—์„œ ์ด๋ฒˆ์— ๋น„๊ตํ•  ํ•œ ๊ฐ€์ง€๋ฅผ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.
  2. 2. ์กฐ๊ฑด ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ๊ธฐ์ฒ˜์Œ์—๋Š” n, ํšจ๊ณผ, ์‚ฐํฌ ๊ฐ™์€ ์ž…๋ ฅ ์ค‘ ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ์‹ญ์‹œ์˜ค.
  3. 3. ์ƒˆ ํ•ฉ์„ฑ ํ‘œ๋ณธ ๋ˆ„๋ฅด๊ธฐ์ƒˆ ํ•ฉ์„ฑ ๋ฐ์ดํ„ฐ๊ฐ€ ๋งŒ๋“ค์–ด์ง‘๋‹ˆ๋‹ค. ๊ฐ™์€ ์กฐ๊ฑด๋„ ํ‘œ๋ณธ์— ๋”ฐ๋ผ ๋‹ฌ๋ผ์งˆ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
  4. 4. ๊ทธ๋ฆผ๊ณผ ๊ณ„์‚ฐ ๊ฒฐ๊ณผ ๋น„๊ตํ•˜๊ธฐ๋ฐ”๊พธ๊ธฐ ์ „ํ›„ ๋ฌด์—‡์ด ์›€์ง์ด๊ณ  ๋ฌด์—‡์ด ๊ทธ๋Œ€๋กœ์ธ์ง€ ํ•œ ๋ฌธ์žฅ์œผ๋กœ ์ ์–ด๋ณด์‹ญ์‹œ์˜ค.

๋ง‰ํžˆ๋ฉด ์ดˆ๊ธฐํ™”๋กœ ๋Œ์•„๊ฐ€ ๊ธฐ๋ณธ ๊ฒฐ๊ณผ๋ฅผ ๋ณธ ๋’ค ์กฐ๊ฑด ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ์‹ญ์‹œ์˜ค. ์ด Lab์€ ์ •๋‹ต ํŒ์ •๊ธฐ๊ฐ€ ์•„๋‹ˆ๋ผ ํŒจํ„ด ๊ด€์ฐฐ ๋„๊ตฌ์ž…๋‹ˆ๋‹ค.

๊ฐ™์€ ์„ค์ •์˜ ํ•ฉ์„ฑ ๊ด€์ธก

A5.93B0.11C0.11D0.03E-0.13F0.03

๊ณ„์‚ฐ ๊ฒฐ๊ณผ

์„ค๊ณ„ run13
Stage 1 ์ƒ์œ„A
Stage 2 ๊ณก๋ฅ  ์ƒ์œ„B
ํ˜„์žฌ noise0.40

๋‹จ๊ณ„ ๊ฒฐ๊ณผ๋Š” ์„ ํƒํŽธํ–ฅ ์—†๋Š” ์ตœ์ข…๋ชจํ˜•์ด ์•„๋‹™๋‹ˆ๋‹ค. sparsityยทheredity๊ฐ€ ์•ฝํ•˜๊ฑฐ๋‚˜ ๊ตํ˜ธ์ž‘์šฉ์ด ๊ฐ•ํ•˜๋ฉด ์ถ”๊ฐ€ run๊ณผ ๋…๋ฆฝ ํ™•์ธ์ด ํ•„์š”ํ•ฉ๋‹ˆ๋‹ค.

๊ต์œก์šฉ synthetic model ยท bjs-advanced-design-sequence-v1. ํ•œ ํ–‰์€ ๋ณ„๋„ ํ‘œ์‹œ๊ฐ€ ์—†๋Š” ํ•œ ํ•˜๋‚˜์˜ ๋…๋ฆฝ simulation ๋˜๋Š” ์„ค๊ณ„ run์ž…๋‹ˆ๋‹ค. ์‹ค์ œ ์—ฐ๊ตฌยทํ’ˆ์งˆยท๊ทœ์ œ ํŒ๋‹จ์—๋Š” ์‚ฌ์šฉํ•  ์ˆ˜ ์—†์Šต๋‹ˆ๋‹ค.

The Lab is a fixed 6-factor, 13-run teaching DSD created with a conference matrix. It is a simple stepwise example that only shows the main effect score and centered-square score, and does not reproduce the selection method or inference of JMP Fit Definitive Screening.

In JMP, leave both the design evaluation and analysis steps together

Definitive Screening Evaluation

3์ˆ˜์ค€ ์ขŒํ‘œ์™€ ์ฃผํšจ๊ณผยท2์ฐจํ•ญ์˜ ์ƒ๊ด€ ๊ตฌ์กฐ๋ฅผ ๋ด…๋‹ˆ๋‹ค.

Correlation Map

์–ด๋–ค ํ›„๋ณดํ•ญ๋ผ๋ฆฌ ๊ตฌ๋ถ„์ด ์•ฝํ•œ์ง€ ๋‹จ๊ณ„๋ถ„์„ ์ „์— ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.

Fit Definitive Screening

์„ ํƒ ๋‹จ๊ณ„์™€ hierarchy ๊ฐ€์ •์ด ๊ฒฐ๊ณผ์— ๋ฏธ์นœ ์˜ํ–ฅ์„ ๊ธฐ๋กํ•ฉ๋‹ˆ๋‹ค.

In Definitive Screening evaluation, we first examine the three-level table and correlation map. The step-by-step results of Fit Definitive Screening record the threshold, selected main effects, quadratic terms, and interaction terms, as well as the hierarchy. Before calling the automatic selection results the final model, we review the full/alternative model and the possibility of augmentation.

Example of Result Statement

A 13-run DSD was used with 6 continuous factors. In the correlation map before the response, the main effect columns were orthogonal to each other, and the correlations of quadratic terms and 2FI candidates were recorded. As a pre-stage strategy, the main effects of A and D, and Dยฒ, were selected as subsequent candidates, but since this depends on sparsity, heredity, and selection bias, we planned 4 augmentation runs and independent confirmation.

Concluding the Section

  • DSD continuous factors have a three-level structure of -1, 0, and +1.
  • Main effects and curvature exploration are linked in a small number of runs.
  • The correlation map shows which higher-order candidates are not separable.
  • Staged analysis depends on sparsity, heredity, and the selection process.
  • Promising effects and curvature are candidates until augmentation and confirmation.
DSD์˜ 3์ˆ˜์ค€ ๊ตฌ์กฐ๋Š” ์ฃผํšจ๊ณผ์™€ ๊ณก๋ฅ  ํƒ์ƒ‰์„ ์ž‡์ง€๋งŒ sparsityยทheredity์™€ ๋‹จ๊ณ„์„ ํƒ์˜ ์œ„ํ—˜์„ ์—†์• ์ง€ ์•Š์Šต๋‹ˆ๋‹ค. ์„ ํƒ ๊ฒฐ๊ณผ๋Š” ๋ณด๊ฐ•์‹คํ—˜ ์ „ ํ›„๋ณด์ž…๋‹ˆ๋‹ค.

In the final section, we package the design, analysis, confirmation, and constraints that have been carried out so far into a verifiable package that others can retrace.

Official Supplementary Materials

This article and the Lab are educational synthetic materials and should not be used as evidence for actual research, process, quality, or regulatory decisions.

๐Ÿ’ฌ Questions & Comments

0 comments

You can post without signing in. Guest comments cannot be edited or deleted by their author.

0/2000

Loading...