Back to List

Optimal Conditions Are Not the End but the Start of the Next Experiment

Connect the contour, surface, and Prediction Profiler of a suitable second-order model, and verify the multiresponse desirability candidate with a confirmation experiment and augment design.

Advanced
|
41min
|
Verified (2026-08-14)
contour plotsurface plotPrediction Profilerdesirabilitymultiresponse optimizationconfirmation experimentaugment designJMP
Progress0/28 (0%)

The second-order model has identified the point that predicts the highest yield. Even if the software outputs conditions with decimal precision, that point is still just a candidate point suggested by the model and the objective function.

The question for this section is:


Is the predicted optimum the end of the experiment, or the beginning of the next one?
๋“ฑ๊ณ ์„ ๊ฐ™์€ ์˜ˆ์ธก ๋ฐ˜์‘์„ ์ž‡๋Š” 2์ฐจ์› ์„ 
Profiler๋‹ค๋ฅธ ์š”์ธ์„ ๊ณ ์ •ํ•˜๊ณ  ํ•œ ์š”์ธ์˜ ์˜ˆ์ธก ๋‹จ๋ฉด์„ ๋ณด๋Š” ํ‘œํ˜„
desirability๋ฐ˜์‘๋ณ„ ๋ชฉํ‘œ ๋‹ฌ์„ฑ๋„๋ฅผ 0~1๋กœ ๋ฐ”๊พผ ์‚ฌ์šฉ์ž ์ •์˜ ํ•จ์ˆ˜
ํ™•์ธ์‹คํ—˜์˜ˆ์ธก ํ›„๋ณด ์กฐ๊ฑด์„ ์ƒˆ ๋…๋ฆฝ ์‹คํ–‰์—์„œ ํ™•์ธํ•˜๋Š” ์‹คํ—˜

Contours and surfaces are two views of the same fitted model.

A 3D surface plot shows the predicted height for each xยทy combination. A contour plot shows the same predicted values connected by lines, as viewed from above. They are not different analyses, but rather the same model viewed from different perspectives.

U25 ยท Figure 01
ํ•œ ๊ณก๋ฉด์„ contourยทProfilerยทํ™•์ธ์ ์œผ๋กœ ์ž‡์Šต๋‹ˆ๋‹ค
์˜ˆ์ธก ํ›„๋ณดProfiler ๋‹จ๋ฉด
์ตœ์ ํ™”๋Š” ์„ค๊ณ„์˜์—ญ ์•ˆ์˜ ํ›„๋ณด๋ฅผ ๊ณ ๋ฅด๋Š” ๋‹จ๊ณ„์ž…๋‹ˆ๋‹ค. ๋ชฉํ‘œ์™€ ๊ฐ€์ค‘์น˜๊ฐ€ ๋ฐ”๋€Œ๋ฉด ํ›„๋ณด๊ฐ€ ์ด๋™ํ•˜๊ณ , ๋งˆ์ง€๋ง‰ ์ ์€ ์ƒˆ ํ™•์ธ์‹คํ—˜์ด์–ด์•ผ ํ•ฉ๋‹ˆ๋‹ค.

If the contour lines are closed ellipses, there may be a peak or valley candidate inside. If the lines continue to improve as they approach the boundary of the design region, it is possible that the actual optimum is outside the range, but the current data does not support this. Predictions that end at the boundary are not extended by extrapolation.

The Profiler connects multiple cross-sections.

In the Prediction Profiler, moving the vertical line of one factor changes the predicted cross-section while keeping the other factor fixed at its current position. If there is an xยทy interaction, the slope of x will vary depending on the y position. Do not interpret a single line in the Profiler as an independent, univariate effect.

The Profiler displays not only the prediction line, but also the confidence interval and factor range whenever possible. Observe whether the prediction uncertainty increases at the end of the range.

Desirability does not replace scientifically defining the objective.

The individual desirability, which converts the goal for each response to a value between 0 and 1, is denoted as dแตข, and the importance weight is denoted as wแตข. The composite desirability can then be created as a weighted geometric mean.

D = (โˆ dแตข^wแตข)^(1/ฮฃwแตข)

For example, to maximize yield and minimize impurities, define the acceptable limit, target, and importance for each. The software does not scientifically justify these values. Since changing even one limit can shift the optimal candidate, the goal definition should be reported along with the results.

InputRole in Composite ExamplePre-recorded
Yieldmaximizelow acceptable value, target value, weight
Impuritiesminimizetarget value, high acceptable value, weight
x, ycontrollable factorstudied range and feasible range
D=1 does not mean scientifically perfect

Composite desirability is a score within the transformation defined by the user. It does not reflect goals that were not included in the function, such as toxicity, cost, time, or unmeasured CQAs. Review sensitivity analyses for the weights and limits together.

Confirmation experiments are new evidence not used in fitting

Independently run new experimental units at the candidate conditions and compare the predicted and observed values. Simply showing the fitted value from the same table again is not confirmation.

The confirmation plan should include the following:

  • Candidate conditions and actual units
  • Predicted values and prediction uncertainty
  • Number of independent replicates and execution order/block
  • Success criteria and acceptable prediction difference
  • Rules to distinguish model, range, and process issues when failure occurs

If the observed mean differs from the prediction, do not simply conclude with "optimization failed." Check for model bias, execution condition errors, new batches, and measurement variations.

Augment adds new points to address remaining questions

If curvature at the center point was discovered in the initial factorial design, it can be expanded to a CCD by adding axial points. If the predicted optimal point is on the boundary and the information is weak, candidate points in that direction can be added. Distinguish between confirmation points and augment points for model improvement, as they have different purposes.

When selecting new points, evaluate whether the desired terms become estimable and the prediction variance is reduced when combined with the existing design. Also, record how the additional runs will be connected to the existing blocks.

In-Silico Lab: Change the objective and view new confirmation values

  1. Confirm the candidate with a yield weight of 2 and an impurity weight of 1.
  2. Increase the impurity weight to 4 and see if the x and y candidates move.
  3. Change the seed at the same candidate and see if the 3 confirmation means fluctuate.
  4. Confirm that all candidates are within โˆ’1โ‰คx,yโ‰ค1.
In-Silico Lab ยท U25

๋‹ค์ค‘๋ฐ˜์‘ ๋ชฉํ‘œ๋ฅผ ๋ฐ”๊พธ๊ณ  ํ™•์ธ์‹คํ—˜๊นŒ์ง€ ์ด์–ด๊ฐ€์„ธ์š”

์ˆ˜์œจ์€ ๋†’์ด๊ณ  ๋ถˆ์ˆœ๋ฌผ์€ ๋‚ฎ์ถ”๋Š” ํ•ฉ์„ฑ๋ชจํ˜•์—์„œ ๊ฐ€์ค‘์น˜๋ฅผ ๋ฐ”๊พธ์–ด desirability ํ›„๋ณด์™€ ์ƒˆ 3ํšŒ ํ™•์ธ์‹คํ—˜์„ ๋น„๊ตํ•ฉ๋‹ˆ๋‹ค.

์ฒ˜์Œ์ด๋ผ๋ฉด: ๋ฌด์—‡์„ ๋ˆŒ๋Ÿฌ์•ผ ํ•˜๋‚˜์š”?
  1. 1. ์งˆ๋ฌธ์„ ๋จผ์ € ์ฝ๊ธฐLab ์ œ๋ชฉ์—์„œ ์ด๋ฒˆ์— ๋น„๊ตํ•  ํ•œ ๊ฐ€์ง€๋ฅผ ํ™•์ธํ•ฉ๋‹ˆ๋‹ค.
  2. 2. ์กฐ๊ฑด ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ๊ธฐ์ฒ˜์Œ์—๋Š” n, ํšจ๊ณผ, ์‚ฐํฌ ๊ฐ™์€ ์ž…๋ ฅ ์ค‘ ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ์‹ญ์‹œ์˜ค.
  3. 3. ์ƒˆ ํ•ฉ์„ฑ ํ‘œ๋ณธ ๋ˆ„๋ฅด๊ธฐ์ƒˆ ํ•ฉ์„ฑ ๋ฐ์ดํ„ฐ๊ฐ€ ๋งŒ๋“ค์–ด์ง‘๋‹ˆ๋‹ค. ๊ฐ™์€ ์กฐ๊ฑด๋„ ํ‘œ๋ณธ์— ๋”ฐ๋ผ ๋‹ฌ๋ผ์งˆ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค.
  4. 4. ๊ทธ๋ฆผ๊ณผ ๊ณ„์‚ฐ ๊ฒฐ๊ณผ ๋น„๊ตํ•˜๊ธฐ๋ฐ”๊พธ๊ธฐ ์ „ํ›„ ๋ฌด์—‡์ด ์›€์ง์ด๊ณ  ๋ฌด์—‡์ด ๊ทธ๋Œ€๋กœ์ธ์ง€ ํ•œ ๋ฌธ์žฅ์œผ๋กœ ์ ์–ด๋ณด์‹ญ์‹œ์˜ค.

๋ง‰ํžˆ๋ฉด ์ดˆ๊ธฐํ™”๋กœ ๋Œ์•„๊ฐ€ ๊ธฐ๋ณธ ๊ฒฐ๊ณผ๋ฅผ ๋ณธ ๋’ค ์กฐ๊ฑด ํ•˜๋‚˜๋งŒ ๋ฐ”๊พธ์‹ญ์‹œ์˜ค. ์ด Lab์€ ์ •๋‹ต ํŒ์ •๊ธฐ๊ฐ€ ์•„๋‹ˆ๋ผ ํŒจํ„ด ๊ด€์ฐฐ ๋„๊ตฌ์ž…๋‹ˆ๋‹ค.

๊ฐ™์€ ์„ค์ •์˜ ํ•ฉ์„ฑ ๊ด€์ธก

coded factor space

๊ณ„์‚ฐ ๊ฒฐ๊ณผ

ํ›„๋ณด (x, y)0.30, 0.55
ํ•ฉ์„ฑ desirability0.713
์˜ˆ์ธก/ํ™•์ธ ์ˆ˜์œจ90.21 / 90.26
์˜ˆ์ธก/ํ™•์ธ ๋ถˆ์ˆœ๋ฌผ4.39 / 4.39

์ด ํ›„๋ณด๋Š” โˆ’1โ‰คx,yโ‰ค1 ๊ฒฉ์ž์™€ ํ˜„์žฌ desirability ์ •์˜ ์•ˆ์—์„œ๋งŒ ์ตœ์ ์ž…๋‹ˆ๋‹ค. ํ™•์ธ ์ฐจ์ด๊ฐ€ ํฌ๋ฉด ๋ชจํ˜•ยท๋ฒ”์œ„ยท์‹คํ–‰์˜ค์ฐจ๋ฅผ ๋‹ค์‹œ ๋ด…๋‹ˆ๋‹ค.

๊ต์œก์šฉ synthetic model ยท bjs-response-surface-sequence-v1. ํ•œ ํ–‰์€ ๋ณ„๋„ ํ‘œ์‹œ๊ฐ€ ์—†๋Š” ํ•œ ํ•˜๋‚˜์˜ ๋…๋ฆฝ simulation ๋˜๋Š” ์„ค๊ณ„ run์ž…๋‹ˆ๋‹ค. ์‹ค์ œ ์—ฐ๊ตฌยทํ’ˆ์งˆยท๊ทœ์ œ ํŒ๋‹จ์—๋Š” ์‚ฌ์šฉํ•  ์ˆ˜ ์—†์Šต๋‹ˆ๋‹ค.

The Lab compares synthetic desirability in an educational grid with 0.05 intervals. It does not reproduce continuous optimization algorithms or JMP's internal optimizer, and the confirmation values are also synthetic data.

Connect JMP expressions to result statements

Contour / Surface Plot

๊ฐ™์€ ์ ํ•ฉ๋ชจํ˜•์„ 2D์™€ 3D ๊ด€์ ์—์„œ ์ฝ์Šต๋‹ˆ๋‹ค.

Prediction Profiler / Desirability

๋ชฉํ‘œยทlimitยทimportance๊ฐ€ ๋ฐ”๋€Œ๋ฉด ํ›„๋ณด๋„ ๋ฐ”๋€œ์„ ๊ธฐ๋กํ•ฉ๋‹ˆ๋‹ค.

Augment Design Evaluation

๊ฒฝ๊ณ„ยท๊ณก๋ฅ ยทํ™•์ธ ๋ชฉ์ ์— ๋งž๋Š” ์ถ”๊ฐ€ run์˜ ์ •๋ณด๋ฅผ ๋ด…๋‹ˆ๋‹ค.

Contours and Surfaces show the location of candidates, the Prediction Profiler shows factor cross-sections and targets, and Desirability shows the specified trade-offs. In the Augment evaluation, the information purpose of the additional runs is verified. Capturing the screen alone does not preserve the target, range, and confirmation plan, so the table and receipt should be saved together.

Example of Result Statement

Within the studied range, the yield maximization and impurity minimization desirability were defined with weights of 2 and 1, respectively. The candidate with the largest composite D was x=0.55, y=0.35, which is within the observed region. The mean of three new independent runs differed from the predicted yield by 0.4 units. The next augment is determined based on the target weight sensitivity and confirmation results.

Concluding the Section

  • Contour, surface, and Profiler are different representations of the same model.
  • The target, limit, and importance of desirability are user-defined.
  • An optimal point outside the design region is not a conclusion of the current data.
  • A confirmation experiment is a new, independent run not used in the fitting.
  • Augment points are selected to address remaining aliases, curvature, and prediction questions.
์˜ˆ์ธก ์ตœ์ ์ ์€ ๋ชฉํ‘œํ•จ์ˆ˜์™€ ๊ด€์ธก ์˜์—ญ์— ๋ฌถ์ธ ํ›„๋ณด์ž…๋‹ˆ๋‹ค. ๋‹ค์ค‘๋ฐ˜์‘ ์ ˆ์ถฉยท์™ธ์‚ฝยทํ™•์ธ์‹คํ—˜์„ ๊ธฐ๋กํ•ด์•ผ ๋‹ค์Œ ์‹คํ–‰ ์กฐ๊ฑด์ด ๋ฉ๋‹ˆ๋‹ค.

In the next section, we will look at the output distribution and pass rate, rather than the average, when the input fluctuates around the optimal conditions.

Supplementary Materials for the Formula

This article and the Lab are educational synthetic materials and should not be used as evidence for actual research, process, quality, or regulatory decisions.

๐Ÿ’ฌ Questions & Comments

0 comments

You can post without signing in. Guest comments cannot be edited or deleted by their author.

0/2000

Loading...