Yesterday, eight independently prepared samples had mean response 9.6. Today, eight new samples targeting the same conditions had mean 10.7. The protocol and measurement were the same, but the number changed. Which experiment was wrong?
We cannot conclude that either was wrong. Yesterday and today used two samples made of different independent units. Even when conditions target the same population, different included units can produce different observations and means.
Why do sample results change when they come from the same population?
The previous unit read one sample through mean, SD, distribution, raw points, and replication structure. Now step back: that well-read sample itself can change when the experiment is repeated.
Keep four pairs of terms as a compass and compare their roles in the figures.
First define the boundary of the question
โWhat is our experimental mean?โ is incomplete until we define which cells, donors, times, and culture conditions it concerns. The full target of the research question is the population.
A population need not be a huge visible list. It may be a finite set, such as all specified frozen samples, or the generating process for outcomes from future independent preparations under the same conditions. The essential step is to state where one question ends.
A sample is the observed values from some independent units used to learn about that population. Eight independent cultures prepared today form one sample; eight newly prepared tomorrow can form another sample targeting the same population.
A sample is part of a population but not automatically its perfect miniature. Selecting only convenient samples or overrepresenting one donor, date, or instrument may fail to reflect the question even with many rows. Sample size matters, but cannot replace where and how the sample was obtained.
The samples you can access may cover less than the population in your research question. Statistical software can calculate the entered numbers accurately, but cannot decide whether the result generalizes to a broader target.
Population numbers and sample numbers have different names
A numerical property of the full population is a parameter. We write population mean as ฮผ and population SD as ฯ. A value calculated from the sample in hand is a statistic: sample mean xฬ and sample SD s.
์ ์ํ ๋ชจ์ง๋จ์ด ๊ฐ์ง ํ๊ท
์ด๋ฒ ํ๋ณธ์์ ๊ณ์ฐํ ํ๊ท
๋ชจ์ง๋จ ๊ฐ๋ค์ ํผ์ง
์ด๋ฒ ํ๋ณธ ๊ฐ๋ค์ ํผ์ง
These symbols are a safety boundary between what we want to know and what we actually calculated. We usually cannot observe the entire population and therefore do not know ฮผ or ฯ directly. We learn about them through xฬ and s.
Even if software prints Mean = 10.274, that is xฬ for the entered sample. Extra decimal places do not turn it into a direct observation of ฮผ. A new sample can change both xฬ and s.
Why do means differ within the same population?
Build intuition with a tiny finite population of synthetic teaching values:
6, 8, 10, 12, 14
The population mean is 10. Now draw two values at a time.
| Sample | Values drawn | Sample mean xฬ | Interpretation |
|---|---|---|---|
| A | 6, 8 | 7 | A possible sample below ฮผ |
| B | 8, 12 | 10 | A sample that happens to equal ฮผ |
| C | 12, 14 | 13 | A possible sample above ฮผ |
All three come from the same population, yet their means are 7, 10, and 13. B is not the sole success. The means differ because different units entered each sample.
The thought experiment of repeatedly forming samples from new independent units while keeping the same population and sampling rule is repeated sampling. The change in sample composition and statistics from sample to sample is sampling variation.
Sampling variation does not mean nothing is trustworthy. It makes the expected movement of a result an object of study. Instead of elevating one statistic into fixed truth, we examine how it can move when the same procedure is repeated.
Different sample means alone do not establish process change, instrument error, or biological difference. Sampling variation can create a difference. Investigate design, batch, day, donor, instrument records, and the magnitude of the difference before assigning a cause.
A second distribution appears
In the previous unit, one histogram point represented one experimental unit. That was a distribution of raw observations. Now repeatedly draw equal-sized samples and leave one point for each calculated xฬ. Their distribution is the sampling distribution of the sample mean.
The two plots may share a numerical axis, but one point means something different:
- Raw-data distribution: one observation from one independent experimental unit.
- Sampling distribution: one statistic xฬ summarizing an entire sample.
Always finish the phrase โdistribution of what?โ A sampling distribution of means differs from one of medians. This unit follows sample means only.
What changes when independent sample size grows?
Compare means from samples of four with means from samples of twenty-five. A few unusually low or high values can move a small-sample mean greatly. In a larger sample, many values contribute and their chance effects tend to offset one another.
Under the same generating process and valid independent sampling, means from larger n generally cluster more narrowly around ฮผ. Three boundaries remain:
- One large-sample xฬ need not equal ฮผ exactly.
- Collecting more observations from a biased source does not automatically remove bias.
- Repeated readings of the same biological sample do not increase independent n.
The next unit quantifies movement of sample means with standard error and expresses it as a confidence interval. For now, read how the width of the mean-point cloud changes with n.
Be precise about what was repeated
Reading four technical wells from one culture and preparing four independent cultures can both produce four table rows. The first is technical repetition within one biological unit; the second introduces new independent units from the population.
Technical repeats are useful for examining variation in dispensing and measurement. But more readings of one sample do not provide four new pieces of biological information. To claim repeated sampling, identify which new independent experimental units entered the sample.
Draw the sample again yourself
The mini Lab uses a symmetric continuous generating process with population mean ฮผ=10 and population SD ฯ=3. It is a synthetic model for observing repeated sampling, not real experimental data.
At n=8, press New sample several times. ฮผ remains 10 while this sample's xฬ and s change. Then compare the width of the accumulated mean points at n=4 and n=25.
์ฒ์์ด๋ผ๋ฉด: ๋ฌด์์ ๋๋ฌ์ผ ํ๋์?
- 1. ์ง๋ฌธ์ ๋จผ์ ์ฝ๊ธฐLab ์ ๋ชฉ์์ ์ด๋ฒ์ ๋น๊ตํ ํ ๊ฐ์ง๋ฅผ ํ์ธํฉ๋๋ค.
- 2. ์กฐ๊ฑด ํ๋๋ง ๋ฐ๊พธ๊ธฐ์ฒ์์๋ n, ํจ๊ณผ, ์ฐํฌ ๊ฐ์ ์ ๋ ฅ ์ค ํ๋๋ง ๋ฐ๊พธ์ญ์์ค.
- 3. New sample ๋๋ฅด๊ธฐ์ ํฉ์ฑ ๋ฐ์ดํฐ๊ฐ ๋ง๋ค์ด์ง๋๋ค. ๊ฐ์ ์กฐ๊ฑด๋ ํ๋ณธ์ ๋ฐ๋ผ ๋ฌ๋ผ์ง ์ ์์ต๋๋ค.
- 4. current sample and repeated-mean trail ๋น๊ตํ๊ธฐ๋ฐ๊พธ๊ธฐ ์ ํ ๋ฌด์์ด ์์ง์ด๊ณ ๋ฌด์์ด ๊ทธ๋๋ก์ธ์ง ํ ๋ฌธ์ฅ์ผ๋ก ์ ์ด๋ณด์ญ์์ค.
๋งํ๋ฉด ์ด๊ธฐํ๋ก ๋์๊ฐ ๊ธฐ๋ณธ ๊ฒฐ๊ณผ๋ฅผ ๋ณธ ๋ค ์กฐ๊ฑด ํ๋๋ง ๋ฐ๊พธ์ญ์์ค. ์ด Lab์ ์ ๋ต ํ์ ๊ธฐ๊ฐ ์๋๋ผ ํจํด ๊ด์ฐฐ ๋๊ตฌ์ ๋๋ค.
๊ฐ์ ๋ชจ์ง๋จ์์ ์ ํ๋ณธ์ ๋ฝ์๋ณด์ธ์
๋ชจ์ง๋จ ํ๊ท 10, ๋ชจ์ง๋จ ํ์คํธ์ฐจ 3์ธ ๊ต์ก์ฉ ์์ฑ ๊ณผ์ ์ ๊ณ ์ ํฉ๋๋ค. seed์ ๋ ๋ฆฝ n๋ง ๋ฐ๊พธ๋ฉฐ ์ด๋ฒ ํ๋ณธ์ ํ๊ท ๊ณผ ๋ฐ๋ณต ํ๊ท ๋ค์ ํ์ ์ ๋น๊ตํฉ๋๋ค.
ํ์ฌ ํ๋ณธ์ ์์๋ฃ์
๊ฐ์ ์ค์ ์ผ๋ก ๋ง๋ 24๊ฐ ํ๋ณธํ๊ท
์ด๋ฒ ์คํ์ ๊ตฌ๋ถ
์ด๋ฒ xฬ๊ฐ 10๊ณผ ๋ค๋ฅด๋๋ผ๋ ์ ์์ ๋๋ค. ์ค์ ํ ฮผ๋ ์์ฑ ๊ณผ์ ์ ์ค์ฌ์ด๊ณ xฬ๋ ์ด๋ฒ์ ๋ฝํ ํ๋ณธ์ ๊ณ์ฐ๊ฐ์ ๋๋ค.
๊ฐ์ 40ํ ๋ฐ๋ณต: n=4์ n=25์ ํ๋ณธํ๊ท ํ์
๋ชจํ: ๋์นญ ์ฐ์ํ ์ ๊ท ์์ฑ ๊ณผ์ , ฮผ=10, ฯ=3 ยท PRNG: mulberry32 ยท ๋ณํ: BoxโMuller ยท simulator_version: u04-guided-v1. ์ด Lab์ ๊ฐ๋ ํ์ต์ฉ์ด๋ฉฐ ์ค์ ์ฐ๊ตฌยทํ์งยท์์ ํ๋จ์ ์ฌ์ฉํ ์ ์์ต๋๋ค.
The seed is a starting value that makes pseudorandom results reproducible. The same simulator version, population settings, n, and seed reproduce the same synthetic sample. This is computational reproducibility, not evidence that real cell experiments are biologically reproducible.
Each copied row is one newly drawn independent experimental unit. Different values from the article are normal. Check the relationships instead:
- This xฬ need not equal ฮผ exactly.
- Changing seed changes the sample and its statistics.
- With equal repeat counts, mean points from larger n generally cluster more narrowly.
How does JMP express this phenomenon?
JMP does not design valid sampling for you. It summarizes the entered sample and can graph a column of statistics collected from repeated runs.
ํ์ฌ ํ๋ณธ์ ์์๋ฃ ๋ชจ์๊ณผ MeanยทStd DevยทN์ ๋ณด์ฌ์ค๋๋ค.
์ ํ๋ณธ์ ๋ฃ์ ๋ xฬ์ s๊ฐ ์ด๋ป๊ฒ ๋ฌ๋ผ์ง๋์ง ๋น๊ตํฉ๋๋ค.
๋ฐ๋ณต ์คํ์์ ๋ชจ์ xฬ ๊ฐ๋ค์ ์์น์ ํ๋ค๋ฆผ์ ํํํฉ๋๋ค.
For the current sample, JMP Distribution reports xฬ as Mean, s as Std Dev, and entered row count as N. The researcher must verify that N equals independent experimental units. JMP will not see four technical-repeat rows from one culture and correct โindependent nโ to one.
Across new samples, xฬ and s change. If a ledger contains sample_id, seed, n, and sample_mean, Distribution of sample_mean expresses the locations and movement of sample meansโthe sampling distribution described above.
The relationships to read are:
- Mean for the current sample is statistic xฬ, not parameter ฮผ.
- Mean and Std Dev can change in a new sample.
- Each row in a sample-mean column summarizes a different whole sample.
- Software output does not guarantee population definition, unbiased sampling, or independence.
The figures and Lab teach the concept. If either program is available, import the copied current sample and sample-mean ledger. Screen layouts differ, but the distinction between a current-sample summary and a distribution of repeated statistics is the same.
Five questions before stopping at one mean
- What exactly is my target population? Define subjects, conditions, time, and independent units.
- Do I have the full population or a sample? Separate observed scope from target scope.
- Is the displayed number a parameter or a statistic? A sample calculation is xฬ or s.
- What new independent units were drawn? Do not count technical-repeat rows as new biological samples.
- How would the statistic move under another draw? Do not treat one result as fixed truth.
Sampling variation is not an annoying exception. It is a necessary structure whenever we learn about a population through a sample. Accepting it prepares the next question: how can one express a plausible range for ฮผ around the observed xฬ?
The next unit places a range of uncertainty beside one sample mean. We connect standard error, intervals that move across samples, and the correct repeated-sampling meaning of 95%.
Official supplementary resources
- JMP Statistics Knowledge Portal ยท Descriptive Statistics
- JMP Statistics Knowledge Portal ยท Inferential Statistics
- JMP Academic ยท Probability and Sampling Distributions
- JMP Help ยท Distributions of Continuous Variables
The values, figures, and In-Silico Lab in this article are synthetic material for explaining statistics. They cannot be used as evidence for real research, clinical, quality, or regulatory decisions.