Difference between revisions of "AP Statistics Curriculum 2007 Limits CLT"
(→The Central Limit Theorem) |
m (Text replacement - "{{translate|pageName=http://wiki.stat.ucla.edu/socr/" to ""{{translate|pageName=http://wiki.socr.umich.edu/") |
||
| (11 intermediate revisions by 3 users not shown) | |||
| Line 5: | Line 5: | ||
The following example motivates the need to study the '''sampling distribution of the sample average''', i.e., the distribution of <math>\overline{X_n}={1\over n}\sum_{i=1}^n{X_i}</math>, as we vary the sample {<math>X_1, X_2, X_3, \cdots , X_n</math>}. | The following example motivates the need to study the '''sampling distribution of the sample average''', i.e., the distribution of <math>\overline{X_n}={1\over n}\sum_{i=1}^n{X_i}</math>, as we vary the sample {<math>X_1, X_2, X_3, \cdots , X_n</math>}. | ||
| − | Suppose there are 10 world renowned laboratories each | + | Suppose there are 10 world renowned laboratories, each is charged with conducting the same experiment (e.g., sequencing the genome [http://en.wikipedia.org/wiki/Drosophila Drosophila, the fruit fly]), using the same protocols. One of the outcomes of this study that the sponsor agency is interested could be the ''average rate of occurrence'' of the [http://lists.informatics.jax.org/searches/GO.cgi?id=GO:0033434 ATC codon] in 10,000 base-pairs in the Drosophila genome. After completing the sequencing of the genome, each lab selects a random segment of 1,000,000 base-pairs and counts the number of ATC codons in every segment of 10,000 base-pairs (there are 100 such segments). Finally they compute the average of the 100 counts they obtained. The funding/sponsoring agency receives 10 average counts from the 10 distinct laboratories. Most likely there will be differences between these averages. |
| − | The most important question | + | The funding agency poses the most important question: Can we predict how much variation (i.e., discrepancy) there will be among the 10 lab averages, if we had only been able to fund/conduct one experiment at one site (due to resource/budgetary limitations)? In other words, if the sponsoring organization could only support one lab to carry out the experiment, can they estimate what are the possible errors that may be committed by using the sample average (of 100 samples) obtained from the chosen lab? |
| − | The answer is yes | + | The answer is yes. They can accurately estimate the real count of ATC codons in the Drosophila genome from a single lab experiment as the sampling distribution of the average (across labs) is known to be (approximately) Normal! |
You can see [[SOCR_EduMaterials_Activities_GCLT_Applications | a number of applications of the Central Limit Theorem here]]. | You can see [[SOCR_EduMaterials_Activities_GCLT_Applications | a number of applications of the Central Limit Theorem here]]. | ||
| − | === | + | === General Statement of the Central Limit Theorem=== |
| − | The Central Limit Theorem (CLT) argues that the distribution of the sum or average of independent observations from the same random process (with | + | The Central Limit Theorem (CLT) argues that the distribution of the sum or average of independent observations from the same random process (with finite mean and variance), will be approximately Normally distributed (i.e., bell-shaped curve). That is, the CLT expresses the fact that any sum or average of (many) independent and identically-distributed random variables will tend to be distributed according to a particular ''Attractor Distribution''; the Normal Distribution effectively represents the core of the universe of all (nice) distributions. |
| − | === | + | ===Symbolic Statement of the Central Limit Theorem=== |
| − | The [http://en.wikipedia.org/wiki/Central_limit_theorem formal statement of the CLT is described here] | + | The [http://en.wikipedia.org/wiki/Central_limit_theorem formal statement of the CLT is described here]. However undergraduate and graduate classes uses the following statement of the central limit theorem: |
Let {<math>X_1,X_2, \cdots, Xn</math>} be a random sample (IID) from a (native) distribution with well-defined and finite mean <math>\mu_X</math> and variance <math>\sigma_X^2</math>. Then as n increases, the sampling distributions of the sample average <math>\overline{X_n}={1\over n}\sum_{i=1}^n{X_i}</math> and the total sum <math>\overline{T_n}=\sum_{i=1}^n{X_i}</math> approach Normal distributions with corresponding means and variances: | Let {<math>X_1,X_2, \cdots, Xn</math>} be a random sample (IID) from a (native) distribution with well-defined and finite mean <math>\mu_X</math> and variance <math>\sigma_X^2</math>. Then as n increases, the sampling distributions of the sample average <math>\overline{X_n}={1\over n}\sum_{i=1}^n{X_i}</math> and the total sum <math>\overline{T_n}=\sum_{i=1}^n{X_i}</math> approach Normal distributions with corresponding means and variances: | ||
| Line 23: | Line 23: | ||
: <math>\mu_{\overline{T_n}}=n\times\mu_X; \sigma_{\overline{T_n}}^2={n\times\sigma_X^2}</math> | : <math>\mu_{\overline{T_n}}=n\times\mu_X; \sigma_{\overline{T_n}}^2={n\times\sigma_X^2}</math> | ||
| − | In essence the CLT implies that the Normal | + | In essence, the CLT implies that the Normal Distribution is the center of the universe of all nice distributions. This is the reason why we encounter frequent estimates involving arithmetic-averaging –- the pathway from a nice distribution to Normal distribution is paved by sample averages. In other words, the CLT provides a unifying framework for all (nice) distributions, the way the [http://en.wikipedia.org/wiki/Grand_unifying_theory Grand Unifying Theory] attempts to unite the theory behind the three fundamental forces in physics. |
| − | ===Are | + | ===Are There CLTs for Other Sample Statistics?=== |
| − | The ramifications of the CLT go beyond the scope of this interpretation. For example, one frequently wonders if there are other types of population-parameters or sample-statistics that yield similar limiting behavior. How large does the sample size have to be to ensure normality of the sample average or total sum? Does the convergence depend on the characteristics of the native distribution (e.g., shape, center, dispersion)? How about weighted averages, non-linear combinations or more general functions of the random sample? Many other interesting questions are frequently asked by people exposed to the CLT. Some may have known theoretical answers (exact or approximate); other questions may be better addressed empirically by simulations and experiments ([[SOCR_EduMaterials_Activities_GeneralCentralLimitTheorem |See the SOCR CLT Applet with Activity]]). | + | The ramifications of the CLT go beyond the scope of this interpretation. |
| + | |||
| + | For example, one frequently wonders if there are other types of population-parameters or sample-statistics that yield similar limiting behavior. | ||
| + | * How large does the sample size have to be to ensure normality of the sample average or total sum? | ||
| + | * Does the convergence depend on the characteristics of the native distribution (e.g., shape, center, dispersion)? | ||
| + | * How about weighted averages, non-linear combinations or more general functions of the random sample? | ||
| + | Many other interesting questions are frequently asked by people exposed to the CLT. Some may have known theoretical answers (exact or approximate); other questions may be better addressed empirically by simulations and experiments ([[SOCR_EduMaterials_Activities_GeneralCentralLimitTheorem |See the SOCR CLT Applet with Activity]]). | ||
===CLT Applications=== | ===CLT Applications=== | ||
[[SOCR_EduMaterials_Activities_GCLT_Applications | A number of applications of the Central Limit Theorem are included in the SOCR CLT Activity]]. | [[SOCR_EduMaterials_Activities_GCLT_Applications | A number of applications of the Central Limit Theorem are included in the SOCR CLT Activity]]. | ||
| − | To start the '''SOCR CLT Experiment''' | + | To start the '''SOCR CLT Experiment''' |
| + | * Go to [http://www.socr.ucla.edu/htmls/SOCR_Experiments.html SOCR Experiments] | ||
| + | * Select the '''SOCR Sampling Distribution CLT Experiment''' from the drop-down list of experiments in the left panel. The image below shows the interface to this experiment. Notice the main control widgets on this image (boxed in blue and pointed to by arrows). The generic control buttons on the top allow you to do one or multiple steps/runs, stop and reset this experiment. The two tabs in the main frame provide graphical access to the results of the experiment (Histograms and Summaries) or the Distribution selection panel (Distributions). Remember that choosing sample-sizes <= 16 will animate the samples (second graphing row), whereas larger sample-sizes (N>20) will only show the updates of the sampling distributions (bottom two graphing rows). | ||
<center>[[Image:SOCR_Activities_General_CLT_Dinov_012207_Fig1.jpg|400px]]</center> | <center>[[Image:SOCR_Activities_General_CLT_Dinov_012207_Fig1.jpg|400px]]</center> | ||
| + | * In the [http://socr.ucla.edu/htmls/exp/Sampling_Distribution_CLT_Experiment.html Sampling Distribution CLT Experiment], select [[UQuadraticDistribuionAbout | Q-quadratic distribution]] (under the distribution tab). Set the sample sizes (n1 and n2) first to 2 and then to 4. Observe the shape of the sampling distribution -- it will become first tri-modal (n=2) and then five-modal (for n=4), respectively. As the sample sizes exceed 5, these multiple modes will merge into one, and the sampling distribution will become unimodal. Of course, the CLT guarantees that the sampling distribution of the average will ultimately become Normal, as the sample size increases. | ||
| + | |||
| + | ===[[EBook_Problems_Limits_CLT|Problems]]=== | ||
| + | |||
<hr> | <hr> | ||
| + | |||
===References=== | ===References=== | ||
| + | * Dinov, ID, Christou, N, and Sanchez, J (2008) ''Central Limit Theorem: New SOCR Applet and Demonstration Activity''. [http://www.amstat.org/publications/jse/v16n2/dinov.html Journal of Statistics Education, Volume 16, Number 2]. | ||
<hr> | <hr> | ||
* SOCR Home page: http://www.socr.ucla.edu | * SOCR Home page: http://www.socr.ucla.edu | ||
| − | {{translate|pageName=http://wiki. | + | "{{translate|pageName=http://wiki.socr.umich.edu/index.php?title=AP_Statistics_Curriculum_2007_Limits_CLT}} |
Latest revision as of 14:24, 3 March 2020
Contents
General Advance-Placement (AP) Statistics Curriculum - The Central Limit Theorem
Motivation
The following example motivates the need to study the sampling distribution of the sample average, i.e., the distribution of \(\overline{X_n}={1\over n}\sum_{i=1}^n{X_i}\), as we vary the sample {\(X_1, X_2, X_3, \cdots , X_n\)}.
Suppose there are 10 world renowned laboratories, each is charged with conducting the same experiment (e.g., sequencing the genome Drosophila, the fruit fly), using the same protocols. One of the outcomes of this study that the sponsor agency is interested could be the average rate of occurrence of the ATC codon in 10,000 base-pairs in the Drosophila genome. After completing the sequencing of the genome, each lab selects a random segment of 1,000,000 base-pairs and counts the number of ATC codons in every segment of 10,000 base-pairs (there are 100 such segments). Finally they compute the average of the 100 counts they obtained. The funding/sponsoring agency receives 10 average counts from the 10 distinct laboratories. Most likely there will be differences between these averages.
The funding agency poses the most important question: Can we predict how much variation (i.e., discrepancy) there will be among the 10 lab averages, if we had only been able to fund/conduct one experiment at one site (due to resource/budgetary limitations)? In other words, if the sponsoring organization could only support one lab to carry out the experiment, can they estimate what are the possible errors that may be committed by using the sample average (of 100 samples) obtained from the chosen lab?
The answer is yes. They can accurately estimate the real count of ATC codons in the Drosophila genome from a single lab experiment as the sampling distribution of the average (across labs) is known to be (approximately) Normal!
You can see a number of applications of the Central Limit Theorem here.
General Statement of the Central Limit Theorem
The Central Limit Theorem (CLT) argues that the distribution of the sum or average of independent observations from the same random process (with finite mean and variance), will be approximately Normally distributed (i.e., bell-shaped curve). That is, the CLT expresses the fact that any sum or average of (many) independent and identically-distributed random variables will tend to be distributed according to a particular Attractor Distribution; the Normal Distribution effectively represents the core of the universe of all (nice) distributions.
Symbolic Statement of the Central Limit Theorem
The formal statement of the CLT is described here. However undergraduate and graduate classes uses the following statement of the central limit theorem:
Let {\(X_1,X_2, \cdots, Xn\)} be a random sample (IID) from a (native) distribution with well-defined and finite mean \(\mu_X\) and variance \(\sigma_X^2\). Then as n increases, the sampling distributions of the sample average \(\overline{X_n}={1\over n}\sum_{i=1}^n{X_i}\) and the total sum \(\overline{T_n}=\sum_{i=1}^n{X_i}\) approach Normal distributions with corresponding means and variances: \[\mu_{\overline{X_n}}=\mu_X; \sigma_{\overline{X_n}}^2={\sigma_X^2\over n}\] \[\mu_{\overline{T_n}}=n\times\mu_X; \sigma_{\overline{T_n}}^2={n\times\sigma_X^2}\]
In essence, the CLT implies that the Normal Distribution is the center of the universe of all nice distributions. This is the reason why we encounter frequent estimates involving arithmetic-averaging –- the pathway from a nice distribution to Normal distribution is paved by sample averages. In other words, the CLT provides a unifying framework for all (nice) distributions, the way the Grand Unifying Theory attempts to unite the theory behind the three fundamental forces in physics.
Are There CLTs for Other Sample Statistics?
The ramifications of the CLT go beyond the scope of this interpretation.
For example, one frequently wonders if there are other types of population-parameters or sample-statistics that yield similar limiting behavior.
- How large does the sample size have to be to ensure normality of the sample average or total sum?
- Does the convergence depend on the characteristics of the native distribution (e.g., shape, center, dispersion)?
- How about weighted averages, non-linear combinations or more general functions of the random sample?
Many other interesting questions are frequently asked by people exposed to the CLT. Some may have known theoretical answers (exact or approximate); other questions may be better addressed empirically by simulations and experiments (See the SOCR CLT Applet with Activity).
CLT Applications
A number of applications of the Central Limit Theorem are included in the SOCR CLT Activity.
To start the SOCR CLT Experiment
- Go to SOCR Experiments
- Select the SOCR Sampling Distribution CLT Experiment from the drop-down list of experiments in the left panel. The image below shows the interface to this experiment. Notice the main control widgets on this image (boxed in blue and pointed to by arrows). The generic control buttons on the top allow you to do one or multiple steps/runs, stop and reset this experiment. The two tabs in the main frame provide graphical access to the results of the experiment (Histograms and Summaries) or the Distribution selection panel (Distributions). Remember that choosing sample-sizes <= 16 will animate the samples (second graphing row), whereas larger sample-sizes (N>20) will only show the updates of the sampling distributions (bottom two graphing rows).
- In the Sampling Distribution CLT Experiment, select Q-quadratic distribution (under the distribution tab). Set the sample sizes (n1 and n2) first to 2 and then to 4. Observe the shape of the sampling distribution -- it will become first tri-modal (n=2) and then five-modal (for n=4), respectively. As the sample sizes exceed 5, these multiple modes will merge into one, and the sampling distribution will become unimodal. Of course, the CLT guarantees that the sampling distribution of the average will ultimately become Normal, as the sample size increases.
Problems
References
- Dinov, ID, Christou, N, and Sanchez, J (2008) Central Limit Theorem: New SOCR Applet and Demonstration Activity. Journal of Statistics Education, Volume 16, Number 2.
- SOCR Home page: http://www.socr.ucla.edu
"-----
Translate this page:
