AP Statistics Curriculum 2007 Estim MOM MLE
Contents
General Advance-Placement (AP) Statistics Curriculum - Method of Moments and Maximum Likelihood Estimation
Suppose we flip a coin 8 times and observe the number of heads (successes) in the outcomes. How would we estimate the true (unknown) probability of a Head (P(H)=?) for this specific coin? There are a number of other similar situations where we need to evaluate, predict or estimate a population (or process) parameter of interest using an observed data sample.
There are many ways to obtain point (value) estimates of various population parameters of interest, using observed data from the specific process we study. The method of moments and the maximum likelihood estimation are among the most popular ones frequently used in practice.
Method of Moments (MOM) Estimation
Parameter estimation using the method of moments is both intuitive and easy to calculate. The idea is to use the sample data to calculate some sample moments and then set these equal to their corresponding population counterparts. Typically the latter involve the parameter(s) that we are interested in estimating and thus we obtain a computationally tractable protocol for their estimation. Summarizing the MOM:
- First: Determine the k parameters of interest and the specific (model) distribution for this process;
- Second: Compute the first k (or more) sample-moments;
- Third: Set the sample-moments equal to the population moments and solve a (linear or non-linear) system of k equations with k unknowns.
MOM Proportion Example
Let's look at the motivational problem we discussed above. We want to flip a coin 8 times, observe the number of heads (successes) in the outcomes and use that to inffer the true (unknown) probability of a Head (P(H)=?) for this specific coin.
- Hypothetical solution: Suppose we observe the following sequence of outcomes {T,H,T,H,H,T,H,H}. Using the MOM protocol we obtain:
- There is one parameter of interest p=P(H) and the process is a Binomial experiment.
- The first sample-moment for a Binomial process is p=E(X). Therefore, if the random variable X = {# H’s}, then np=8p=E(X)= Sample#H’s = 5 , which yeields that the first sample moment is \(\hat{p}={5\over 8}\). Hence, we would estimate the uknown \(p=P(H) \approx MOM(p)=\hat{p}={5\over 8}\).
- Experimental Solution: We can also use SOCR Experiments to demonstrate the MOM estimation technique. You can refer to the SOCR Coin Sample Experiment for more information of this SOCR applet. The The figure below illustrates flipping a coin 8 times and observing 5 Heads. This is a Binomial(n=8, p=0.65) distribution. However, let's pretend for a minute that we did not know the actual p=P(H) value! So we have a good approximation \(0.65=p=P(H) \approx MOM(p)=\hat{p}={5\over 8}=0.625\). Of course, if we run this experiment again, our MOM estimate for p would change!
References
- SOCR Home page: http://www.socr.ucla.edu
Translate this page:
