Difference between revisions of "AP Statistics Curriculum 2007 Bayesian Prelim"
(New page: '''Bayes Theorem''' Bayes theorem is associated with probability statements that relate conditional and marginal properties of two random events. These statements are often written in the...) |
m (Text replacement - "{{translate|pageName=http://wiki.stat.ucla.edu/socr/" to ""{{translate|pageName=http://wiki.socr.umich.edu/") |
||
| (25 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
| − | + | ==[[EBook | Probability and Statistics Ebook]] - Bayes Theorem== | |
| − | Bayes | + | ===Introduction=== |
| + | Bayes Theorem, or "Bayes Rule" can be stated succinctly by the equality | ||
| − | P(A) | + | : <math>P(A|B) = \frac{P(B|A) \cdot P(A)} {P(B)}</math> |
| − | + | In words, "the probability of event A occurring given that event B occurred is equal to the probability of event B occurring given that event A occurred times the probability of event A occurring divided by the probability that event B occurs." | |
| − | + | Bayes Theorem can also be written in terms of densities or likelihood functions over continuous random variables. Let's call <math>f(\star)</math> the density (or in some cases, the likelihood) defined by the random process <math>\star</math>. If <math>X</math> and <math>Y</math> are random variables, we can say | |
| − | P( | + | <math>f(Y|X) = \frac{f(X|Y) \cdot f(Y)} { f(X) }</math> |
| + | |||
| + | ===Example=== | ||
| + | Suppose a laboratory blood test is used as evidence for a disease. Assume P(positive Test| Disease) = 0.95, P(positive Test| no Disease)=0.01 and P(Disease) = 0.005. Find P(Disease|positive Test)=? | ||
| + | |||
| + | Denote D = {the test person has the disease}, <math>D^c</math> = {the test person does not have the disease} and T = {the test result is positive}. Then | ||
| + | <center><math>P(D | T) = {P(T | D) P(D) \over P(T)} = {P(T | D) P(D) \over P(T|D)P(D) + P(T|D^c)P(D^c)}=</math> | ||
| + | <math>={0.95\times 0.005 \over {0.95\times 0.005 +0.01\times 0.995}}=0.3231293.</math></center> | ||
| + | |||
| + | ===Bayesian Statstics=== | ||
| + | What is commonly called '''Bayesian Statistics''' is a very special application of Bayes Theorem. | ||
| + | |||
| + | We will examine a number of examples in this Chapter, but to illustrate generally, imagine that '''x''' is a fixed collection of data that has been realized from some known density, <math>f(X)</math>, that takes a parameter, <math>\mu</math>, whose value is not certainly known. | ||
| + | |||
| + | Using Bayes Theorem we may write | ||
| + | |||
| + | : <math>f(\mu|\mathbf{x}) = \frac{f(\mathbf{x}|\mu) \cdot f(\mu)} { f(\mathbf{x}) }</math> | ||
| + | |||
| + | In this formulation, we solve for <math>f(\mu|\mathbf{x})</math>, the "posterior" density of the population parameter, <math>\mu</math>. | ||
| + | |||
| + | For this we utilize the likelihood function of our data given our parameter, <math>f(\mathbf{x}|\mu) </math>, and, importantly, a density <math>f(\mu)</math>, that describes our "prior" belief in <math>\mu</math>. | ||
| + | |||
| + | Since <math>\mathbf{x}</math> is fixed, <math>f(\mathbf{x})</math> is a fixed number -- a "normalizing constant" so to ensure that the posterior density integrates to one. | ||
| + | |||
| + | <math>f(\mathbf{x}) = \int_{\mu} f( \mathbf{x} \cap \mu) d\mu = \int_{\mu} f( \mathbf{x} | \mu ) f(\mu) d\mu </math> | ||
| + | |||
| + | ==See also== | ||
| + | * [[EBook#Chapter_III:_Probability |Probability Chapter]] | ||
| + | |||
| + | ==References== | ||
| + | |||
| + | <hr> | ||
| + | * SOCR Home page: http://www.socr.ucla.edu | ||
| + | |||
| + | "{{translate|pageName=http://wiki.socr.umich.edu/index.php?title=AP_Statistics_Curriculum_2007_Bayesian_Prelim}} | ||
Latest revision as of 13:41, 3 March 2020
Contents
Probability and Statistics Ebook - Bayes Theorem
Introduction
Bayes Theorem, or "Bayes Rule" can be stated succinctly by the equality
\[P(A|B) = \frac{P(B|A) \cdot P(A)} {P(B)}\]
In words, "the probability of event A occurring given that event B occurred is equal to the probability of event B occurring given that event A occurred times the probability of event A occurring divided by the probability that event B occurs."
Bayes Theorem can also be written in terms of densities or likelihood functions over continuous random variables. Let's call \(f(\star)\) the density (or in some cases, the likelihood) defined by the random process \(\star\). If \(X\) and \(Y\) are random variables, we can say
\(f(Y|X) = \frac{f(X|Y) \cdot f(Y)} { f(X) }\)
Example
Suppose a laboratory blood test is used as evidence for a disease. Assume P(positive Test| Disease) = 0.95, P(positive Test| no Disease)=0.01 and P(Disease) = 0.005. Find P(Disease|positive Test)=?
Denote D = {the test person has the disease}, \(D^c\) = {the test person does not have the disease} and T = {the test result is positive}. Then
Bayesian Statstics
What is commonly called Bayesian Statistics is a very special application of Bayes Theorem.
We will examine a number of examples in this Chapter, but to illustrate generally, imagine that x is a fixed collection of data that has been realized from some known density, \(f(X)\), that takes a parameter, \(\mu\), whose value is not certainly known.
Using Bayes Theorem we may write
\[f(\mu|\mathbf{x}) = \frac{f(\mathbf{x}|\mu) \cdot f(\mu)} { f(\mathbf{x}) }\]
In this formulation, we solve for \(f(\mu|\mathbf{x})\), the "posterior" density of the population parameter, \(\mu\).
For this we utilize the likelihood function of our data given our parameter, \(f(\mathbf{x}|\mu) \), and, importantly, a density \(f(\mu)\), that describes our "prior" belief in \(\mu\).
Since \(\mathbf{x}\) is fixed, \(f(\mathbf{x})\) is a fixed number -- a "normalizing constant" so to ensure that the posterior density integrates to one.
\(f(\mathbf{x}) = \int_{\mu} f( \mathbf{x} \cap \mu) d\mu = \int_{\mu} f( \mathbf{x} | \mu ) f(\mu) d\mu \)
See also
References
- SOCR Home page: http://www.socr.ucla.edu
"-----
Translate this page:
