User:Timothee Flutre/Notebook/Postdoc/2011/11/10
From OpenWetWare
(→Bayesian model of univariate linear regression for QTL detection: fix typo) 
(→Bayesian model of univariate linear regression for QTL detection: start adding marginal posterior of B) 

Line 63:  Line 63:  
  * '''Joint posterior''':  +  * '''Joint posterior (1)''': 
<math>\mathsf{P}(\tau, B  Y, X) = \mathsf{P}(\tau  Y, X) \mathsf{P}(B  Y, X, \tau)</math>  <math>\mathsf{P}(\tau, B  Y, X) = \mathsf{P}(\tau  Y, X) \mathsf{P}(B  Y, X, \tau)</math>  
Line 134:  Line 134:  
<math>\tau  Y, X \sim \Gamma \left( \frac{N+\kappa}{2}, \; \frac{1}{2} (Y^T X \Omega X^T Y + Y^T Y + \lambda) \right)</math>  <math>\tau  Y, X \sim \Gamma \left( \frac{N+\kappa}{2}, \; \frac{1}{2} (Y^T X \Omega X^T Y + Y^T Y + \lambda) \right)</math>  
+  
+  
+  * '''Joint posterior (2)''': sometimes it is said that the joint posterior follows a Normal Inverse Gamma distribution:  
+  
+  <math>B, \tau  Y, X \sim \mathcal{N}IG(\Omega X^TY, \tau^{1}\Omega, \frac{N+\kappa}{2}, \frac{\lambda^\ast}{2})</math>  
+  
+  where <math>\lambda^\ast = (Y^T X \Omega X^T Y + Y^T Y + \lambda)</math>  
+  
+  
+  * '''Marginal posterior of B''': we can now integrate out <math>\tau</math>:  
+  
+  <math>\mathsf{P}(B  Y, X) = \int \mathsf{P}(B, \tau  Y, X) \mathsf{d}\tau</math>  
+  
+  <math>\mathsf{P}(B  Y, X) = \frac{\frac{\lambda^\ast}{2}^{\frac{N+\kappa}{2}}}{(2\pi)^\frac{3}{2} \Omega^{\frac{1}{2}} \Gamma(\frac{N+\kappa}{2})} \int \tau^{\frac{N+\kappa+3}{2}1} exp \left[\tau \left( \frac{\lambda^\ast}{2} + (B  \Omega X^TY)^T \Omega^{1} (B  \Omega X^TY) \right) \right] \mathsf{d}\tau</math>  
+  
+  Here we recognize the formula to [http://en.wikipedia.org/wiki/Gamma_function#Integration_problems integrate the Gamma function]:  
+  
+  <math>\mathsf{P}(B  Y, X) = \frac{\frac{\lambda^\ast}{2}^{\frac{N+\kappa}{2}} \Gamma(\frac{N+\kappa+3}{2})}{(2\pi)^\frac{3}{2} \Omega^{\frac{1}{2}} \Gamma(\frac{N+\kappa}{2})} \left( \frac{\lambda^\ast}{2} + (B  \Omega X^TY)^T \Omega^{1} (B  \Omega X^TY) \right)^{\frac{N+\kappa+3}{2}}</math>  
<! ##### DO NOT edit below this line unless you know what you are doing. ##### >  <! ##### DO NOT edit below this line unless you know what you are doing. ##### > 
Revision as of 22:19, 21 November 2012
Project name  Main project page Previous entry Next entry 
Bayesian model of univariate linear regression for QTL detectionSee Servin & Stephens (PLoS Genetics, 2007).
where β_{1} is in fact the additive effect of the SNP, noted a from now on, and β_{2} is the dominance effect of the SNP, d = ak. Let's now write the model in matrix notation:
This gives the following multivariate Normal distribution for the phenotypes:
The likelihood of the parameters given the data is therefore:
A Gamma distribution for τ:
which means:
And a multivariate Normal distribution for B:
which means:
Here and in the following, we neglect all constants (e.g. normalization constant, Y^{T}Y, etc):
We use the prior and likelihood and keep only the terms in B:
We expand:
We factorize some terms:
Let's define . We can see that Ω^{T} = Ω, which means that Ω is a symmetric matrix. This is particularly useful here because we can use the following equality: Ω^{ − 1}Ω^{T} = I.
This now becomes easy to factorizes totally:
We recognize the kernel of a Normal distribution, allowing us to write the conditional posterior as:
Similarly to the equations above:
But now, to handle the second term, we need to integrate over B, thus effectively taking into account the uncertainty in B:
Again, we use the priors and likelihoods specified above (but everything inside the integral is kept inside it, even if it doesn't depend on B!):
As we used a conjugate prior for τ, we know that we expect a Gamma distribution for the posterior. Therefore, we can take τ^{N / 2} out of the integral and start guessing what looks like a Gamma distribution. We also factorize inside the exponential:
We recognize the conditional posterior of B. This allows us to use the fact that the pdf of the Normal distribution integrates to one:
We finally recognize a Gamma distribution, allowing us to write the posterior as:
where
Here we recognize the formula to integrate the Gamma function:
