User:Timothee Flutre/Notebook/Postdoc/2011/11/10
From OpenWetWare
(→Bayesian model of univariate linear regression for QTL detection: start adding marginal posterior of B) 
(→Bayesian model of univariate linear regression for QTL detection: finish marginal posterior of B) 

Line 34:  Line 34:  
<math>Y  X, \tau, B \sim \mathcal{N}(XB, \tau^{1} I_N)</math>  <math>Y  X, \tau, B \sim \mathcal{N}(XB, \tau^{1} I_N)</math>  
+  
+  Even though we can write the likelihood as a multivariate Normal, I still keep the term "univariate" in the title because the covariance matrix of <math>Y  X, \tau, B</math> remains a single real number, <math>\tau</math>.  
The likelihood of the parameters given the data is therefore:  The likelihood of the parameters given the data is therefore:  
Line 42:  Line 44:  
  * '''Priors''': we use the usual conjugate prior  +  * '''Priors''': we use the usual [http://en.wikipedia.org/wiki/Conjugate_prior conjugate prior] 
<math>\mathsf{P}(\tau, B) = \mathsf{P}(\tau) \mathsf{P}(B  \tau)</math>  <math>\mathsf{P}(\tau, B) = \mathsf{P}(\tau) \mathsf{P}(B  \tau)</math>  
Line 152:  Line 154:  
<math>\mathsf{P}(B  Y, X) = \frac{\frac{\lambda^\ast}{2}^{\frac{N+\kappa}{2}} \Gamma(\frac{N+\kappa+3}{2})}{(2\pi)^\frac{3}{2} \Omega^{\frac{1}{2}} \Gamma(\frac{N+\kappa}{2})} \left( \frac{\lambda^\ast}{2} + (B  \Omega X^TY)^T \Omega^{1} (B  \Omega X^TY) \right)^{\frac{N+\kappa+3}{2}}</math>  <math>\mathsf{P}(B  Y, X) = \frac{\frac{\lambda^\ast}{2}^{\frac{N+\kappa}{2}} \Gamma(\frac{N+\kappa+3}{2})}{(2\pi)^\frac{3}{2} \Omega^{\frac{1}{2}} \Gamma(\frac{N+\kappa}{2})} \left( \frac{\lambda^\ast}{2} + (B  \Omega X^TY)^T \Omega^{1} (B  \Omega X^TY) \right)^{\frac{N+\kappa+3}{2}}</math>  
+  
+  And we now recognize a [http://en.wikipedia.org/wiki/Multivariate_tdistribution multivariate t distribution]:  
+  
+  <math>\mathsf{P}(B  Y, X) = \frac{\Gamma(\frac{N+\kappa+3}{2})}{\Gamma(\frac{N+\kappa}{2}) \pi^\frac{3}{2} \lambda^\ast \Omega^{\frac{1}{2}} } \left( 1 + \frac{(B  \Omega X^TY)^T \Omega^{1} (B  \Omega X^TY)}{\lambda^\ast} \right)^{\frac{N+\kappa+3}{2}}</math>  
<! ##### DO NOT edit below this line unless you know what you are doing. ##### >  <! ##### DO NOT edit below this line unless you know what you are doing. ##### > 
Revision as of 01:23, 22 November 2012
Project name  Main project page Previous entry Next entry 
Bayesian model of univariate linear regression for QTL detectionSee Servin & Stephens (PLoS Genetics, 2007).
where β_{1} is in fact the additive effect of the SNP, noted a from now on, and β_{2} is the dominance effect of the SNP, d = ak. Let's now write the model in matrix notation:
This gives the following multivariate Normal distribution for the phenotypes:
Even though we can write the likelihood as a multivariate Normal, I still keep the term "univariate" in the title because the covariance matrix of Y  X,τ,B remains a single real number, τ. The likelihood of the parameters given the data is therefore:
A Gamma distribution for τ:
which means:
And a multivariate Normal distribution for B:
which means:
Here and in the following, we neglect all constants (e.g. normalization constant, Y^{T}Y, etc):
We use the prior and likelihood and keep only the terms in B:
We expand:
We factorize some terms:
Let's define . We can see that Ω^{T} = Ω, which means that Ω is a symmetric matrix. This is particularly useful here because we can use the following equality: Ω^{ − 1}Ω^{T} = I.
This now becomes easy to factorizes totally:
We recognize the kernel of a Normal distribution, allowing us to write the conditional posterior as:
Similarly to the equations above:
But now, to handle the second term, we need to integrate over B, thus effectively taking into account the uncertainty in B:
Again, we use the priors and likelihoods specified above (but everything inside the integral is kept inside it, even if it doesn't depend on B!):
As we used a conjugate prior for τ, we know that we expect a Gamma distribution for the posterior. Therefore, we can take τ^{N / 2} out of the integral and start guessing what looks like a Gamma distribution. We also factorize inside the exponential:
We recognize the conditional posterior of B. This allows us to use the fact that the pdf of the Normal distribution integrates to one:
We finally recognize a Gamma distribution, allowing us to write the posterior as:
where
Here we recognize the formula to integrate the Gamma function:
And we now recognize a multivariate t distribution:
