User:Carl Boettiger/Notebook/Comparative Phylogenetics/2010/02/10
Comparative Phylogenetics  Main project page Previous entry Next entry 
Followup on Parametric Bootstrapping
"I've read up a bit on the bootstrap just now. First off, although parametric and nonparametric bootstrapping has always seemed very different to me, they fit in the same natural framework. The general idea is that in reality, there's some real parameters x and some probability distribution P that's given us some data. We get an estimate x' from that data. To estimate confidence (or whathaveyou) in x', we get some estimate P' of *the probability distribution*, and use P' to make a bunch more fake data, to which we apply the estimation procedures, etcetera. We could get P' by assuming a parametric model and plugging in x'. Or, we could resample from the data, or permute it, etcetera. I suppose that you've seen the 'boot' package in R? It does both parametric and nonparametric bootstrapping, and its function boot.ci() computes confidence intervals in some sophisticated ways. Sophisticated ways? Why do we need to be more sophisticated? Well, the simple, straightforward method that we were using in the discussion is fine, really, but there's some corrections to it that make it better. Briefly, the bootstrap introduces (small) biases. Some references are: "Bootstrap confidence intervals", a review, http://www.jstor.org/stable/2246110 "Better bootstrap confidence intervals", describing the method BCa, http://www.jstor.org/stable/2289144 (and which does *not* come after the above article, btw) both by Bradley Efron. Note that here ABC refers to "approximate bootstrap", not "approximate bayesian". One message is that one needs about 1,000 bootstrap replicates to get good confidence intervals. One interesting note from the first article: the "standard" confidence intervals are not transformation invariant: often it is advisable to apply some transformation (e.g. tanh^{1}) to the data to get the intervals. The BCa bootstrap intervals are, by contrast, transformation invariant."
