Does a sample statistic always have a normal distribution?

Answer 1

No, many sample statistics do not have a normal distribution. In most cases order statistics, such as the minimum or the maximum, are not normally distributed, even when the underlying data themselves have a common normal distribution. The geometric mean (for positive-valued data) almost never has a normal distribution. Practically important statistics, including the chi-square statistic, the F-statistic, and the R-squared statistic of regression, do not have normal distributions. Typically, the normal distribution arises as a good approximation when the sample statistic acts like the independent sum of variables none of whose variances dominates the total variance: this is a loose statement of the Central Limit Theorem. A sample sum and mean, when the elements of the sample are independently obtained, will therefore often be approximately normally distributed provided the sample is large enough.