Family physician count and service provision in Ontario and Alberta between 2005/06 and 2017/18: a cross-sectional study
McDonald T, Schultz SE, Green LA, Lethebe BC, Glazier RH. CMAJ Open. 2023; 11(6):E1102-8. Epub 2023 Nov 28.
Objective — We examined the impact on statistical inference when a χ2 test is used to compare the proportion of successes in the level of a categorical variable that has the highest observed proportion of successes with the proportion of successes in all other levels of the categorical variable combined.
Study Design and Setting — Monte Carlo simulations and a case study examining the association between astrological sign and hospitalization for heart failure.
Results — A standard χ2 test results in an inflation of the type I error rate, with the type I error rate increasing as the number of levels of the categorical variable increases. Using a standard χ2 test, the hospitalization rate for Pisces was statistically significantly different from that of the other 11 astrological signs combined (P=0.026). After accounting for the fact that the selection of Pisces was based on it having the highest observed proportion of heart failure hospitalizations, subjects born under the sign of Pisces no longer had a significantly higher rate of heart failure hospitalization compared to the other residents of Ontario (P=0.152).
Conclusions — Post hoc comparisons of the proportions of successes across different levels of a categorical variable can result in incorrect inferences.
Austin PC, Goldwasser MA. J Clin Epidemiol. 2008; 61(3):295-300. Epub 2007 Sep 24.
The ICES website uses cookies. If that’s okay with you, keep on browsing, or learn more about our Privacy Policy.