Should we use logistic mixed model analysis for the effect estimation in a longitudinal RCT with a dichotomous outcome variable?

Abstract

Background: Within epidemiology both mixed model analysis and Generalised Estimating Equations (GEE analysis) are frequently used to analyse longitudinal RCT data. With a continuous outcome, both methods lead to more or less the same results, but with a dichotomous outcome the results are totally different. The purpose of the present study is to evaluate the performance of a logistic mixed model analysis and a logistic GEE analysis and to give an advice which of the two methods should be used.

Methods: Two real life RCT datasets with and without missing data were used to perform this evaluation. Regarding the logistic mixed model analysis also two different estimation procedures were compared to each other.

Results: The regression coefficients obtained from the two logistic mixed model analyses were different from each other, but were always higher then the regression coefficients derived from a logistic GEE analysis. Because this also holds for the standard errors, the corresponding p-values were more or less the same. It was further shown that the effect estimates derived from a logistic mixed model analysis were an overestimation of the ‘real’ effect estimates.

Conclusions:  Although logistic mixed model analysis is widely used for the analysis of longitudinal RCT data, this article shows that logistic mixed model analysis should not be used when one is interested in the magnitude of the regression coefficients (i.e. effect estimates).