Comparison of imputation methods for missing laboratory data in medicine

Akbar K. Waljee, Ashin Mukherjee, Amit G. Singal, Yiwei Zhang, Jeffrey Warren, Ulysses Balis, Jorge Marrero, Ji Zhu, Peter D R Higgins

Research output: Contribution to journalArticlepeer-review

282 Scopus citations

Abstract

Objectives: Missing laboratory data is a common issue, but the optimal method of imputation of missing values has not been determined. The aims of our study were to compare the accuracy of four imputation methods for missing completely at random laboratory data and to compare the effect of the imputed values on the accuracy of two clinical predictive models. Design: Retrospective cohort analysis of two large data sets. Setting: A tertiary level care institution in Ann Arbor, Michigan. Participants: The Cirrhosis cohort had 446 patients and the Inflammatory Bowel Disease cohort had 395 patients. Methods: Non-missing laboratory data were randomly removed with varying frequencies from two large data sets, and we then compared the ability of four methods-missForest, mean imputation, nearest neighbour imputation and multivariate imputation by chained equations (MICE)-to impute the simulated missing data. We characterised the accuracy of the imputation and the effect of the imputation on predictive ability in two large data sets. Results: MissForest had the least imputation error for both continuous and categorical variables at each frequency of missingness, and it had the smallest prediction difference when models used imputed laboratory values. In both data sets, MICE had the second least imputation error and prediction difference, followed by the nearest neighbour and mean imputation. Conclusions: MissForest is a highly accurate method of imputation for missing laboratory data and outperforms other common imputation techniques in terms of imputation error and maintenance of predictive ability with imputed values in two clinical predicative models.

Original languageEnglish (US)
Article numbere002847
JournalBMJ Open
Volume3
Issue number8
DOIs
StatePublished - 2013

ASJC Scopus subject areas

  • General Medicine

Fingerprint

Dive into the research topics of 'Comparison of imputation methods for missing laboratory data in medicine'. Together they form a unique fingerprint.

Cite this