AdaBoosted Deep Ensembles: Getting Maximum Performance Out of Small Training Datasets

Syed M.S. Reza, John A. Butman, Deric M. Park, Dzung L. Pham, Snehashis Roy

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Even though state-of-the-art convolutional neural networks (CNNs) have shown outstanding performance in a wide range of imaging applications, they typically require large amounts of high-quality training data to prevent over fitting. In the case of medical image segmentation, it is often difficult to gain access to large data sets, particularly those involving rare diseases, such as skull-based chordoma tumors. This challenge is exacerbated by the difficulty in performing manual delineations, which are time-consuming and can have inconsistent quality. In this work, we propose a deep ensemble method that learns multiple models, trained using a leave-one-out strategy, and then aggregates the outputs for test data through a boosting strategy. The proposed method was evaluated for chordoma tumor segmentation in head magnetic resonance images using three well-known CNN architectures; VNET, UNET, and Feature pyramid network (FPN). Significantly improved Dice scores (up to 27%) were obtained using the proposed ensemble method when compared to a single model trained with all available training subjects. The proposed ensemble method can be applied to any neural network based segmentation method to potentially improve generalizability when learning from a small sized dataset.

Original languageEnglish
Title of host publicationMachine Learning in Medical Imaging - 11th International Workshop, MLMI 2020, Held in Conjunction with MICCAI 2020, Proceedings
EditorsMingxia Liu, Chunfeng Lian, Pingkun Yan, Xiaohuan Cao
PublisherSpringer Science and Business Media Deutschland GmbH
Pages572-582
Number of pages11
ISBN (Print)9783030598600
DOIs
StatePublished - 2020
Event11th International Workshop on Machine Learning in Medical Imaging, MLMI 2020, held in conjunction with the 23rd International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2020 - Lima, Peru
Duration: Oct 4 2020Oct 4 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12436 LNCS

Conference

Conference11th International Workshop on Machine Learning in Medical Imaging, MLMI 2020, held in conjunction with the 23rd International Conference on Medical Image Computing and Computer Assisted Intervention, MICCAI 2020
Country/TerritoryPeru
CityLima
Period10/4/2010/4/20

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'AdaBoosted Deep Ensembles: Getting Maximum Performance Out of Small Training Datasets'. Together they form a unique fingerprint.

Cite this