Preterm birth is often associated with impaired neurodevelopment. Quantitative evaluation of MR images may indicate the state and expected progression of brain development in preterm born infants and aid in the decision of future interventions. Segmentation of different tissue types in the brain is a prerequisite for obtaining such MRI measurements.
In this project, we design methods for automatic and quantitative analysis of neonatal MR brain images in a longitudinally imaged cohort of preterm infants, focusing on brain tissue volumes and cortical morphology.


Automatic segmentation of images acquired at 30 (left) and 40 weeks postmenstrual age (right), in unmyelinated white matter (red), cortical grey matter (yellow), and cerebrospinal fluid in the extracerebral space (blue).
Researchers
Journal Articles |
|
1. | P. Moeskops, J. de Bresser, H.J Kuijf, A.M Mendrik, G.J. Biessels, J.P. Pluim, I. Išgum NeuroImage Clinical, 17 , pp. 251-262, 2017. @article{moesk18, title = {Evaluation of a deep learning approach for the segmentation of brain tissues and white matter hyperintensities of presumed vascular origin in MRI}, author = {P. Moeskops, J. de Bresser, H.J Kuijf, A.M Mendrik, G.J. Biessels, J.P. Pluim, I. Išgum}, url = {http://www.sciencedirect.com/science/article/pii/S2213158217302486}, year = {2017}, date = {2017-10-06}, journal = {NeuroImage Clinical}, volume = {17}, pages = {251-262}, abstract = {Automatic segmentation of brain tissues and white matter hyperintensities of presumed vascular origin (WMH) in MRI of older patients is widely described in the literature. Although brain abnormalities and motion artefacts are common in this age group, most segmentation methods are not evaluated in a setting that includes these items. In the present study, our tissue segmentation method for brain MRI was extended and evaluated for additional WMH segmentation. Furthermore, our method was evaluated in two large cohorts with a realistic variation in brain abnormalities and motion artefacts. The method uses a multi-scale convolutional neural network with a T1-weighted image, a T2-weighted fluid attenuated inversion recovery (FLAIR) image and a T1-weighted inversion recovery (IR) image as input. The method automatically segments white matter (WM), cortical grey matter (cGM), basal ganglia and thalami (BGT), cerebellum (CB), brain stem (BS), lateral ventricular cerebrospinal fluid (lvCSF), peripheral cerebrospinal fluid (pCSF), and WMH. Our method was evaluated quantitatively with images publicly available from the MRBrainS13 challenge (n = 20), quantitatively and qualitatively in relatively healthy older subjects (n = 96), and qualitatively in patients from a memory clinic (n = 110). The method can accurately segment WMH (Overall Dice coefficient in the MRBrainS13 data of 0.67) without compromising performance for tissue segmentations (Overall Dice coefficients in the MRBrainS13 data of 0.87 for WM, 0.85 for cGM, 0.82 for BGT, 0.93 for CB, 0.92 for BS, 0.93 for lvCSF, 0.76 for pCSF). Furthermore, the automatic WMH volumes showed a high correlation with manual WMH volumes (Spearman’s ρ = 0.83 for relatively healthy older subjects). In both cohorts, our method produced reliable segmentations (as determined by a human observer) in most images (relatively healthy/memory clinic: tissues 88%/77% reliable, WMH 85%/84% reliable) despite various degrees of brain abnormalities and motion artefacts. In conclusion, this study shows that a convolutional neural network-based segmentation method can accurately segment brain tissues and WMH in MR images of older patients with varying degrees of brain abnormalities and motion artefacts.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Automatic segmentation of brain tissues and white matter hyperintensities of presumed vascular origin (WMH) in MRI of older patients is widely described in the literature. Although brain abnormalities and motion artefacts are common in this age group, most segmentation methods are not evaluated in a setting that includes these items. In the present study, our tissue segmentation method for brain MRI was extended and evaluated for additional WMH segmentation. Furthermore, our method was evaluated in two large cohorts with a realistic variation in brain abnormalities and motion artefacts. The method uses a multi-scale convolutional neural network with a T1-weighted image, a T2-weighted fluid attenuated inversion recovery (FLAIR) image and a T1-weighted inversion recovery (IR) image as input. The method automatically segments white matter (WM), cortical grey matter (cGM), basal ganglia and thalami (BGT), cerebellum (CB), brain stem (BS), lateral ventricular cerebrospinal fluid (lvCSF), peripheral cerebrospinal fluid (pCSF), and WMH. Our method was evaluated quantitatively with images publicly available from the MRBrainS13 challenge (n = 20), quantitatively and qualitatively in relatively healthy older subjects (n = 96), and qualitatively in patients from a memory clinic (n = 110). The method can accurately segment WMH (Overall Dice coefficient in the MRBrainS13 data of 0.67) without compromising performance for tissue segmentations (Overall Dice coefficients in the MRBrainS13 data of 0.87 for WM, 0.85 for cGM, 0.82 for BGT, 0.93 for CB, 0.92 for BS, 0.93 for lvCSF, 0.76 for pCSF). Furthermore, the automatic WMH volumes showed a high correlation with manual WMH volumes (Spearman’s ρ = 0.83 for relatively healthy older subjects). In both cohorts, our method produced reliable segmentations (as determined by a human observer) in most images (relatively healthy/memory clinic: tissues 88%/77% reliable, WMH 85%/84% reliable) despite various degrees of brain abnormalities and motion artefacts. In conclusion, this study shows that a convolutional neural network-based segmentation method can accurately segment brain tissues and WMH in MR images of older patients with varying degrees of brain abnormalities and motion artefacts. |
2. | P. Moeskops, I. Isgum, K. Keunen, N.H.P. Claessens, I.C. van Haastert, F. Groenendaal, L.S. de Vries, M.A. Viergever, M.J.N.L. Benders Prediction of cognitive and motor outcome of preterm infants based on automatic quantitative descriptors from neonatal MR brain images Journal Article Scientific Reports, 7 (2163), 2017. @article{Moesk17, title = {Prediction of cognitive and motor outcome of preterm infants based on automatic quantitative descriptors from neonatal MR brain images}, author = {P. Moeskops, I. Isgum, K. Keunen, N.H.P. Claessens, I.C. van Haastert, F. Groenendaal, L.S. de Vries, M.A. Viergever, M.J.N.L. Benders}, url = {https://www.nature.com/articles/s41598-017-02307-w}, year = {2017}, date = {2017-05-19}, journal = {Scientific Reports}, volume = {7}, number = {2163}, abstract = {This study investigates the predictive ability of automatic quantitative brain MRI descriptors for the identification of infants with low cognitive and/or motor outcome at 2–3 years chronological age. MR brain images of 173 patients were acquired at 30 weeks postmenstrual age (PMA) (n=86) and 40 weeks PMA (n=153) between 2008 and 2013. Eight tissue volumes and measures of cortical morphology were automatically computed. A support vector machine classifier was employed to identify infants who exhibit low cognitive and/or motor outcome (<85) at 2–3 years chronological age as assessed by the Bayley scales. Based on the images acquired at 30 weeks PMA, the automatic identification resulted in an area under the receiver operation characteristic curve (AUC) of 0.78 for low cognitive outcome, and an AUC of 0.80 for low motor outcome. Identification based on the change of the descriptors between 30 and 40 weeks PMA (n=66) resulted in an AUC of 0.80 for low cognitive outcome and an AUC of 0.85 for low motor outcome. This study provides evidence of the feasibility of identification of preterm infants at risk of cognitive and motor impairments based on descriptors automatically computed from images acquired at 30 and 40 weeks PMA.}, keywords = {}, pubstate = {published}, tppubtype = {article} } This study investigates the predictive ability of automatic quantitative brain MRI descriptors for the identification of infants with low cognitive and/or motor outcome at 2–3 years chronological age. MR brain images of 173 patients were acquired at 30 weeks postmenstrual age (PMA) (n=86) and 40 weeks PMA (n=153) between 2008 and 2013. Eight tissue volumes and measures of cortical morphology were automatically computed. A support vector machine classifier was employed to identify infants who exhibit low cognitive and/or motor outcome (<85) at 2–3 years chronological age as assessed by the Bayley scales. Based on the images acquired at 30 weeks PMA, the automatic identification resulted in an area under the receiver operation characteristic curve (AUC) of 0.78 for low cognitive outcome, and an AUC of 0.80 for low motor outcome. Identification based on the change of the descriptors between 30 and 40 weeks PMA (n=66) resulted in an AUC of 0.80 for low cognitive outcome and an AUC of 0.85 for low motor outcome. This study provides evidence of the feasibility of identification of preterm infants at risk of cognitive and motor impairments based on descriptors automatically computed from images acquired at 30 and 40 weeks PMA. |
3. | K.J. Kersbergen, F. Leroy, I. Isgum, F. Groenendaal, L.S. de Vries, N.H.P. Claessens, I.C. van Haastert, P. Moeskops, C. Fischer, J.-F. Mangin, M.A. Viergever, J. Dubois, M.J.N.L. Benders Relation between clinical risk factors, early cortical changes, and neurodevelopmental outcome in preterm infants Journal Article NeuroImage, 5 (142), pp. 301-310, 2016. @article{Kers16, title = {Relation between clinical risk factors, early cortical changes, and neurodevelopmental outcome in preterm infants}, author = {K.J. Kersbergen, F. Leroy, I. Isgum, F. Groenendaal, L.S. de Vries, N.H.P. Claessens, I.C. van Haastert, P. Moeskops, C. Fischer, J.-F. Mangin, M.A. Viergever, J. Dubois, M.J.N.L. Benders}, year = {2016}, date = {2016-07-06}, journal = {NeuroImage}, volume = {5}, number = {142}, pages = {301-310}, keywords = {}, pubstate = {published}, tppubtype = {article} } |
4. | N.H.P. Claessens, P. Moeskops, A. Buchmann, B. Latal, W. Knirsch, I. Scheer, I. Isgum, L.S. de Vries, M.J.N.L. Benders, M. von Rhein Delayed cortical gray matter development in neonates with severe congenital heart disease Journal Article Pediatric Research, 80 (5), pp. 668-674, 2016. @article{Clae16, title = {Delayed cortical gray matter development in neonates with severe congenital heart disease}, author = {N.H.P. Claessens, P. Moeskops, A. Buchmann, B. Latal, W. Knirsch, I. Scheer, I. Isgum, L.S. de Vries, M.J.N.L. Benders, M. von Rhein}, year = {2016}, date = {2016-06-01}, journal = {Pediatric Research}, volume = {80}, number = {5}, pages = {668-674}, keywords = {}, pubstate = {published}, tppubtype = {article} } |
5. | P. Moeskops, M.A. Viergever, A.M. Mendrik, L.S. de Vries, M.J.N.L. Benders, I. Isgum Automatic segmentation of MR brain images with a convolutional neural network Journal Article IEEE Transactions on Medical Imaging, 35 (5), pp. 1252-1261, 2016. @article{Moes16, title = {Automatic segmentation of MR brain images with a convolutional neural network}, author = {P. Moeskops, M.A. Viergever, A.M. Mendrik, L.S. de Vries, M.J.N.L. Benders, I. Isgum}, year = {2016}, date = {2016-05-01}, journal = {IEEE Transactions on Medical Imaging}, volume = {35}, number = {5}, pages = {1252-1261}, abstract = {Automatic segmentation in MR brain images is important for quantitative analysis in large-scale studies with images acquired at all ages. This paper presents a method for the automatic segmentation of MR brain images into a number of tissue classes using a convolutional neural network. To ensure that the method obtains accurate segmentation details as well as spatial consistency, the network uses multiple patch sizes and multiple convolution kernel sizes to acquire multi-scale information about each voxel. The method is not dependent on explicit features, but learns to recognise the information that is important for the classification based on training data. The method requires a single anatomical MR image only. The segmentation method is applied to five different data sets: coronal T2-weighted images of preterm infants acquired at 30 weeks postmenstrual age (PMA) and 40 weeks PMA, axial T2-weighted images of preterm infants acquired at 40 weeks PMA, axial T1-weighted images of ageing adults acquired at an average age of 70 years, and T1-weighted images of young adults acquired at an average age of 23 years. The method obtained the following average Dice coefficients over all segmented tissue classes for each data set, respectively: 0.87, 0.82, 0.84, 0.86, and 0.91. The results demonstrate that the method obtains accurate segmentations in all five sets, and hence demonstrates its robustness to differences in age and acquisition protocol.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Automatic segmentation in MR brain images is important for quantitative analysis in large-scale studies with images acquired at all ages. This paper presents a method for the automatic segmentation of MR brain images into a number of tissue classes using a convolutional neural network. To ensure that the method obtains accurate segmentation details as well as spatial consistency, the network uses multiple patch sizes and multiple convolution kernel sizes to acquire multi-scale information about each voxel. The method is not dependent on explicit features, but learns to recognise the information that is important for the classification based on training data. The method requires a single anatomical MR image only. The segmentation method is applied to five different data sets: coronal T2-weighted images of preterm infants acquired at 30 weeks postmenstrual age (PMA) and 40 weeks PMA, axial T2-weighted images of preterm infants acquired at 40 weeks PMA, axial T1-weighted images of ageing adults acquired at an average age of 70 years, and T1-weighted images of young adults acquired at an average age of 23 years. The method obtained the following average Dice coefficients over all segmented tissue classes for each data set, respectively: 0.87, 0.82, 0.84, 0.86, and 0.91. The results demonstrate that the method obtains accurate segmentations in all five sets, and hence demonstrates its robustness to differences in age and acquisition protocol. |
6. | P. Moeskops; M.J.N.L. Benders; K.J. Kersbergen; F. Groenendaal; L.S. de Vries; M.A. Viergever; I. Išgum Development of cortical morphology evaluated with longitudinal MR brain images of preterm infants Journal Article PLOS ONE, 10 (7), pp. e0131552, 2015. @article{Moes15b, title = {Development of cortical morphology evaluated with longitudinal MR brain images of preterm infants}, author = {P. Moeskops and M.J.N.L. Benders and K.J. Kersbergen and F. Groenendaal and L.S. de Vries and M.A. Viergever and I. Išgum}, year = {2015}, date = {2015-07-10}, journal = {PLOS ONE}, volume = {10}, number = {7}, pages = {e0131552}, abstract = {The cerebral cortex develops rapidly in the last trimester of pregnancy. In preterm infants, brain development is very vulnerable because of their often complicated extra-uterine conditions. The aim of this study was to quantitatively describe cortical development in a cohort of 85 preterm infants with and without brain injury imaged at 30 and 40 weeks postmenstrual age (PMA). In the acquired T2-weighted MR images, unmyelinated white matter (UWM), cortical grey matter (CoGM), and cerebrospinal fluid in the extracerebral space (CSF) were automatically segmented. Based on these segmentations, cortical descriptors evaluating volume, surface area, thickness, gyrification index, and global mean curvature were computed at both time points, for the whole brain, as well as for the frontal, temporal, parietal, and occipital lobes separately. Additionally, visual scoring of brain abnormality was performed using a conventional scoring system at 40 weeks PMA. The evaluated descriptors showed larger change in the occipital lobes than in the other lobes. Moreover, the cortical descriptors showed an association with the abnormality scores: gyrification index and global mean curvature decreased, whereas, interestingly, median cortical thickness increased with increasing abnormality score. This was more pronounced at 40 weeks PMA than at 30 weeks PMA, suggesting that the period between 30 and 40 weeks PMA might provide a window of opportunity for intervention to prevent delay in cortical development.}, keywords = {}, pubstate = {published}, tppubtype = {article} } The cerebral cortex develops rapidly in the last trimester of pregnancy. In preterm infants, brain development is very vulnerable because of their often complicated extra-uterine conditions. The aim of this study was to quantitatively describe cortical development in a cohort of 85 preterm infants with and without brain injury imaged at 30 and 40 weeks postmenstrual age (PMA). In the acquired T2-weighted MR images, unmyelinated white matter (UWM), cortical grey matter (CoGM), and cerebrospinal fluid in the extracerebral space (CSF) were automatically segmented. Based on these segmentations, cortical descriptors evaluating volume, surface area, thickness, gyrification index, and global mean curvature were computed at both time points, for the whole brain, as well as for the frontal, temporal, parietal, and occipital lobes separately. Additionally, visual scoring of brain abnormality was performed using a conventional scoring system at 40 weeks PMA. The evaluated descriptors showed larger change in the occipital lobes than in the other lobes. Moreover, the cortical descriptors showed an association with the abnormality scores: gyrification index and global mean curvature decreased, whereas, interestingly, median cortical thickness increased with increasing abnormality score. This was more pronounced at 40 weeks PMA than at 30 weeks PMA, suggesting that the period between 30 and 40 weeks PMA might provide a window of opportunity for intervention to prevent delay in cortical development. |
7. | P. Moeskops, M.J.N.L. Benders, S.M. Chita, K.J. Kersbergen, F. Groenendaal, L.S. de Vries, M.A. Viergever, I. Išgum Automatic segmentation of MR brain images of preterm infants using supervised classification Journal Article NeuroImage, 118 , pp. 628-641, 2015. @article{Moes15, title = {Automatic segmentation of MR brain images of preterm infants using supervised classification}, author = {P. Moeskops, M.J.N.L. Benders, S.M. Chita, K.J. Kersbergen, F. Groenendaal, L.S. de Vries, M.A. Viergever, I. Išgum}, year = {2015}, date = {2015-06-07}, journal = {NeuroImage}, volume = {118}, pages = {628-641}, abstract = {Preterm birth is often associated with impaired brain development. The state and expected progression of preterm brain development can be evaluated using quantitative assessment of MR images. Such measurements require accurate segmentation of different tissue types in those images. This paper presents an algorithm for the automatic segmentation of unmyelinated white matter (WM), cortical grey matter (GM), and cerebrospinal fluid in the extracerebral space (CSF). The algorithm uses supervised voxel classification in three subsequent stages. In the first stage, voxels that can easily be assigned to one of the three tissue types are labelled. In the second stage, dedicated analysis of the remaining voxels is performed. The first and the second stage both use two-class classification for each tissue type separately. Possible inconsistencies that could result from these tissue-specific segmentation stages are resolved in the third stage, which performs multi-class classification. A set of T1- and T2-weighted images was analysed, but the optimised system performs automatic segmentation using a T2-weighted image only. We have investigated the performance of the algorithm when using training data randomly selected from completely annotated images as well as when using training data from only partially annotated images. The method was evaluated on images of preterm infants acquired at 30 and 40 weeks postmenstrual age (PMA). When the method was trained using random selection from the completely annotated images, the average Dice coefficients were 0.95 for WM, 0.81 for GM, and 0.89 for CSF on an independent set of images acquired at 30 weeks PMA. When the method was trained using only the partially annotated images, the average Dice coefficients were 0.95 for WM, 0.78 for GM and 0.87 for CSF for the images acquired at 30 weeks PMA, and 0.92 for WM, 0.80 for GM and 0.85 for CSF for the images acquired at 40 weeks PMA. Even though the segmentations obtained using training data from the partially annotated images resulted in slightly lower Dice coefficients, the performance in all experiments was close to that of a second human expert (0.93 for WM, 0.79 for GM and 0.86 for CSF for the images acquired at 30 weeks, and 0.94 for WM, 0.76 for GM and 0.87 for CSF for the images acquired at 40 weeks). These results show that the presented method is robust to age and acquisition protocol and that it performs accurate segmentation of WM, GM, and CSF when the training data is extracted from complete annotations as well as when the training data is extracted from partial annotations only. This extends the applicability of the method by reducing the time and effort necessary to create training data in a population with different characteristics.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Preterm birth is often associated with impaired brain development. The state and expected progression of preterm brain development can be evaluated using quantitative assessment of MR images. Such measurements require accurate segmentation of different tissue types in those images. This paper presents an algorithm for the automatic segmentation of unmyelinated white matter (WM), cortical grey matter (GM), and cerebrospinal fluid in the extracerebral space (CSF). The algorithm uses supervised voxel classification in three subsequent stages. In the first stage, voxels that can easily be assigned to one of the three tissue types are labelled. In the second stage, dedicated analysis of the remaining voxels is performed. The first and the second stage both use two-class classification for each tissue type separately. Possible inconsistencies that could result from these tissue-specific segmentation stages are resolved in the third stage, which performs multi-class classification. A set of T1- and T2-weighted images was analysed, but the optimised system performs automatic segmentation using a T2-weighted image only. We have investigated the performance of the algorithm when using training data randomly selected from completely annotated images as well as when using training data from only partially annotated images. The method was evaluated on images of preterm infants acquired at 30 and 40 weeks postmenstrual age (PMA). When the method was trained using random selection from the completely annotated images, the average Dice coefficients were 0.95 for WM, 0.81 for GM, and 0.89 for CSF on an independent set of images acquired at 30 weeks PMA. When the method was trained using only the partially annotated images, the average Dice coefficients were 0.95 for WM, 0.78 for GM and 0.87 for CSF for the images acquired at 30 weeks PMA, and 0.92 for WM, 0.80 for GM and 0.85 for CSF for the images acquired at 40 weeks PMA. Even though the segmentations obtained using training data from the partially annotated images resulted in slightly lower Dice coefficients, the performance in all experiments was close to that of a second human expert (0.93 for WM, 0.79 for GM and 0.86 for CSF for the images acquired at 30 weeks, and 0.94 for WM, 0.76 for GM and 0.87 for CSF for the images acquired at 40 weeks). These results show that the presented method is robust to age and acquisition protocol and that it performs accurate segmentation of WM, GM, and CSF when the training data is extracted from complete annotations as well as when the training data is extracted from partial annotations only. This extends the applicability of the method by reducing the time and effort necessary to create training data in a population with different characteristics. |
8. | I. Isgum, M.J.N.L. Benders, B. Avants, M.J. Cardoso, S.J. Counsell, E. Fischi Gomez, L. Gui, P. S Hüppi, K.J. Kersbergen, A. Makropoulos, A. Melbourne, P. Moeskops, C.P. Mol, M. Kuklisova-Murgasova, D. Rueckert, J.A. Schnabel, V. Srhoj-Egekher, J. Wu, S. Wang, L.S. de Vries, M.A. Viergever Evaluation of automatic neonatal brain segmentation algorithms: the NeoBrainS12 challenge Journal Article Medical Image Analysis, 20 (1), pp. 135-151, 2015. @article{Isgu14, title = {Evaluation of automatic neonatal brain segmentation algorithms: the NeoBrainS12 challenge}, author = {I. Isgum, M.J.N.L. Benders, B. Avants, M.J. Cardoso, S.J. Counsell, E. Fischi Gomez, L. Gui, P. S Hüppi, K.J. Kersbergen, A. Makropoulos, A. Melbourne, P. Moeskops, C.P. Mol, M. Kuklisova-Murgasova, D. Rueckert, J.A. Schnabel, V. Srhoj-Egekher, J. Wu, S. Wang, L.S. de Vries, M.A. Viergever}, year = {2015}, date = {2015-01-01}, journal = {Medical Image Analysis}, volume = {20}, number = {1}, pages = {135-151}, abstract = {A number of algorithms for brain segmentation in preterm born infants have been published, but a reliable comparison of their performance is lacking. The NeoBrainS12 study (http://neobrains12.isi.uu.nl), providing three different image sets of preterm born infants, was set up to provide such a comparison. These sets are (i) axial scans acquired at 40 weeks corrected age, (ii) coronal scans acquired at 30 weeks corrected age and (iii) coronal scans acquired at 40 weeks corrected age. Each of these three sets consists of three T1- and T2-weighted MR images of the brain acquired with a 3T MRI scanner. The task was to segment cortical grey matter, non-myelinated and myelinated white matter, brainstem, basal ganglia and thalami, cerebellum, and cerebrospinal fluid in the ventricles and in the extracerebral space separately. Any team could upload the results and all segmentations were evaluated in the same way. This paper presents the results of eight participating teams. The results demonstrate that the participating methods were able to segment all tissue classes well, except myelinated white matter.}, keywords = {}, pubstate = {published}, tppubtype = {article} } A number of algorithms for brain segmentation in preterm born infants have been published, but a reliable comparison of their performance is lacking. The NeoBrainS12 study (http://neobrains12.isi.uu.nl), providing three different image sets of preterm born infants, was set up to provide such a comparison. These sets are (i) axial scans acquired at 40 weeks corrected age, (ii) coronal scans acquired at 30 weeks corrected age and (iii) coronal scans acquired at 40 weeks corrected age. Each of these three sets consists of three T1- and T2-weighted MR images of the brain acquired with a 3T MRI scanner. The task was to segment cortical grey matter, non-myelinated and myelinated white matter, brainstem, basal ganglia and thalami, cerebellum, and cerebrospinal fluid in the ventricles and in the extracerebral space separately. Any team could upload the results and all segmentations were evaluated in the same way. This paper presents the results of eight participating teams. The results demonstrate that the participating methods were able to segment all tissue classes well, except myelinated white matter. |
Inproceedings |
|
1. | P. Moeskops, J.M. Wolterink, B.H.M. van der Velden, K.G.A. Gilhuijs, T. Leiner, M.A. Viergever, I. Isgum Deep learning for multi-task medical image segmentation in multiple modalities Inproceedings In: Medical Image Computing and Computer-Assisted Intervention, pp. 478-486, 2016. @inproceedings{MoesWolt16, title = {Deep learning for multi-task medical image segmentation in multiple modalities}, author = {P. Moeskops, J.M. Wolterink, B.H.M. van der Velden, K.G.A. Gilhuijs, T. Leiner, M.A. Viergever, I. Isgum}, year = {2016}, date = {2016-10-17}, booktitle = {Medical Image Computing and Computer-Assisted Intervention}, volume = {9901}, pages = {478-486}, abstract = {Automatic segmentation of medical images is an important task for many clinical applications. In practice, a wide range of anatomical structures are visualised using different imaging modalities. In this paper, we investigate whether a single convolutional neural network (CNN) can be trained to perform different segmentation tasks. A single CNN is trained to segment six tissues in MR brain images, the pectoral muscle in MR breast images, and the coronary arteries in cardiac CTA. The CNN therefore learns to identify the imaging modality, the visualised anatomical structures, and the tissue classes. For each of the three tasks (brain MRI, breast MRI and cardiac CTA), this combined training procedure resulted in a segmentation performance equivalent to that of a CNN trained specifically for that task, demonstrating the high capacity of CNN architectures. Hence, a single system could be used in clinical practice to automatically perform diverse segmentation tasks without task-specific training.}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } Automatic segmentation of medical images is an important task for many clinical applications. In practice, a wide range of anatomical structures are visualised using different imaging modalities. In this paper, we investigate whether a single convolutional neural network (CNN) can be trained to perform different segmentation tasks. A single CNN is trained to segment six tissues in MR brain images, the pectoral muscle in MR breast images, and the coronary arteries in cardiac CTA. The CNN therefore learns to identify the imaging modality, the visualised anatomical structures, and the tissue classes. For each of the three tasks (brain MRI, breast MRI and cardiac CTA), this combined training procedure resulted in a segmentation performance equivalent to that of a CNN trained specifically for that task, demonstrating the high capacity of CNN architectures. Hence, a single system could be used in clinical practice to automatically perform diverse segmentation tasks without task-specific training. |
2. | P. Moeskops; M.A. Viergever; M.J.N.L. Benders; I. Isgum Evaluation of an automatic brain segmentation method developed for neonates on adult MR brain images Inproceedings In: SPIE Medical Imaging, pp. 941315, 2015. @inproceedings{moeskops:2015-2725, title = {Evaluation of an automatic brain segmentation method developed for neonates on adult MR brain images}, author = {P. Moeskops and M.A. Viergever and M.J.N.L. Benders and I. Isgum}, year = {2015}, date = {2015-01-01}, booktitle = {SPIE Medical Imaging}, volume = {9413}, pages = {941315}, abstract = {Automatic brain tissue segmentation is of clinical relevance in images acquired at all ages. The aim of this work is to evaluate a method developed for neonatal images in the segmentation of adult images. The evaluated method employs supervised voxel classification in subsequent stages, exploiting spatial and intensity information. Evaluation was performed using images available within the MRBrainS13 challenge. The obtained average Dice coefficients were 85.77% for grey matter, 88.66% for white matter, 81.08% for cerebrospinal fluid, 95.65% for cerebrum, and 96.92% for intracranial cavity, currently resulting in the best overall ranking.}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } Automatic brain tissue segmentation is of clinical relevance in images acquired at all ages. The aim of this work is to evaluate a method developed for neonatal images in the segmentation of adult images. The evaluated method employs supervised voxel classification in subsequent stages, exploiting spatial and intensity information. Evaluation was performed using images available within the MRBrainS13 challenge. The obtained average Dice coefficients were 85.77% for grey matter, 88.66% for white matter, 81.08% for cerebrospinal fluid, 95.65% for cerebrum, and 96.92% for intracranial cavity, currently resulting in the best overall ranking. |
3. | P. Moeskops; M.J.N.L. Benders; P.C. Pearlman; K.J. Kersbergen; A. Leemans; M.A. Viergever; I. Isgum Assessment of quantitative cortical biomarkers in the developing brain of preterm infants Inproceedings In: SPIE Medical Imaging, pp. 867011, 2013. @inproceedings{Moeskops2013, title = {Assessment of quantitative cortical biomarkers in the developing brain of preterm infants}, author = {P. Moeskops and M.J.N.L. Benders and P.C. Pearlman and K.J. Kersbergen and A. Leemans and M.A. Viergever and I. Isgum}, year = {2013}, date = {2013-09-03}, booktitle = {SPIE Medical Imaging}, volume = {8670}, pages = {867011}, abstract = {The cerebral cortex rapidly develops its folding during the second and third trimester of pregnancy. In preterm birth, this growth might be disrupted and influence neurodevelopment. The aim of this work is to extract quantitative biomarkers describing the cortex and evaluate them on a set of preterm infants without brain pathology. For this study, a set of 19 preterm - but otherwise healthy - infants scanned coronally with 3T MRI at the postmenstrual age of 30 weeks were selected. In ten patients (test set), the gray and white matter were manually annotated by an expert on the T2-weighted scans. Manual segmentations were used to extract cortical volume, surface area, thickness, and curvature using voxel-based methods. To compute these biomarkers per region in every patient, a template brain image has been generated by iterative registration and averaging of the scans of the remaining nine patients. This template has been manually divided in eight regions, and is transformed to every test image using elastic registration. In the results, gray and white matter volumes and cortical surface area appear symmetric between hemispheres, but small regional differences are visible. Cortical thickness seems slightly higher in the right parietal lobe than in other regions. The parietal lobes exhibit a higher global curvature, indicating more complex folding compared to other regions. The proposed approach can potentially - together with an automatic segmentation algorithm - be applied as a tool to assist in early diagnosis of abnormalities and prediction of the development of the cognitive abilities of these children.}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } The cerebral cortex rapidly develops its folding during the second and third trimester of pregnancy. In preterm birth, this growth might be disrupted and influence neurodevelopment. The aim of this work is to extract quantitative biomarkers describing the cortex and evaluate them on a set of preterm infants without brain pathology. For this study, a set of 19 preterm - but otherwise healthy - infants scanned coronally with 3T MRI at the postmenstrual age of 30 weeks were selected. In ten patients (test set), the gray and white matter were manually annotated by an expert on the T2-weighted scans. Manual segmentations were used to extract cortical volume, surface area, thickness, and curvature using voxel-based methods. To compute these biomarkers per region in every patient, a template brain image has been generated by iterative registration and averaging of the scans of the remaining nine patients. This template has been manually divided in eight regions, and is transformed to every test image using elastic registration. In the results, gray and white matter volumes and cortical surface area appear symmetric between hemispheres, but small regional differences are visible. Cortical thickness seems slightly higher in the right parietal lobe than in other regions. The parietal lobes exhibit a higher global curvature, indicating more complex folding compared to other regions. The proposed approach can potentially - together with an automatic segmentation algorithm - be applied as a tool to assist in early diagnosis of abnormalities and prediction of the development of the cognitive abilities of these children. |
4. | S.M. Chita; M.J.N.L. Benders; P. Moeskops; K.J. Kersbergen; M.A. Viergever; I. Isgum Automatic segmentation of the preterm neonatal brain with MRI using supervised classification Inproceedings In: SPIE Medical Imaging, pp. 86693X-1-86693X-6, 2013. @inproceedings{Chita2013, title = {Automatic segmentation of the preterm neonatal brain with MRI using supervised classification}, author = {S.M. Chita and M.J.N.L. Benders and P. Moeskops and K.J. Kersbergen and M.A. Viergever and I. Isgum}, year = {2013}, date = {2013-09-02}, booktitle = {SPIE Medical Imaging}, volume = {8669}, pages = {86693X-1-86693X-6}, abstract = {Cortical folding ensues around 13-14 weeks gestational age and a qualitative analysis of the cortex around this period is required to observe and better understand the folds arousal. A quantitative assessment of cortical folding can be based on the cortical surface area, extracted from segmentations of unmyelinated white matter (UWM), cortical grey matter (CoGM) and cerebrospinal fuid in the extracerebral space (CSF). This work presents a method for automatic segmentation of these tissue types in preterm infants. A set of T1- and T2-weighted images of ten infants scanned at 30 weeks postmenstrual age was used. The reference standard was obtained by manual expert segmentation. The method employs supervised pixel classication in three subsequent stages. The classication is performed based on the set of spatial and texture features. Segmentation results are evaluated in terms of Dice coecient (DC), Hausdorff distance (HD), and modied Hausdorff distance (MHD) defined as 95th percentile of the HD. The method achieved average DC of 0.94 for UWM, 0.73 for CoGM and 0.86 for CSF. The average HD and MHD were 6.89 mm and 0.34 mm for UWM, 6.49 mm and 0.82 mm for CoGM, and 7.09 mm and 0.79 mm for CSF, respectively. The presented method can provide volumetric measurements of the segmented tissues, and it enables quantification of cortical characteristics. Therefore, the method provides a basis for evaluation of clinical relevance of these biomarkers in the given population.}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } Cortical folding ensues around 13-14 weeks gestational age and a qualitative analysis of the cortex around this period is required to observe and better understand the folds arousal. A quantitative assessment of cortical folding can be based on the cortical surface area, extracted from segmentations of unmyelinated white matter (UWM), cortical grey matter (CoGM) and cerebrospinal fuid in the extracerebral space (CSF). This work presents a method for automatic segmentation of these tissue types in preterm infants. A set of T1- and T2-weighted images of ten infants scanned at 30 weeks postmenstrual age was used. The reference standard was obtained by manual expert segmentation. The method employs supervised pixel classication in three subsequent stages. The classication is performed based on the set of spatial and texture features. Segmentation results are evaluated in terms of Dice coecient (DC), Hausdorff distance (HD), and modied Hausdorff distance (MHD) defined as 95th percentile of the HD. The method achieved average DC of 0.94 for UWM, 0.73 for CoGM and 0.86 for CSF. The average HD and MHD were 6.89 mm and 0.34 mm for UWM, 6.49 mm and 0.82 mm for CoGM, and 7.09 mm and 0.79 mm for CSF, respectively. The presented method can provide volumetric measurements of the segmented tissues, and it enables quantification of cortical characteristics. Therefore, the method provides a basis for evaluation of clinical relevance of these biomarkers in the given population. |
Abstracts |
|
1. | P. Moeskops, N.C. A'Campo, M.J.N.L. Benders, L.S. de Vries, M.A. Viergever, I. Isgum Automatic whole brain segmentation of MR brain images of preterm infants and adults using supervised classification Abstract In: 2015. @booklet{Moes15bb, title = {Automatic whole brain segmentation of MR brain images of preterm infants and adults using supervised classification}, author = {P. Moeskops, N.C. A'Campo, M.J.N.L. Benders, L.S. de Vries, M.A. Viergever, I. Isgum}, year = {2015}, date = {2015-04-16}, booktitle = {IEEE ISBI NeatBrainS15 workshop}, month = {04}, keywords = {}, pubstate = {published}, tppubtype = {booklet} } |
2. | P. Moeskops; M.J.N.L. Benders; A. Buchmann; B. Latal; W. Knirsch; L.S. de Vries; C. Hagmann; I. Isgum; M. Von Rhein Cortical morphology in infants with congenital heart disease pre- and post-surgery Abstract In: 2014. @booklet{moeskops:2014-2587, title = {Cortical morphology in infants with congenital heart disease pre- and post-surgery}, author = {P. Moeskops and M.J.N.L. Benders and A. Buchmann and B. Latal and W. Knirsch and L.S. de Vries and C. Hagmann and I. Isgum and M. Von Rhein}, year = {2014}, date = {2014-05-10}, booktitle = {Pediatric Academic Societies Annual Meeting}, abstract = {Infants with congenital heart disease (CHD) are known to have delayed brain maturation. A recently developed method (Moeskops et al. SPIE 2013) can be used to quantify cortical morphology. Quantitative description of cortical morphology in infants with CHD undergoing serial perioperative MRI scans. 32 CHD patients were imaged before (preSurg) and after surgery (postSurg) on a 3T MRI scanner (University Children’s Hospital Zürich), infants with cerebral injury were excluded from the analysis; 18 had preSurg and postSurg scans, 8 only preSurg and 6 only postSurg. In addition, 18 healthy controls were scanned (University Hospital Zürich) at comparable postnatal ages as the postSurg scans. Manual annotations of grey and white matter volumes were performed by A.B. Based on these annotations the following quantitative descriptors were calculated for the left and right hemispheres: white matter volume (VWM), inner cortical surface area (AIC), median cortical thickness (TC), and gyrification index (GI). Table 1 lists the gestational ages (GA) at birth and at the time of scanning (cGA), as well as the results for: VWM, AIC, TC, and GI. Using t-tests (α= 0.05), significant growth was found between preSurg and postSurg scans. After surgery, differences between CHD patients and controls were found for VWM and AIC. The method for description of cortical morphology could successfully be applied. Growth and development over the 3 weeks between the preSurg and postSurg scans was seen for AIC, TC, and GI in CHD infants. Smaller VWM and AIC were found in CHD patients compared to the controls. Whether this deficiency is caused by surgery or pre-existing delay in maturation needs to be elucidated.}, month = {05}, keywords = {}, pubstate = {published}, tppubtype = {booklet} } Infants with congenital heart disease (CHD) are known to have delayed brain maturation. A recently developed method (Moeskops et al. SPIE 2013) can be used to quantify cortical morphology. Quantitative description of cortical morphology in infants with CHD undergoing serial perioperative MRI scans. 32 CHD patients were imaged before (preSurg) and after surgery (postSurg) on a 3T MRI scanner (University Children’s Hospital Zürich), infants with cerebral injury were excluded from the analysis; 18 had preSurg and postSurg scans, 8 only preSurg and 6 only postSurg. In addition, 18 healthy controls were scanned (University Hospital Zürich) at comparable postnatal ages as the postSurg scans. Manual annotations of grey and white matter volumes were performed by A.B. Based on these annotations the following quantitative descriptors were calculated for the left and right hemispheres: white matter volume (VWM), inner cortical surface area (AIC), median cortical thickness (TC), and gyrification index (GI). Table 1 lists the gestational ages (GA) at birth and at the time of scanning (cGA), as well as the results for: VWM, AIC, TC, and GI. Using t-tests (α= 0.05), significant growth was found between preSurg and postSurg scans. After surgery, differences between CHD patients and controls were found for VWM and AIC. The method for description of cortical morphology could successfully be applied. Growth and development over the 3 weeks between the preSurg and postSurg scans was seen for AIC, TC, and GI in CHD infants. Smaller VWM and AIC were found in CHD patients compared to the controls. Whether this deficiency is caused by surgery or pre-existing delay in maturation needs to be elucidated. |
3. | P. Moeskops; I. Isgum; K.J. Kersbergen; F. Groenendaal; L.S. de Vries; M.A. Viergever; M.J.N.L. Benders Quantitative evaluation of cortical development in serial MR images of preterm infants Abstract In: 2013. @booklet{moeskops:2013-2395, title = {Quantitative evaluation of cortical development in serial MR images of preterm infants}, author = {P. Moeskops and I. Isgum and K.J. Kersbergen and F. Groenendaal and L.S. de Vries and M.A. Viergever and M.J.N.L. Benders}, year = {2013}, date = {2013-01-01}, booktitle = {Pediatric Academic Societies Annual Meeting}, abstract = {The cerebral cortex rapidly develops its folding in the third trimester of pregnancy. Preterm birth might disrupt this growth and influence subsequent neurodevelopment. The aim of this study is to compute quantitative biomarkers with regard to cortical development and evaluate them on a serial set of preterm infants without brain pathology. Preterm infants (n = 5, gestational age: 27.0 ± 0.9 wks) without brain pathology and with normal cognitive outcome at 15 months were selected. Coronal T2-weighted MR images were acquired at a postmenstrual age of 31.3 ± 0.7 wks and at term-equivalent age (41.3 ± 1.3 wks). The cortical gray (GM) and white matter (WM) were manually annotated by an expert. These segmentations were used to quantify white matter volume (VWM), inner cortical surface area (AIC), median cortical thickness (TC), and normalized global mean curvature of the inner cortical surface (HIC). To assess regional development, the scans were parcellated into frontal, temporal, parietal and occipital lobes using an annotated template image generated for this population. VWM and AIC appear symmetric between hemispheres, but small regional asymmetries are visible, which are in agreement with the literature. Comparison of the 30 and 40 wk scans reveals that VWM increases on average by a factor of 2.0 ± 0.2 and appears to change less (p < 0.005) in the temporal lobes than in the hemispheres. AIC shows this same regional trend (p < 0.005), but increases by a factor of 3.6 ± 0.4. TC shows an increase factor of 1.2 ± 0.1. HIC increases by a factor of 1.5 ± 0.2 and appears to change more in the frontal lobes (p < 0.01) and less in the temporal lobes (p = 0.01), than over the hemispheres. The parietal lobes exhibit a higher HIC in both scans (p < 0.01 for 30 wks, not for 40 wks), which indicates more complex folding than in other regions. This preliminary study on cortical biomarkers was applied to a small set of manually segmented images. A small increase in thickness is visible in a 10 wk period. The increase in folding of the cortex appears larger in the frontal lobe than in the temporal lobe between 30 and 40 wks. This may explain the larger vulnerability of the frontal lobe compared to the temporal lobe in preterm infants. To validate these findings, the presented approach will be combined with an automatic segmentation on a larger cohort.}, month = {01}, keywords = {}, pubstate = {published}, tppubtype = {booklet} } The cerebral cortex rapidly develops its folding in the third trimester of pregnancy. Preterm birth might disrupt this growth and influence subsequent neurodevelopment. The aim of this study is to compute quantitative biomarkers with regard to cortical development and evaluate them on a serial set of preterm infants without brain pathology. Preterm infants (n = 5, gestational age: 27.0 ± 0.9 wks) without brain pathology and with normal cognitive outcome at 15 months were selected. Coronal T2-weighted MR images were acquired at a postmenstrual age of 31.3 ± 0.7 wks and at term-equivalent age (41.3 ± 1.3 wks). The cortical gray (GM) and white matter (WM) were manually annotated by an expert. These segmentations were used to quantify white matter volume (VWM), inner cortical surface area (AIC), median cortical thickness (TC), and normalized global mean curvature of the inner cortical surface (HIC). To assess regional development, the scans were parcellated into frontal, temporal, parietal and occipital lobes using an annotated template image generated for this population. VWM and AIC appear symmetric between hemispheres, but small regional asymmetries are visible, which are in agreement with the literature. Comparison of the 30 and 40 wk scans reveals that VWM increases on average by a factor of 2.0 ± 0.2 and appears to change less (p < 0.005) in the temporal lobes than in the hemispheres. AIC shows this same regional trend (p < 0.005), but increases by a factor of 3.6 ± 0.4. TC shows an increase factor of 1.2 ± 0.1. HIC increases by a factor of 1.5 ± 0.2 and appears to change more in the frontal lobes (p < 0.01) and less in the temporal lobes (p = 0.01), than over the hemispheres. The parietal lobes exhibit a higher HIC in both scans (p < 0.01 for 30 wks, not for 40 wks), which indicates more complex folding than in other regions. This preliminary study on cortical biomarkers was applied to a small set of manually segmented images. A small increase in thickness is visible in a 10 wk period. The increase in folding of the cortex appears larger in the frontal lobe than in the temporal lobe between 30 and 40 wks. This may explain the larger vulnerability of the frontal lobe compared to the temporal lobe in preterm infants. To validate these findings, the presented approach will be combined with an automatic segmentation on a larger cohort. |