CT based screening of heavy smokers is designed for early detection of lung cancer, but also offers the possibility to detect multiple other diseases at an early stage. This is especially interesting when the screening images would allow automatic detection of these diseases.
This project is focusing on the automatic detection of cardiovascular disease and osteoporosis in lung cancer screening trials. The detection needs to be robust against various acquisition protocols, to allow application of these automatic algorithms to scans acquired in different lung cancer screening trials.
This is a collaborative project between the Image Sciences Institute (ISI), UMC Utrecht and the Diagnostic Image Analysis Group (DIAG), Radboud University Medical Center.

Vertebra segmentation in low-dose chest CT using an iterative fully convolutional neural network. The segmentations are used to detect vertebral compression fractures.
Researchers
Journal Articles |
|
1. | C.C. van 't Klooster, H.M. Nathoe, J .Hjortnaes, M.L. Bots, I. Išgum, N. Lessmann, Y. van der Graaf, T. Leiner, F.L.J. Visseren, On behalf of the UCC-SMART-study group International Journal of Cardiology, Heart & Vasculature, 27 (100499), 2020. @article{Klooster2020, title = {Multifocal cardiovascular calcification in patients with established cardiovascular disease; prevalence, risk factors, and relation with recurrent cardiovascular disease}, author = {C.C. van 't Klooster, H.M. Nathoe, J .Hjortnaes, M.L. Bots, I. Išgum, N. Lessmann, Y. van der Graaf, T. Leiner, F.L.J. Visseren, On behalf of the UCC-SMART-study group}, doi = {10.1016/j.ijcha.2020.100499}, year = {2020}, date = {2020-04-20}, journal = {International Journal of Cardiology, Heart & Vasculature}, volume = {27}, number = {100499}, abstract = {Aims The aim is to investigate (multifocal) cardiovascular calcification in patients with established cardiovascular disease (CVD), regarding prevalence, risk factors, and relation with recurrent CVD or vascular interventions. Coronary artery calcification (CAC), thoracic aortic calcification (TAC) (including ascending aorta, aortic arch, descending aorta), mitral annular calcification (MAC), and aortic valve calcification (AVC) are studied. Methods The study concerned 568 patients with established CVD enrolled in the ORACLE cohort. All patients underwent computed tomography. Prevalence of site-specific and multifocal calcification was determined. Ordinal regression analyses were performed to quantify associations of risk factors with cardiovascular calcification, and Cox regression analyses to determine the relation between calcium scores and recurrent CVD or vascular interventions. Results Calcification was multifocal in 76% (N = 380) of patients with calcification. Age (per SD) was associated with calcification at all locations (lowest OR 2.17; 99%CI 1.54–3.11 for ascending aorta calcification). Diabetes mellitus and systolic blood pressure were associated with TAC, whereas male sex was a determinant of CAC. TAC and CAC were related to the combined endpoint CVD or vascular intervention (N = 68). In a model with all calcium scores combined, only CAC was related to the combined outcome (HR 1.39; 95%CI 1.15–1.68). Conclusion Cardiovascular calcification is generally multifocal in patients with established CVD. Differences in associations between risk factors and calcification at various anatomical locations stress the divergence in pathophysiological pathways. CAC is most strongly related to recurrent CVD or vascular interventions independent of traditional risk factors, and independent of heart valve and thoracic aorta calcification.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Aims The aim is to investigate (multifocal) cardiovascular calcification in patients with established cardiovascular disease (CVD), regarding prevalence, risk factors, and relation with recurrent CVD or vascular interventions. Coronary artery calcification (CAC), thoracic aortic calcification (TAC) (including ascending aorta, aortic arch, descending aorta), mitral annular calcification (MAC), and aortic valve calcification (AVC) are studied. Methods The study concerned 568 patients with established CVD enrolled in the ORACLE cohort. All patients underwent computed tomography. Prevalence of site-specific and multifocal calcification was determined. Ordinal regression analyses were performed to quantify associations of risk factors with cardiovascular calcification, and Cox regression analyses to determine the relation between calcium scores and recurrent CVD or vascular interventions. Results Calcification was multifocal in 76% (N = 380) of patients with calcification. Age (per SD) was associated with calcification at all locations (lowest OR 2.17; 99%CI 1.54–3.11 for ascending aorta calcification). Diabetes mellitus and systolic blood pressure were associated with TAC, whereas male sex was a determinant of CAC. TAC and CAC were related to the combined endpoint CVD or vascular intervention (N = 68). In a model with all calcium scores combined, only CAC was related to the combined outcome (HR 1.39; 95%CI 1.15–1.68). Conclusion Cardiovascular calcification is generally multifocal in patients with established CVD. Differences in associations between risk factors and calcification at various anatomical locations stress the divergence in pathophysiological pathways. CAC is most strongly related to recurrent CVD or vascular interventions independent of traditional risk factors, and independent of heart valve and thoracic aorta calcification. |
2. | N. Lessmann, B. van Ginneken, P.A. de Jong, I. Išgum Iterative fully convolutional neural networks for automatic vertebra segmentation and identification Journal Article Medical Image Analysis, 53 , pp. 142-155, 2019. @article{Lessmann2019, title = {Iterative fully convolutional neural networks for automatic vertebra segmentation and identification}, author = {N. Lessmann, B. van Ginneken, P.A. de Jong, I. Išgum}, url = {https://arxiv.org/abs/1804.04383}, year = {2019}, date = {2019-02-12}, journal = {Medical Image Analysis}, volume = {53}, pages = {142-155}, abstract = {Precise segmentation and anatomical identification of the vertebrae provides the basis for automatic analysis of the spine, such as detection of vertebral compression fractures or other abnormalities. Most dedicated spine CT and MR scans as well as scans of the chest, abdomen or neck cover only part of the spine. Segmentation and identification should therefore not rely on the visibility of certain vertebrae or a certain number of vertebrae. We propose an iterative instance segmentation approach that uses a fully convolutional neural network to segment and label vertebrae one after the other, independently of the number of visible vertebrae. This instance-by-instance segmentation is enabled by combining the network with a memory component that retains information about already segmented vertebrae. The network iteratively analyzes image patches, using information from both image and memory to search for the next vertebra. To efficiently traverse the image, we include the prior knowledge that the vertebrae are always located next to each other, which is used to follow the vertebral column. The network concurrently performs multiple tasks, which are segmentation of a vertebra, regression of its anatomical label and prediction whether the vertebra is completely visible in the image, which allows to exclude incompletely visible vertebrae from further analyses. The predicted anatomical labels of the individual vertebrae are additionally refined with a maximum likelihood approach, choosing the overall most likely labeling if all detected vertebrae are taken into account. This method was evaluated with five diverse datasets, including multiple modalities (CT and MR), various fields of view and coverages of different sections of the spine, and a particularly challenging set of low-dose chest CT scans. For vertebra segmentation, the average Dice score was 94.9 ± 2.1% with an average absolute symmetric surface distance of 0.2 ± 10.1mm. The anatomical identification had an accuracy of 93 %, corresponding to a single case with mislabeled vertebrae. Vertebrae were classified as completely or incompletely visible with an accuracy of 97 %. The proposed iterative segmentation method compares favorably with state-of-the-art methods and is fast, flexible and generalizable.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Precise segmentation and anatomical identification of the vertebrae provides the basis for automatic analysis of the spine, such as detection of vertebral compression fractures or other abnormalities. Most dedicated spine CT and MR scans as well as scans of the chest, abdomen or neck cover only part of the spine. Segmentation and identification should therefore not rely on the visibility of certain vertebrae or a certain number of vertebrae. We propose an iterative instance segmentation approach that uses a fully convolutional neural network to segment and label vertebrae one after the other, independently of the number of visible vertebrae. This instance-by-instance segmentation is enabled by combining the network with a memory component that retains information about already segmented vertebrae. The network iteratively analyzes image patches, using information from both image and memory to search for the next vertebra. To efficiently traverse the image, we include the prior knowledge that the vertebrae are always located next to each other, which is used to follow the vertebral column. The network concurrently performs multiple tasks, which are segmentation of a vertebra, regression of its anatomical label and prediction whether the vertebra is completely visible in the image, which allows to exclude incompletely visible vertebrae from further analyses. The predicted anatomical labels of the individual vertebrae are additionally refined with a maximum likelihood approach, choosing the overall most likely labeling if all detected vertebrae are taken into account. This method was evaluated with five diverse datasets, including multiple modalities (CT and MR), various fields of view and coverages of different sections of the spine, and a particularly challenging set of low-dose chest CT scans. For vertebra segmentation, the average Dice score was 94.9 ± 2.1% with an average absolute symmetric surface distance of 0.2 ± 10.1mm. The anatomical identification had an accuracy of 93 %, corresponding to a single case with mislabeled vertebrae. Vertebrae were classified as completely or incompletely visible with an accuracy of 97 %. The proposed iterative segmentation method compares favorably with state-of-the-art methods and is fast, flexible and generalizable. |
3. | N. Lessmann, P.A. de Jong, C. Celeng, R.A.P. Takx, M.A. Viergever, B. van Ginneken, I. Išgum Sex differences in coronary artery and thoracic aorta calcification and their association with cardiovascular mortality in heavy smokers Journal Article JACC: Cardiovascular Imaging, 12 (9), pp. 1808-1817, 2019. @article{Lessmann2019, title = {Sex differences in coronary artery and thoracic aorta calcification and their association with cardiovascular mortality in heavy smokers}, author = {N. Lessmann, P.A. de Jong, C. Celeng, R.A.P. Takx, M.A. Viergever, B. van Ginneken, I. Išgum}, url = {https://dx.doi.org/10.1016/j.jcmg.2018.10.026}, year = {2019}, date = {2019-01-16}, journal = {JACC: Cardiovascular Imaging}, volume = {12}, number = {9}, pages = {1808-1817}, abstract = {Objectives: The aim of this study was to investigate sex differences in the prevalence, extent, and association of coronary artery calcium (CAC) and thoracic aorta calcium (TAC) scores with cardiovascular mortality in a population eligible for lung screening. Background: CAC and TAC scores derived from chest computed tomography (CT) might be useful biomarkers for individualized cardiovascular disease prevention and could be especially relevant in high-risk populations such as heavy smokers. Therefore, it is important to know the prevalence of arterial calcifications in male and female heavy smokers, and if there are differences in the predictive value calcifications carry. Methods: We performed a nested case–control study with 5,718 participants of the CT arm of the NLST (National Lung Screening Trial). Prevalence and extent of CAC and TAC were resampled to the full cohort to provide unbiased estimates of the typical calcium burden of male and female heavy smokers. Weighted Cox proportional hazards regression was used to assess differences in the association of CAC and TAC scores with all-cause and cardiovascular mortality. Results: CAC was substantially more common and more severe in men (prevalence: 81% vs. 60%; median volume: 104 mm³ vs.12 mm³). Women had CAC comparable to that of men who were 10 years younger. TAC was equally common in men and women, with a tendency to be more pronounced in women (prevalence: 92% vs. 93%; median volume: 388 mm³ vs. 404 mm³). Both types of calcification were associated with increased cardiovascular and all-cause mortality. TAC scores improved the prediction of coronary heart disease mortality over CAC in men, but not in women. In both sexes, TAC, but not CAC, was associated with cardiovascular mortality other than coronary heart disease. Conclusions: CAC develops later in women, whereas TAC develops equally in both sexes. CAC is strongly associated with coronary heart disease, whereas TAC is especially associated with extracardiac vascular mortality in either sex.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Objectives: The aim of this study was to investigate sex differences in the prevalence, extent, and association of coronary artery calcium (CAC) and thoracic aorta calcium (TAC) scores with cardiovascular mortality in a population eligible for lung screening. Background: CAC and TAC scores derived from chest computed tomography (CT) might be useful biomarkers for individualized cardiovascular disease prevention and could be especially relevant in high-risk populations such as heavy smokers. Therefore, it is important to know the prevalence of arterial calcifications in male and female heavy smokers, and if there are differences in the predictive value calcifications carry. Methods: We performed a nested case–control study with 5,718 participants of the CT arm of the NLST (National Lung Screening Trial). Prevalence and extent of CAC and TAC were resampled to the full cohort to provide unbiased estimates of the typical calcium burden of male and female heavy smokers. Weighted Cox proportional hazards regression was used to assess differences in the association of CAC and TAC scores with all-cause and cardiovascular mortality. Results: CAC was substantially more common and more severe in men (prevalence: 81% vs. 60%; median volume: 104 mm³ vs.12 mm³). Women had CAC comparable to that of men who were 10 years younger. TAC was equally common in men and women, with a tendency to be more pronounced in women (prevalence: 92% vs. 93%; median volume: 388 mm³ vs. 404 mm³). Both types of calcification were associated with increased cardiovascular and all-cause mortality. TAC scores improved the prediction of coronary heart disease mortality over CAC in men, but not in women. In both sexes, TAC, but not CAC, was associated with cardiovascular mortality other than coronary heart disease. Conclusions: CAC develops later in women, whereas TAC develops equally in both sexes. CAC is strongly associated with coronary heart disease, whereas TAC is especially associated with extracardiac vascular mortality in either sex. |
4. | N. Lessmann, B. van Ginneken, M. Zreik, P.A. de Jong, B.D. de Vos, M.A. Viergever, I. Išgum Automatic calcium scoring in low-dose chest CT using deep neural networks with dilated convolutions Journal Article IEEE Transactions on Medical Imaging, 37 (2), pp. 615-625, 2018. @article{Lessmann2017, title = {Automatic calcium scoring in low-dose chest CT using deep neural networks with dilated convolutions}, author = {N. Lessmann, B. van Ginneken, M. Zreik, P.A. de Jong, B.D. de Vos, M.A. Viergever, I. Išgum}, url = {https://arxiv.org/pdf/1711.00349.pdf}, year = {2018}, date = {2018-02-01}, journal = {IEEE Transactions on Medical Imaging}, volume = {37}, number = {2}, pages = {615-625}, abstract = {Heavy smokers undergoing screening with low-dose chest CT are affected by cardiovascular disease as much as by lung cancer. Low-dose chest CT scans acquired in screening enable quantification of atherosclerotic calcifications and thus enable identification of subjects at increased cardiovascular risk. This paper presents a method for automatic detection of coronary artery, thoracic aorta and cardiac valve calcifications in low-dose chest CT using two consecutive convolutional neural networks. The first network identifies and labels potential calcifications according to their anatomical location and the second network identifies true calcifications among the detected candidates. This method was trained and evaluated on a set of 1744 CT scans from the National Lung Screening Trial. To determine whether any reconstruction or only images reconstructed with soft tissue filters can be used for calcification detection, we evaluated the method on soft and medium/sharp filter reconstructions separately. On soft filter reconstructions, the method achieved F1 scores of 0.89, 0.89, 0.67, and 0.55 for coronary artery, thoracic aorta, aortic valve and mitral valve calcifications, respectively. On sharp filter reconstructions, the F1 scores were 0.84, 0.81, 0.64, and 0.66, respectively. Linearly weighted kappa coefficients for risk category assignment based on per subject coronary artery calcium were 0.91 and 0.90 for soft and sharp filter reconstructions, respectively. These results demonstrate that the presented method enables reliable automatic cardiovascular risk assessment in all low-dose chest CT scans acquired for lung cancer screening.}, keywords = {}, pubstate = {published}, tppubtype = {article} } Heavy smokers undergoing screening with low-dose chest CT are affected by cardiovascular disease as much as by lung cancer. Low-dose chest CT scans acquired in screening enable quantification of atherosclerotic calcifications and thus enable identification of subjects at increased cardiovascular risk. This paper presents a method for automatic detection of coronary artery, thoracic aorta and cardiac valve calcifications in low-dose chest CT using two consecutive convolutional neural networks. The first network identifies and labels potential calcifications according to their anatomical location and the second network identifies true calcifications among the detected candidates. This method was trained and evaluated on a set of 1744 CT scans from the National Lung Screening Trial. To determine whether any reconstruction or only images reconstructed with soft tissue filters can be used for calcification detection, we evaluated the method on soft and medium/sharp filter reconstructions separately. On soft filter reconstructions, the method achieved F1 scores of 0.89, 0.89, 0.67, and 0.55 for coronary artery, thoracic aorta, aortic valve and mitral valve calcifications, respectively. On sharp filter reconstructions, the F1 scores were 0.84, 0.81, 0.64, and 0.66, respectively. Linearly weighted kappa coefficients for risk category assignment based on per subject coronary artery calcium were 0.91 and 0.90 for soft and sharp filter reconstructions, respectively. These results demonstrate that the presented method enables reliable automatic cardiovascular risk assessment in all low-dose chest CT scans acquired for lung cancer screening. |
Inproceedings |
|
1. | N. Lessmann, B. van Ginneken, P.A. de Jong, I. Išgum Iterative fully convolutional neural networks for automatic vertebra segmentation Inproceedings In: Medical Imaging with Deep Learning (MIDL 2018), 2018. @inproceedings{Lessmann2018, title = {Iterative fully convolutional neural networks for automatic vertebra segmentation}, author = {N. Lessmann, B. van Ginneken, P.A. de Jong, I. Išgum}, url = {https://openreview.net/pdf?id=S1NnlZnjG}, year = {2018}, date = {2018-05-22}, booktitle = {Medical Imaging with Deep Learning (MIDL 2018)}, abstract = {Precise segmentation of the vertebrae is often required for automatic detection of vertebral abnormalities. This especially enables incidental detection of abnormalities such as compression fractures in images that were acquired for other diagnostic purposes. While many CT and MR scans of the chest and abdomen cover a section of the spine, they often do not cover the entire spine. Additionally, the first and last visible vertebrae are likely only partially included in such scans. In this paper, we therefore approach vertebra segmentation as an instance segmentation problem. A fully convolutional neural network is combined with an instance memory that retains information about already segmented vertebrae. This network iteratively analyzes image patches, using the instance memory to search for and segment the first not yet segmented vertebra. At the same time, each vertebra is classified as completely or partially visible, so that partially visible vertebrae can be excluded from further analyses. We evaluated this method on spine CT scans from a vertebra segmentation challenge and on low-dose chest CT scans. The method achieved an average Dice score of 95.8% and 92.1%, respectively, and a mean absolute surface distance of 0.194 mm and 0.344 mm.}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } Precise segmentation of the vertebrae is often required for automatic detection of vertebral abnormalities. This especially enables incidental detection of abnormalities such as compression fractures in images that were acquired for other diagnostic purposes. While many CT and MR scans of the chest and abdomen cover a section of the spine, they often do not cover the entire spine. Additionally, the first and last visible vertebrae are likely only partially included in such scans. In this paper, we therefore approach vertebra segmentation as an instance segmentation problem. A fully convolutional neural network is combined with an instance memory that retains information about already segmented vertebrae. This network iteratively analyzes image patches, using the instance memory to search for and segment the first not yet segmented vertebra. At the same time, each vertebra is classified as completely or partially visible, so that partially visible vertebrae can be excluded from further analyses. We evaluated this method on spine CT scans from a vertebra segmentation challenge and on low-dose chest CT scans. The method achieved an average Dice score of 95.8% and 92.1%, respectively, and a mean absolute surface distance of 0.194 mm and 0.344 mm. |
2. | N. Lessmann, B. van Ginneken, I. Išgum Iterative convolutional neural networks for automatic vertebra identification and segmentation in CT images Inproceedings In: SPIE Medical Imaging, pp. 1057408, 2018. @inproceedings{less18, title = {Iterative convolutional neural networks for automatic vertebra identification and segmentation in CT images}, author = {N. Lessmann, B. van Ginneken, I. Išgum}, url = {https://doi.org/10.1117/12.2292731}, year = {2018}, date = {2018-02-11}, booktitle = {SPIE Medical Imaging}, pages = {1057408}, abstract = {Segmentation and identification of the vertebrae in CT images are important initial steps for automatic analysis of the spine. This paper presents an automatic method based on iteratively applied convolutional neural networks. This approach utilizes the inherent order of the vertebral column to simplify the detection problem, so that a deep neural network can be trained with a low number of manual reference segmentations. Vertebrae are identified and segmented individually in sequential order relative to a reference vertebra. Additionally, a coarse-to-fine segmentation scheme is employed: The localization and identification of the vertebrae is first performed in low-resolution images that enable the analysis of context information. The fine segmentation is performed afterwards in the original high-resolution images. In contrast to most previous methods for vertebra segmentation, this approach is not focused on modeling shape information. The method was trained and evaluated with 15 spine CT scans from the MICCAI CSI 2014 workshop challenge. These scans cover the whole thoracic and lumbar part of the spine of healthy young adults. In contrast to a non-iterative convolutional neural network, the proposed method correctly identified all vertebrae. The method achieved a mean Dice coefficient of 0.948 and a mean surface distance of 0.29 mm and thus outperforms the best method that participated in the original challenge.}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } Segmentation and identification of the vertebrae in CT images are important initial steps for automatic analysis of the spine. This paper presents an automatic method based on iteratively applied convolutional neural networks. This approach utilizes the inherent order of the vertebral column to simplify the detection problem, so that a deep neural network can be trained with a low number of manual reference segmentations. Vertebrae are identified and segmented individually in sequential order relative to a reference vertebra. Additionally, a coarse-to-fine segmentation scheme is employed: The localization and identification of the vertebrae is first performed in low-resolution images that enable the analysis of context information. The fine segmentation is performed afterwards in the original high-resolution images. In contrast to most previous methods for vertebra segmentation, this approach is not focused on modeling shape information. The method was trained and evaluated with 15 spine CT scans from the MICCAI CSI 2014 workshop challenge. These scans cover the whole thoracic and lumbar part of the spine of healthy young adults. In contrast to a non-iterative convolutional neural network, the proposed method correctly identified all vertebrae. The method achieved a mean Dice coefficient of 0.948 and a mean surface distance of 0.29 mm and thus outperforms the best method that participated in the original challenge. |
3. | N. Lessmann, I. Isgum, A.A.A. Setio, B.D. de Vos, F. Ciompi, P.A. de Jong, M. Oudkerk, W.P.Th.M. Mali, M.A. Viergever, B. van Ginneken Deep convolutional neural networks for automatic coronary calcium scoring in a screening study with low-dose chest CT Inproceedings In: SPIE Medical Imaging, pp. 978511, 2016, (Bla). @inproceedings{less16, title = {Deep convolutional neural networks for automatic coronary calcium scoring in a screening study with low-dose chest CT}, author = {N. Lessmann, I. Isgum, A.A.A. Setio, B.D. de Vos, F. Ciompi, P.A. de Jong, M. Oudkerk, W.P.Th.M. Mali, M.A. Viergever, B. van Ginneken}, url = {https://doi.org/10.1117/12.2216978 http://188.166.76.74/papers/Lessmann2016_CalciumScoringChestCT_DeepLearning_SPIE.pdf}, year = {2016}, date = {2016-03-01}, booktitle = {SPIE Medical Imaging}, volume = {9785}, pages = {978511}, abstract = {Coronary artery calcium (CAC) scoring can identify subjects at risk of cardiovascular events in screening programs with low-dose chest CT. We present an automatic method for CAC scoring based on deep convolutional neural networks. Candidates are extracted by intensity-based thresholding and subsequently classified by three concurrent networks that analyze three orthogonal 2D image patches per voxel. The networks consist of three convolutional steps and one fully-connected layer. In 231 subjects, this method detected on average 194.3 / 199.8mm3 CAC (sensitivity 97.2%), with 10.3mm3 false-positive volume per scan. Accuracy of cardiovascular risk category assignment was 84.4% (linearly weighted kappa 0.89).}, note = {Bla}, keywords = {}, pubstate = {published}, tppubtype = {inproceedings} } Coronary artery calcium (CAC) scoring can identify subjects at risk of cardiovascular events in screening programs with low-dose chest CT. We present an automatic method for CAC scoring based on deep convolutional neural networks. Candidates are extracted by intensity-based thresholding and subsequently classified by three concurrent networks that analyze three orthogonal 2D image patches per voxel. The networks consist of three convolutional steps and one fully-connected layer. In 231 subjects, this method detected on average 194.3 / 199.8mm3 CAC (sensitivity 97.2%), with 10.3mm3 false-positive volume per scan. Accuracy of cardiovascular risk category assignment was 84.4% (linearly weighted kappa 0.89). |
Abstracts |
|
1. | A. Schreuder; C. Jacobs; N. Lessmann; E.T. Scholten; I. Išgum; M. Prokop; C.M. Schaefer-Prokop; B. van Ginneken Improved lung cancer and mortality prediction accuracy using survival models based on semi-automatic CT image measurements Abstract In: 2018. @booklet{Schreuder2018, title = {Improved lung cancer and mortality prediction accuracy using survival models based on semi-automatic CT image measurements}, author = {A. Schreuder and C. Jacobs and N. Lessmann and E.T. Scholten and I. Išgum and M. Prokop and C.M. Schaefer-Prokop and B. van Ginneken}, year = {2018}, date = {2018-06-16}, booktitle = {World Conference on Lung Cancer}, month = {06}, keywords = {}, pubstate = {published}, tppubtype = {booklet} } |
2. | N. Lessmann, B. van Ginneken, P.A. de Jong, W.B. Veldhuis, M.A. Viergever, I. Isgum Deep learning analysis for automatic calcium scoring in routine chest CT Abstract In: 2017. @booklet{less2017, title = {Deep learning analysis for automatic calcium scoring in routine chest CT}, author = {N. Lessmann, B. van Ginneken, P.A. de Jong, W.B. Veldhuis, M.A. Viergever, I. Isgum}, year = {2017}, date = {2017-11-28}, booktitle = {Radiological Society of North America, 103rd Annual Meeting}, abstract = {INTRODUCTION Coronary artery calcium (CAC) is a robust predictor of cardiovascular events (CVE) in asymptomatic individuals. Several guidelines recommend reporting of CAC scores in ungated chest CT exams. In addition, chest CT can be used to quantify thoracic aorta calcification (TAC) and cardiac valve calcification (CVC), which may further improve prediction of CVE. This study evaluates the performance of an automatic method for scoring of CAC, TAC and CVC on routine chest CT exams. METHOD AND MATERIALS The study includes 290 retrospectively collected chest CTs (16/64/256 slice scanners, 0.9/1.0mm slice thickness, 0.7mm increment, 100/120kvP, 60mAs, ungated non-contrast). For calcium scoring, the scans were resampled to 3mm thick slices with 1.5mm increment. Calcifications were manually identified and labeled to define a reference standard. A deep-learning-based method employing two convolutional neural networks was used to identify and label calcifications automatically. This automatic method was trained on 1012 low-dose chest CTs from the National Lung Screening Trial. Calcifications were quantified using volume and Agatston scores. Correlation of automatic and reference scores was assessed using two-way-mixed ICC. Additionally, patients were assigned to a cardiovascular risk category based on their total CAC Agatston score (0, 1-100, 101-1000, >1000). Risk category assignment was evaluated using proportion of agreement and linearly weighted к. RESULTS 16 scans (5.5%) were excluded due to insufficient image quality for manual scoring. 38.7% of the remaining patients had no CAC, 18.6% had a score 1-100, 16.4% a score 101-1000, and 26.3% a score > 1000. There was excellent correlation between automatic and manual volume scores for CAC (ICC=0.925, 95% CI: 0.904-0.941), TAC (ICC=0.991, 95% CI: 0.987-0.994), aortic valve calcifications (ICC=0.791, 95% CI: 0.734-0.836) and mitral valve calcifications (ICC=0.935, 95% CI: 0.918-0.949). Automatic and manual risk categorization agreed in 81.8% and differed by one category in 15.0% of the patients with excellent reliability (к=0.82). CONCLUSIONS Fully automatic scoring of coronary, aortic and cardiac valve calcifications highly correlates with manual scoring, even in ungated routine chest CT.}, month = {11}, keywords = {}, pubstate = {published}, tppubtype = {booklet} } INTRODUCTION Coronary artery calcium (CAC) is a robust predictor of cardiovascular events (CVE) in asymptomatic individuals. Several guidelines recommend reporting of CAC scores in ungated chest CT exams. In addition, chest CT can be used to quantify thoracic aorta calcification (TAC) and cardiac valve calcification (CVC), which may further improve prediction of CVE. This study evaluates the performance of an automatic method for scoring of CAC, TAC and CVC on routine chest CT exams. METHOD AND MATERIALS The study includes 290 retrospectively collected chest CTs (16/64/256 slice scanners, 0.9/1.0mm slice thickness, 0.7mm increment, 100/120kvP, 60mAs, ungated non-contrast). For calcium scoring, the scans were resampled to 3mm thick slices with 1.5mm increment. Calcifications were manually identified and labeled to define a reference standard. A deep-learning-based method employing two convolutional neural networks was used to identify and label calcifications automatically. This automatic method was trained on 1012 low-dose chest CTs from the National Lung Screening Trial. Calcifications were quantified using volume and Agatston scores. Correlation of automatic and reference scores was assessed using two-way-mixed ICC. Additionally, patients were assigned to a cardiovascular risk category based on their total CAC Agatston score (0, 1-100, 101-1000, >1000). Risk category assignment was evaluated using proportion of agreement and linearly weighted к. RESULTS 16 scans (5.5%) were excluded due to insufficient image quality for manual scoring. 38.7% of the remaining patients had no CAC, 18.6% had a score 1-100, 16.4% a score 101-1000, and 26.3% a score > 1000. There was excellent correlation between automatic and manual volume scores for CAC (ICC=0.925, 95% CI: 0.904-0.941), TAC (ICC=0.991, 95% CI: 0.987-0.994), aortic valve calcifications (ICC=0.791, 95% CI: 0.734-0.836) and mitral valve calcifications (ICC=0.935, 95% CI: 0.918-0.949). Automatic and manual risk categorization agreed in 81.8% and differed by one category in 15.0% of the patients with excellent reliability (к=0.82). CONCLUSIONS Fully automatic scoring of coronary, aortic and cardiac valve calcifications highly correlates with manual scoring, even in ungated routine chest CT. |
3. | N. Lessmann, I. Isgum, S. Lam, J. Mayo, P.A. de Jong, M.A. Viergever, B. van Ginneken Automatic coronary calcium scoring and cardiovascular risk estimation in the Pan-Canadian lung cancer screening trial Abstract In: 2015. @booklet{less15, title = {Automatic coronary calcium scoring and cardiovascular risk estimation in the Pan-Canadian lung cancer screening trial}, author = {N. Lessmann, I. Isgum, S. Lam, J. Mayo, P.A. de Jong, M.A. Viergever, B. van Ginneken}, year = {2015}, date = {2015-11-29}, booktitle = {Radiological Society of North America, 101th Annual Meeting}, abstract = {PURPOSE Coronary artery calcium (CAC) scores determined in low-dose ungated chest CT as acquired for lung cancer screening are a strong and independent predictor of cardiovascular events (CVE). Automatic CAC scoring can complement lung cancer screening by identifying subjects at risk of a CVE. We investigated agreement and reliability of an automatic CAC scoring method previously developed for CAC scoring in the Dutch-Belgian lung cancer screening trial (NELSON) in the Pan-Canadian Early Detection of Lung Cancer Study (PanCan). METHOD AND MATERIALS Our study included 149 low-dose chest CT scans from the PanCan (16x or 64x 1.0 or 1.25 mm, 120 kvP, 40-50 mAs, no IV contrast, no ECG synchronization). Prior to scoring, the scans were reconstructed to 3.1 mm slice thickness at 1.4 mm increment. In each scan, the reference standard was set by manual annotation of CAC by one observer. Only voxels with intensities above 130 HU and lesions with a minimum volume of 1.5 mm³ were considered. Subsequently, automatic CAC scoring was performed using a supervised pattern recognition method previously developed for CAC scoring in the NELSON trial. The algorithm was trained with 100 NELSON scans. Volume and Agatston scores were computed for manual and automatic scores. Subjects were assigned to a cardiovascular risk category based on the Agatston score (0-10, 11-100, 101-400, >400). Agreement was determined as proportion of agreement in risk category assignment. Reliability was determined using linearly weighted к for risk category assignment and two-way-mixed intraclass correlation coefficient (ICC) for volume scores. RESULTS Three (2.0%) scans were excluded due to metal artifacts. In the remaining scans, the reference median CAC volume was 52.3 mm3 (P25-P75: 0-287.3 mm3). 83.6% of these scans were automatically assigned to the correct risk category. Reliability of the automatic scoring was very good for both risk category assignment (к=0.83) and volume scores (ICC=0.80). CONCLUSION Automatic coronary calcium scoring in lung cancer screening CT scans is feasible. To achieve good agreement with manual scores representative training data was not necessary.}, month = {11}, keywords = {}, pubstate = {published}, tppubtype = {booklet} } PURPOSE Coronary artery calcium (CAC) scores determined in low-dose ungated chest CT as acquired for lung cancer screening are a strong and independent predictor of cardiovascular events (CVE). Automatic CAC scoring can complement lung cancer screening by identifying subjects at risk of a CVE. We investigated agreement and reliability of an automatic CAC scoring method previously developed for CAC scoring in the Dutch-Belgian lung cancer screening trial (NELSON) in the Pan-Canadian Early Detection of Lung Cancer Study (PanCan). METHOD AND MATERIALS Our study included 149 low-dose chest CT scans from the PanCan (16x or 64x 1.0 or 1.25 mm, 120 kvP, 40-50 mAs, no IV contrast, no ECG synchronization). Prior to scoring, the scans were reconstructed to 3.1 mm slice thickness at 1.4 mm increment. In each scan, the reference standard was set by manual annotation of CAC by one observer. Only voxels with intensities above 130 HU and lesions with a minimum volume of 1.5 mm³ were considered. Subsequently, automatic CAC scoring was performed using a supervised pattern recognition method previously developed for CAC scoring in the NELSON trial. The algorithm was trained with 100 NELSON scans. Volume and Agatston scores were computed for manual and automatic scores. Subjects were assigned to a cardiovascular risk category based on the Agatston score (0-10, 11-100, 101-400, >400). Agreement was determined as proportion of agreement in risk category assignment. Reliability was determined using linearly weighted к for risk category assignment and two-way-mixed intraclass correlation coefficient (ICC) for volume scores. RESULTS Three (2.0%) scans were excluded due to metal artifacts. In the remaining scans, the reference median CAC volume was 52.3 mm3 (P25-P75: 0-287.3 mm3). 83.6% of these scans were automatically assigned to the correct risk category. Reliability of the automatic scoring was very good for both risk category assignment (к=0.83) and volume scores (ICC=0.80). CONCLUSION Automatic coronary calcium scoring in lung cancer screening CT scans is feasible. To achieve good agreement with manual scores representative training data was not necessary. |
PhD Theses |
|
1. | N. Lessmann Machine learning based quantification of extrapulmonary diseases in chest CT PhD Thesis Utrecht University, The Netherlands, 2019, ISBN: 978-94-6323-607-2. @phdthesis{Lessmann2019c, title = {Machine learning based quantification of extrapulmonary diseases in chest CT}, author = {N. Lessmann}, isbn = {978-94-6323-607-2}, year = {2019}, date = {2019-06-25}, school = {Utrecht University, The Netherlands}, keywords = {}, pubstate = {published}, tppubtype = {phdthesis} } |