Deep learning‐based convolutional neural network for intramodality brain MRI synthesis
TL;DR: A state‐of‐the‐art deep learning convolutional neural network for image‐to‐image translation across three standards MRI contrasts for the brain could hold great promise for clinical use for improved clinical decision‐making and better diagnosis of brain cancer patients due to the availability of multicontrast MRIs.
read more
Abstract: Abstract Purpose The existence of multicontrast magnetic resonance (MR) images increases the level of clinical information available for the diagnosis and treatment of brain cancer patients. However, acquiring the complete set of multicontrast MR images is not always practically feasible. In this study, we developed a state‐of‐the‐art deep learning convolutional neural network (CNN) for image‐to‐image translation across three standards MRI contrasts for the brain. Methods BRATS’2018 MRI dataset of 477 patients clinically diagnosed with glioma brain cancer was used in this study, with each patient having T1‐weighted (T1), T2‐weighted (T2), and FLAIR contrasts. It was randomly split into 64%, 16%, and 20% as training, validation, and test set, respectively. We developed a U‐Net model to learn the nonlinear mapping of a source image contrast to a target image contrast across three MRI contrasts. The model was trained and validated with 2D paired MR images using a mean‐squared error (MSE) cost function, Adam optimizer with 0.001 learning rate, and 120 epochs with a batch size of 32. The generated synthetic‐MR images were evaluated against the ground‐truth images by computing the MSE, mean absolute error (MAE), peak signal‐to‐noise ratio (PSNR), and structural similarity index (SSIM). Results The generated synthetic‐MR images with our model were nearly indistinguishable from the real images on the testing dataset for all translations, except synthetic FLAIR images had slightly lower quality and exhibited loss of details. The range of average PSNR, MSE, MAE, and SSIM values over the six translations were 29.44–33.25 dB, 0.0005–0.0012, 0.0086–0.0149, and 0.932–0.946, respectively. Our results were as good as the best‐reported results by other deep learning models on BRATS datasets. Conclusions Our U‐Net model exhibited that it can accurately perform image‐to‐image translation across brain MRI contrasts. It could hold great promise for clinical use for improved clinical decision‐making and better diagnosis of brain cancer patients due to the availability of multicontrast MRIs. This approach may be clinically relevant and setting a significant step to efficiently fill a gap of absent MR sequences without additional scanning.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Deep learning based synthesis of MRI, CT and PET: Review and analysis.
Sanuwani Dayarathna,Kh Tohidul Islam,Sergio Uribe,Guan Yang,Munawar Hayat,Zhaolin Chen +5 more
TL;DR: This survey comprehensively reviews deep learning-based medical imaging translation from 2018 to 2023 on pseudo-CT, synthetic MR, and synthetic PET, and provides an overview of synthetic contrasts in medical imaging and the most frequently employed deep learning networks for medical image synthesis.
44
Deep learning-based algorithm for postoperative glioblastoma MRI segmentation: a promising new tool for tumor burden assessment
Andrea Bianconi,Luca Francesco Rossi,Marta Bonada,Pietro Zeppa,E. Nico,Raffaele De Marco,Paola Lacroce,Fabio Cofano,Francesco Bruno,Giovanni Morana,Antonio Melcarne,R. Rudà,Luca Mainardi,Pietro Fiaschi,Diego Garbossa,Lia Morra +15 more
TL;DR: The performances achieved by the algorithm are consistent with previous literature for both pre-operative and post-operative glioblastoma’s MRI evaluation and it is possible to reduce the impact of low-quality images and missing sequences.
11
A layer-wise fusion network incorporating self-supervised learning for multimodal MR image synthesis
Qianying Zhou,Hua Zou +1 more
TL;DR: The proposed multimodal attention feature fusion block (MAFFB) in the well-designed layer-wise fusion strategy can model both common and unique information in all modalities, consistent with the clinical analysis.
5
Deep Learning for MRI Segmentation and Molecular Subtyping in Glioblastoma: Critical Aspects from an Emerging Field
Marta Bonada,Luca Francesco Rossi,Giovanni Carone,Francesca Panico,Fabio Cofano,Pietro Fiaschi,Diego Garbossa,Francesco DiMeco,Andrea Bianconi +8 more
TL;DR: Deep learning applications in glioblastoma MRI assessment have shown promise for tumor segmentation and molecular subtyping, but are hindered by technical limitations, including MRI heterogeneity and data scarcity, and require standardized data collection and regulation.
1
Application of MR Images in Radiotherapy Planning for brain tumor Based on Deep Learning.
Xiangkun Dai,Ma Na,Du Lehui,Xiaoshen Wang,Zhongjian Ju,Chuanbin Jie,Hanshun Gong,Ruigang Ge,Yu Wei,Baolin Qu +9 more
TL;DR: MRI images can be used for accurate dose calculation in brain tumor radiotherapy planning based on deep learning methods.
1
References
U-Net: Convolutional Networks for Biomedical Image Segmentation
Olaf Ronneberger,Philipp Fischer,Thomas Brox +2 more
- 05 Oct 2015
TL;DR: Neber et al. as discussed by the authors proposed a network and training strategy that relies on the strong use of data augmentation to use the available annotated samples more efficiently, which can be trained end-to-end from very few images and outperforms the prior best method (a sliding-window convolutional network) on the ISBI challenge for segmentation of neuronal structures in electron microscopic stacks.
Image quality assessment: from error visibility to structural similarity
TL;DR: In this article, a structural similarity index is proposed for image quality assessment based on the degradation of structural information, which can be applied to both subjective ratings and objective methods on a database of images compressed with JPEG and JPEG2000.
•Journal Article
Dropout: a simple way to prevent neural networks from overfitting
TL;DR: It is shown that dropout improves the performance of neural networks on supervised learning tasks in vision, speech recognition, document classification and computational biology, obtaining state-of-the-art results on many benchmark data sets.
•Proceedings Article
Rectified Linear Units Improve Restricted Boltzmann Machines
Vinod Nair,Geoffrey E. Hinton +1 more
- 21 Jun 2010
TL;DR: Restricted Boltzmann machines were developed using binary stochastic hidden units that learn features that are better for object recognition on the NORB dataset and face verification on the Labeled Faces in the Wild dataset.
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
Kaiming He,Xiangyu Zhang,Shaoqing Ren,Jian Sun +3 more
- 07 Dec 2015
TL;DR: In this paper, a Parametric Rectified Linear Unit (PReLU) was proposed to improve model fitting with nearly zero extra computational cost and little overfitting risk, which achieved a 4.94% top-5 test error on ImageNet 2012 classification dataset.