Standardization in Quantitative Imaging: A Multicenter Comparison of Radiomic Features from Different Software Packages on Digital Reference Objects and Patient Data Sets
Michael F. McNitt-Gray,Sandy Napel,Akshay Jaggi,Sarah A. Mattonen,Sarah A. Mattonen,Lubomir M. Hadjiiski,Mark Muzi,Dmitry B. Goldgof,Yoganand Balagurunathan,Larry Pierce,Paul E. Kinahan,Ella F. Jones,A. Nguyen,A. Virkud,Heang Ping Chan,Nastaran Emaminejad,M Wahi-Anwar,M. Daly,Mahmoud A. Abdalah,Hao Yang,Lin Lu,Wenbing Lv,Arman Rahmim,Aimilia Gastounioti,Sarthak Pati,Spyridon Bakas,Despina Kontos,Binsheng Zhao,Jayashree Kalpathy-Cramer,Keyvan Farahani +29 more
- 01 Jun 2020
- Vol. 6, Iss: 2, pp 118-128
TL;DR: Assessment of radiomic features when computed by several groups by using different software packages under very tightly controlled conditions highlights the value of feature definition standardization as well as the need to further clarify definitions for some features.
read more
Abstract: Radiomic features are being increasingly studied for clinical applications. We aimed to assess the agreement among radiomic features when computed by several groups by using different software packages under very tightly controlled conditions, which included standardized feature definitions and common image data sets. Ten sites (9 from the NCI's Quantitative Imaging Network] positron emission tomography-computed tomography working group plus one site from outside that group) participated in this project. Nine common quantitative imaging features were selected for comparison including features that describe morphology, intensity, shape, and texture. The common image data sets were: three 3D digital reference objects (DROs) and 10 patient image scans from the Lung Image Database Consortium data set using a specific lesion in each scan. Each object (DRO or lesion) was accompanied by an already-defined volume of interest, from which the features were calculated. Feature values for each object (DRO or lesion) were reported. The coefficient of variation (CV), expressed as a percentage, was calculated across software packages for each feature on each object. Thirteen sets of results were obtained for the DROs and patient data sets. Five of the 9 features showed excellent agreement with CV < 1%; 1 feature had moderate agreement (CV < 10%), and 3 features had larger variations (CV ≥ 10%) even after attempts at harmonization of feature calculations. This work highlights the value of feature definition standardization as well as the need to further clarify definitions for some features.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
Artificial intelligence and machine learning in cancer imaging
Dow-Mu Koh,Nikolaos Papanikolaou,Ulrich Bick,Rowland Illing,Charles E. Kahn,Jayshree Kalpathi-Cramer,C. Matos,Luis Martí-Bonmatí,Anne Miles,Seong K. Mun,Sandy Napel,Andrea Rockall,Evis Sala,Nicola Strickland,Fred W. Prior +14 more
TL;DR: An increasing array of tools are being developed using artificial intelligence (AI) and machine learning (ML) for cancer imaging as discussed by the authors . But the development of an optimal tool requires multidisciplinary engagement to ensure that the appropriate use case is met, as well as to undertake robust development and testing prior to its adoption into healthcare systems.
164
Understanding Sources of Variation to Improve the Reproducibility of Radiomics.
TL;DR: In this article, the authors present a review of the state-of-the-art in feature reproducibility and generalizability of radiomics signatures (features and models) and discuss potential strategies and practical considerations to reduce feature variability.
Joint EANM/SNMMI guideline on radiomics in nuclear medicine
Mathieu Hatt,Áron Krisztián Krizsán,Arman Rahmim,Tyler Bradshaw,Pedro Fragoso Costa,Attila Forgács,Robert Seifert,A.,Zwanenburg,I. El Naqa,Paul E. Kinahan,Florent Tixier,Abhijeet Kumar Jha,Dimitris Visvikis +13 more
TL;DR: In this article , the authors provide comprehensive information on best practices for robust radiomics analyses for both hand-crafted and deep learning-based approaches, including study design, quality assurance, data collection, impact of acquisition and reconstruction, detection and segmentation, feature standardization and implementation, as well as appropriate modelling schemes, model evaluation, and interpretation.
Structural and functional radiomics for lung cancer.
Guangyao Wu,Guangyao Wu,Arthur Jochems,Abdalla Ibrahim,Chenggong Yan,Chenggong Yan,Sebastian Sanduleanu,Henry C. Woodruff,Philippe Lambin +8 more
TL;DR: In this paper, the authors outline the latest applications of both structural and functional radiomics in detection, diagnosis, and prediction of pathology, gene mutation, treatment strategy, follow-up, treatment response evaluation, and prognosis in the field of lung cancer.
Impact of feature harmonization on radiogenomics analysis: Prediction of EGFR and KRAS mutations from non-small cell lung cancer PET/CT images
Isaac Shiri,Mehdi Amini,Mostafa Nazari,Ghasem Hajianfar,Atlas Haddadi Avval,Hamid Abdollahi,Mehrdad Oveisi,Hossein Arabi,Arman Rahmim,Habib Zaidi +9 more
TL;DR: In this article , the impact of harmonization on the performance of CT, PET, and fused PET/CT radiomic features toward the prediction of mutations status, for epidermal growth factor receptor (EGFR) and Kirsten rat sarcoma viral oncogene (KRAS) genes in non-small cell lung cancer (NSCLC) patients.
73
References
Textural Features for Image Classification
Robert M. Haralick,K. Shanmugam,Its'hak Dinstein +2 more
- 01 Nov 1973
TL;DR: These results indicate that the easily computable textural features based on gray-tone spatial dependancies probably have a general applicability for a wide variety of image-classification applications.
23.6K
Radiomics: Images Are More than Pictures, They Are Data.
TL;DR: This report describes the process of radiomics, its challenges, and its potential power to facilitate better clinical decision making, particularly in the care of patients with cancer.
6.9K
Computational Radiomics System to Decode the Radiographic Phenotype
Joost J. M. van Griethuysen,Joost J. M. van Griethuysen,Joost J. M. van Griethuysen,Andriy Fedorov,Chintan Parmar,Ahmed Hosny,Nicole Aucoin,Vivek Narayan,Regina G. H. Beets-Tan,Regina G. H. Beets-Tan,Jean-Christophe Fillion-Robin,Steve Pieper,Hugo J.W.L. Aerts +12 more
TL;DR: PyRadiomics, a flexible open-source platform capable of extracting a large panel of engineered features from medical images, is developed and its application in characterizing lung lesions is demonstrated.
Radiomics: extracting more information from medical images using advanced feature analysis.
Philippe Lambin,Emmanuel Rios-Velazquez,Ralph T.H. Leijenaar,Sara Carvalho,Ruud G.P.M. van Stiphout,Patrick V. Granton,Catharina M.L. Zegers,Robert J. Gillies,Ronald Boellard,Andre Dekker,Hugo J.W.L. Aerts,Hugo J.W.L. Aerts +11 more
TL;DR: Radiomics--the high-throughput extraction of large amounts of image features from radiographic images--addresses this problem and is one of the approaches that hold great promises but need further validation in multi-centric settings and in the laboratory.
5K
Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach
Hugo J.W.L. Aerts,Emmanuel Rios Velazquez,Ralph T.H. Leijenaar,Chintan Parmar,Patrick Grossmann,Sara Carvalho,Sara Cavalho,Johan Bussink,René Monshouwer,Benjamin Haibe-Kains,Derek H. F. Rietveld,Frank J. P. Hoebers,Michelle M. Rietbergen,C. René Leemans,Andre Dekker,John Quackenbush,Robert J. Gillies,Philippe Lambin +17 more
TL;DR: The data suggest that radiomics identifies a general prognostic phenotype existing in both lung and head-and-neck cancer, which may have a clinical impact as imaging is routinely used in clinical practice, providing an unprecedented opportunity to improve decision-support in cancer treatment at low cost.
Related Papers (5)
Alex Zwanenburg,Alex Zwanenburg,Martin Vallières,Mahmoud A. Abdalah,Hugo J.W.L. Aerts,Hugo J.W.L. Aerts,Vincent Andrearczyk,Aditya Apte,Saeed Ashrafinia,Spyridon Bakas,Roelof J. Beukinga,Ronald Boellaard,Marta Bogowicz,Luca Boldrini,Irène Buvat,Gary Cook,Christos Davatzikos,Adrien Depeursinge,Marie-Charlotte Desseroit,Nicola Dinapoli,Cuong V. Dinh,Sebastian Echegaray,Issam El Naqa,Issam El Naqa,Andriy Fedorov,Roberto Gatta,Robert J. Gillies,Vicky Goh,Michael Götz,Matthias Guckenberger,Sung Min Ha,Mathieu Hatt,Fabian Isensee,Philippe Lambin,Stefan Leger,Stefan Leger,Ralph T.H. Leijenaar,Jacopo Lenkowicz,Fiona Lippert,Are Losnegård,Klaus H. Maier-Hein,Olivier Morin,Henning Müller,Sandy Napel,Christophe Nioche,Fanny Orlhac,Sarthak Pati,Elisabeth Pfaehler,Arman Rahmim,Arman Rahmim,Arvind Rao,Jonas Scherer,Muhammad Siddique,Nanna M. Sijtsema,Jairo Socarras Fernandez,Emiliano Spezi,Roel J H M Steenbakkers,Stephanie Tanadini-Lang,Daniela Thorwarth,Esther G.C. Troost,Esther G.C. Troost,Taman Upadhaya,Vincenzo Valentini,Lisanne V. van Dijk,Joost J. M. van Griethuysen,Floris H. P. van Velden,Philip Whybra,Christian Richter,Christian Richter,Steffen Löck,Steffen Löck +70 more
Philippe Lambin,Ralph T.H. Leijenaar,Timo M. Deist,Jurgen Peerlings,Evelyn E.C. de Jong,Janita E. van Timmeren,Sebastian Sanduleanu,Ruben T. H. M. Larue,Aniek J.G. Even,Arthur Jochems,Yvonka van Wijk,Henry C. Woodruff,Johan van Soest,Tim Lustberg,Erik Roelofs,Wouter van Elmpt,Andre Dekker,Felix M. Mottaghy,Felix M. Mottaghy,Joachim E. Wildberger,Sean Walsh +20 more
Hugo J.W.L. Aerts,Emmanuel Rios Velazquez,Ralph T.H. Leijenaar,Chintan Parmar,Patrick Grossmann,Sara Carvalho,Sara Cavalho,Johan Bussink,René Monshouwer,Benjamin Haibe-Kains,Derek H. F. Rietveld,Frank J. P. Hoebers,Michelle M. Rietbergen,C. René Leemans,Andre Dekker,John Quackenbush,Robert J. Gillies,Philippe Lambin +17 more