Deep learning-based prediction of molecular cancer biomarkers from tissue slides: A new tool for precision oncology
1
조회
0
다운로드
1
인용
0
참고문헌
키워드
초록
Molecular tests are necessary to stratify cancer patients for targeted therapy. However, high cost and technical barriers limit the application of these tests, hindering optimal treatment. Recently, deep learning (DL) has been applied to predict molecular test results from digitized images of tissue slides. Furthermore, treatment response and prognosis can be predicted from tissue slides using DL. In this review, we summarized DL-based studies regarding the prediction of genetic mutation, microsatellite instability, tumor mutational burden, molecular subtypes, gene expression, treatment response, and prognosis directly from Hematoxylin and Eosin-stained tissue slides. Although performance needs to be improved, these studies clearly demonstrated the feasibility of DL-based prediction of key molecular features in cancer tissues. With the accumulation of data and technical advances, the performance of the DL system could be improved in the near future. Therefore, we expect that DL could provide cost- and time-effective alternative tools for patient stratification in the era of precision oncology.
Abstract
Molecular tests are necessary to stratify cancer patients for targeted therapy. However, high cost and technical barriers limit the application of these tests, hindering optimal treatment. Recently, deep learning (DL) has been applied to predict molecular test results from digitized images of tissue slides. Furthermore, treatment response and prognosis can be predicted from tissue slides using DL. In this review, we summarized DL-based studies regarding the prediction of genetic mutation, microsatellite instability, tumor mutational burden, molecular subtypes, gene expression, treatment response, and prognosis directly from Hematoxylin and Eosin-stained tissue slides. Although performance needs to be improved, these studies clearly demonstrated the feasibility of DL-based prediction of key molecular features in cancer tissues. With the accumulation of data and technical advances, the performance of the DL system could be improved in the near future. Therefore, we expect that DL could provide cost- and time-effective alternative tools for patient stratification in the era of precision oncology.
참고문헌 (86)
- Chae YK, "Path toward precision oncology : review of targeted therapy studies and tools to aid in defining"actionability"of a molecular lesion and patient management support", Mol Cancer Ther, 16, pp.2645~2655 (2017)
- Murchan P, "Deep learning of histopathological features for the prediction of tumour molecular genetics", Diagnostics(Basel), 11, pp.1406~ (2021)
- Bera K, "Artificial intelligence in digital pathology-new tools for diagnosis and precision oncology", Nat Rev Clin Oncol, 16, pp.703~715 (2019)
- Litjens G, "Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis", Sci Rep, 6, pp.26286~ (2016)
- Costa DB, "Effects of erlotinib in EGFR mutated non-small cell lung cancers with resistance to gefitinib", Clin Cancer Res, 14, pp.7060~7067 (2008)
- Kopetz S, "Randomized trial of irinotecan and cetuximab with or without vemurafenib in BRAF-mutant metastatic colorectal cancer(SWOG S1406)", J Clin Oncol, 39, pp.285~294 (2021)
- Hong DS, "KRASG12C Inhibition with sotorasib in advanced solid tumors", N Engl J Med, 383, pp.1207~1217 (2020)
- Coudray N, "Classification and mutation prediction from nonsmall cell lung cancer histopathology images using deep learning", Nat Med, 24, pp.1559~1567 (2018)
- Tsou P, "Mapping driver mutations to histopathological subtypes in papillary thyroid carcinoma : applying a deep convolutional neural network", J Clin Med, 8, pp.1675~ (2019)
- Chen M, "Classification and mutation prediction based on histopathology H&E images in liver cancer using deep learning", NPJ Precis Oncol, 4, pp.14~ (2020)
- Liu S, "Isocitrate dehydrogenase(IDH)status prediction in histopathology images of gliomas using deep learning", Sci Rep, 10, pp.7733~ (2020)
- Fu Y, "Pan-cancer computational histopathology reveals mutations, tumor composition and prognosis", Nat Cancer, 1, pp.800~810 (2020)
- Kather JN, "Pan-cancer image-based detection of clinically actionable genetic alterations", Nat Cancer, 1, pp.789~799 (2020)
- Jang HJ, "Prediction of clinically actionable genetic alterations from colorectal cancer histopathology images using deep learning", World J Gastroenterol, 26, pp.6207~6223 (2020)
- Noorbakhsh J, "Deep learning-based cross-classifications reveal conserved spatial behaviors within tumor histological images", Nat Commun, 11, pp.6367~ (2020)
- Jang HJ, "Generalizability of deep learning system for the pathologic diagnosis of various cancers", Appl Sci, 11, pp.808~ (2021)
- Yang Y, "Identification and validation of efficacy of immunological therapy for lung cancer from histopathological images based on deep learning", Front Genet, 12, pp.642981~ (2021)
- Loeffler CML, "Artificial intelligence–based detection of FGFR3mutational status directly from routine histology in bladder cancer : a possible preselection for molecular testing?", Eur Urol Focus, 8, pp.472~479 (2022)
- Jang HJ, "Prediction of genetic alterations from gastric cancer histopathology images using a fully automated deep learning approach", World J Gastroenterol, 27, pp.7687~7704 (2021)
- Li K, "Microsatellite instability : a review of what the oncologist should know", Cancer Cell Int, 20, pp.16~ (2020)
- Llosa NJ, "The vigorous immune microenvironment of microsatellite instable colon cancer is balanced by multiple counterinhibitory checkpoints", Cancer Discov, 5, pp.43~51 (2015)
- Eso Y, "Microsatellite instability and immune checkpoint inhibitors : toward precision medicine against gastrointestinal and hepatobiliary cancers", J Gastroenterol, 55, pp.15~26 (2020)
- Popat S, "Systematic review of microsatellite instability and colorectal cancer prognosis", J Clin Oncol, 23, pp.609~618 (2005)
- Kather JN, "Deep learning can predict microsatellite instability directly from histology in gastrointestinal cancer", Nat Med, 25, pp.1054~1056 (2019)
- Cao R, "Development and interpretation of a pathomics-based model for the prediction of microsatellite instability in colorectal cancer", Theranostics, 10, pp.11080~11091 (2020)
- Echle A, "Clinical-grade detection of microsatellite instability in colorectal tumors by deep learning", Gastroenterology, 159, pp.1406~1416 (2020)
- Wang T, "Microsatellite instability prediction of uterine corpus endometrial carcinoma based on H&E histology whole-slide imaging", pp.1289~1292 (2020), IEEE
- Krause J, "Deep learning detects genetic alterations in cancer histology generated by adversarial networks", J Pathol, 254, pp.70~79 (2021)
- Yamashita R, "Deep learning model for the prediction of microsatellite instability in colorectal cancer : a diagnostic study", Lancet Oncol, 22, pp.132~141 (2021)
- Lee SH, "Feasibility of deep learning-based fully automated classification of microsatellite instability in tissue slides of colorectal cancer", Int J Cancer, 149, pp.728~740 (2021)
- Galuppini F, "Tumor mutation burden : from comprehensive mutational screening to the clinic", Cancer Cell Int, 19, pp.209~ (2019)
- Klempner SJ, "Tumor mutational burden as a predictive biomarker for response to immune checkpoint inhibitors : a review of current evidence", Oncologist, 25, pp.e147~e159 (2020)
- Jain MS, "Predicting tumour mutational burden from histopathological images using multiscale deep learning", Nat Mach Intell, 2, pp.356~362 (2020)
- Xu H, "Deep transfer learning approach to predict tumor mutation burden(TMB)and delineate spatial heterogeneity of TMB within tumors from whole slide images", Cold Spring Harbor Lab, 1, pp.554527~ (2020)
- Shimada Y, "Histopathological characteristics and artificial intelligence for predicting tumor mutational burden-high colorectal cancer", J Gastroenterol, 56, pp.547~559 (2021)
- Sadhwani A, "Comparative analysis of machine learning approaches to classify tumor mutation burden in lung adenocarcinoma using histopathology images", Sci Rep, 11, pp.16605~ (2021)
- Dienstmann R, "Consensus molecular subtypes and the evolution of precision medicine in colorectal cancer", Nat Rev Cancer, 17, pp.268~ (2017)
- Cristescu R, "Molecular analysis of gastric cancer identifies subtypes associated with distinct clinical outcomes", Nat Med, 21, pp.449~456 (2015)
- Hu F, "Gene expression classification of lung adenocarcinoma into molecular subtypes", IEEE, 2020, pp.17, 1187~1197
- Chia SK, "A 50-gene intrinsic subtype classifier for prognosis and prediction of benefit from adjuvant tamoxifen", Clin Cancer Res, 18, pp.4465~4472 (2012)
- Couture HD, "Image analysis with deep learning to predict breast cancer grade, ER status, histologic subtype, and intrinsic subtype", NPJ Breast Cancer, 4, pp.30~ (2018)
- Jaber MI, "A deep learning image-based intrinsic molecular subtype classifier of breast tumors reveals tumor heterogeneity that may affect survival", Breast Cancer Res, 22, pp.12~ (2020)
- Hong R, "Predicting endometrial cancer subtypes and molecular features from histopathology images using multi-resolution deep learning models", Cell Rep Med, 2, pp.100400~ (2021)
- Sirinukunwattana K, "Image-based consensus molecular subtype(imCMS)classification of colorectal cancer using deep learning", Gut, 70, pp.544~554 (2021)
- Yu KH, "Classifying non-small cell lung cancer types and transcriptomic subtypes using convolutional neural networks", J Am Med Inform Assoc, 27, pp.757~769 (2020)
- Woerl AC, "Deep learning predicts molecular subtype of muscleinvasive bladder cancer from conventional histopathological slides", Eur Urol, 78, pp.256~264 (2020)
- Reis-Filho JS, "The impact of expression profiling on prognostic and predictive testing in breast cancer", J Clin Pathol, 59, pp.225~231 (2006)
- Nagy Á, "Pancancer survival analysis of cancer hallmark genes", Sci Rep, 11, pp.6047~ (2021)
- El Sayed R, "Endocrine and targeted therapy for hormone-receptorpositive, HER2-negative advanced breast cancer : insights to sequencing treatment and overcoming resistance based on clinical trials", Front Oncol, 9, pp.510~ (2019)
- Guinney J, "The consensus molecular subtypes of colorectal cancer", Nat Med, 21, pp.1350~1356 (2015)
- Lumachi F, "Treatment of estrogen receptor-positive breast cancer", Curr Med Chem, 20, pp.596~604 (2013)
- Nishino M, "Monitoring immune-checkpoint blockade : response evaluation and biomarker development", Nat Rev Clin Oncol, 14, pp.655~668 (2017)
- Sha L, "Multifield-of-view deep learning model predicts nonsmall cell lung cancer programmed death-ligand 1 status from whole-slide hematoxylin and eosin images", J Pathol Inform, 10, pp.24~ (2019)
- Rawat RR, "Deep learned tissue"fingerprints"classify breast cancers by ER", PR, Sci Rep, pp.2020, 10[DOI]
- Naik N, "Deep learning-enabled breast cancer hormonal receptor status determination from base-level H&E stains", Nat Commun, 11, pp.5727~ (2020)
- He B, "Integrating spatial gene expression and breast tumour morphology via deep learning", Nat Biomed Eng, 4, pp.827~834 (2020)
- Schmauch B, "A deep learning model to predict RNA-Seq expression of tumours from whole slide images", Nat Commun, 11, pp.3877~ (2020)
- Levy-Jurgenson A, "Spatial transcriptomics inferred from pathology whole-slide images links tumor heterogeneity to survival in breast and lung cancer", Sci Rep, 10, pp.18802~ (2020)
- Hu J, "Using deep learning to predict anti-PD-1 response in melanoma and lung cancer patients from histopathology images", Transl Oncol, 14, pp.100921~ (2021)
- Johannet P, "Using machine learning algorithms to predict immunotherapy response in patients with advanced melanoma", Clin Cancer Res, 27, pp.131~140 (2021)
- Bychkov D, "Deep learning based tissue analysis predicts outcome in colorectal cancer", Sci Rep, 8, pp.3395~ (2018)
- Mobadersany P, "Predicting cancer outcomes from histology and genomics using convolutional networks", Proc Natl Acad Sci U S A, 115, pp.E2970~E2979 (2018)
- Kather JN, "Predicting survival from colorectal cancer histology slides using deep learning : a retrospective multicenter study", PLoS Med, 16, pp.e1002730~ (2019)
- Courtiol P, "Deep learning-based classification of mesothelioma improves prediction of patient outcome", Nat Med, 25, pp.1519~1525 (2019)
- Skrede OJ, "Deep learning for prediction of colorectal cancer outcome : a discovery and validation study", Lancet, 395, pp.350~360 (2020)
- Kulkarni PM, "Deep learning based on standard H&E images of primary melanoma tumors identifies patients at risk for visceral recurrence and death", Clin Cancer Res, 26, pp.1126~1134 (2020)
- Wulczyn E, "Deep learning-based survival prediction for multiple cancer types using histopathology images", PLoS One, 15, pp.e0233678~ (2020)
- Saillard C, "Predicting survival after hepatocellular carcinoma resection using deep learning on histological slides", Hepatology, 72, pp.2000~2013 (2020)
- Wang X, "Predicting gastric cancer outcome from resected lymph node histopathology images using deep learning", Nat Commun, 12, pp.1637~ (2021)
- Wulczyn E, "Interpretable survival prediction for colorectal cancer using deep learning", NPJ Digit Med, 4, pp.71~ (2021)
- Shim WS, "identifying the prognostic features of early-stage lung adenocarcinoma using multi-scale pathology images and deep convolutional neural networks", Cancers(Basel), 13, pp.3308~ (2021)
- Tizhoosh HR, "Artificial intelligence and digital pathology : challenges and opportunities", J Pathol Inform, 9, pp.38~ (2018)
- Kiani A, "Impact of a deep learning assistant on the histopathologic classification of liver cancer", NPJ Digit Med, 3, pp.23~ (2020)
- Aatresh AA, "LiverNet : efficient and robust deep learning model for automatic diagnosis of sub-types of liver hepatocellular carcinoma cancer from H&E stained liver histopathology images", Int J Comput Assist Radiol Surg, 16, pp.1549~1563 (2021)
- Arjmand A, "Training of deep convolutional neural networks to identify critical liver alterations in histopathology image samples", Appl Sci, 10, pp.42~ (2020)
- Yu Y, "Deep learning enables automated scoring of liver fibrosis stages", Sci Rep, 8, pp.16016~ (2018)
- Sun L, "Deep learning quantification of percent steatosis in donor liver biopsy frozen sections", EBioMedicine, 60, pp.103029~ (2020)
- Zhang Y, "Single-cell RNA sequencing in cancer research", J Exp Clin Cancer Res, 40, pp.81~ (2021)
- Rao A, "Exploring tissue architecture using spatial transcriptomics", Nature, 596, pp.211~220 (2021)
- Chan LK, "Cellular heterogeneity and plasticity in liver cancer", Semin Cancer Biol, 82, pp.134~149 (2022)
- Freidlin B, "Biomarker enrichment strategies : matching trial design to biomarker credentials", Nat Rev Clin Oncol, 11, pp.81~90 (2014)
- Lee J, "Tumor genomic profiling guides patients with metastatic gastric cancer to targeted treatment : the VIKTORY umbrella trial", Cancer Discov, 9, pp.1388~1405 (2019)
- Rudin C, "Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead", Nat Mach Intell, 1, pp.206~215 (2019)
