본문 바로가기
KERD
논문KCI 등재

Deep Learning in Genomic and Medical Image Data Analysis: Challenges and Approaches

2

조회

0

다운로드

3

인용

0

참고문헌

키워드

초록

Artificial intelligence, especially deep learning technology, is penetrating the majority of research areas, including the field of bioinformatics. However, deep learning has some limitations, such as the complexity of parameter tuning, architecture design, and so forth. In this study, we analyze these issues and challenges in regards to its applications in bioinformatics, particularly genomic analysis and medical image analytics, and give the corresponding approaches and solutions. Although these solutions are mostly rule of thumb, they can effectively handle the issues connected to training learning machines. As such, we explore the tendency of deep learning technology by examining several directions, such as automation, scalability, individuality, mobility, integration, and intelligence warehousing.

Abstract

Artificial intelligence, especially deep learning technology, is penetrating the majority of research areas, including the field of bioinformatics. However, deep learning has some limitations, such as the complexity of parameter tuning, architecture design, and so forth. In this study, we analyze these issues and challenges in regards to its applications in bioinformatics, particularly genomic analysis and medical image analytics, and give the corresponding approaches and solutions. Although these solutions are mostly rule of thumb, they can effectively handle the issues connected to training learning machines. As such, we explore the tendency of deep learning technology by examining several directions, such as automation, scalability, individuality, mobility, integration, and intelligence warehousing.

참고문헌 (54)

  1. A. Krizhevsky, "Imagenet classification with deep convolutional neural networks", Advances in Neural Information Processing Systems, 25, pp.1097~1105 (2012)
  2. L. Deng, "Binary coding of speech spectrograms using a deep auto-encoder", Proceedings of 11th annual conference of the International Speech Communication Association (INTERSPEECH2010), pp.1692~1695 (2010)
  3. R. Socher, "Semi-supervised recursive autoencoders for predicting sentiment distributions", Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.151~161 (2001)
  4. Y. Bengio, "Learning deep architectures for AI", Foundations and Trends in Machine Learning, 2(1), pp.1~127 (2009)
  5. Y. Bengio, "Deep learning of representations: looking forward", Proceedings of International Conference on Statistical Language and Speech Processing (SLAP), pp.1~37 (2013)
  6. Y. Bengio, "Representation learning : a review and new perspectives", IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(8), pp.1798~1828 (2013)
  7. Y. LeCun, "Deep learning", Nature, 521(7553), pp.436~444 (2015)
  8. S. Min, "Deep learning in bioinformatics", Briefings in Bioinformatics (2016)[DOI]
  9. G. Hinton, "The wake-sleep algorithm for unsupervised neural networks", Science, 268(5214), pp.1158~1161 (1995)
  10. G. E. Hinton, "Learning multiple layers of representation", Trends in Cognitive Sciences, 11(10), pp.428~434 (2007)
  11. L. Deng, "New types of deep neural network learning for speech recognition and related applications : an overview", Proceedings of 2013 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp.8599~8603 (2013)
  12. P. Di Lena, "Deep architectures for protein contact map prediction", Bioinformatics, 28(19), pp.2449~2457 (2012)
  13. J. Eickholt, "Predicting protein residue-residue contacts using deep networks and boosting", Bioinformatics, 28(23), pp.3066~3072 (2012)
  14. M. K. Leung, "Deep learning of the tissue-regulated splicing code", Bioinformatics, 30(12), pp.i121~i129 (2014)
  15. C. Trapnell, "TopHat : discovering splice junctions with RNA-Seq", Bioinformatics, 25(9), pp.1105~1111 (2009)
  16. M. K. K. Leung, "Machine learning in genomic medicine : a review of computational problems and data sets", Proceedings of the IEEE, 104(1), pp.176~197 (2016)
  17. M. W. Libbrecht, "Machine learning applications in genetics and genomics", Nature Reviews Genetics, 16(6), pp.321~332 (2015)
  18. N. Srivastava, "Dropout : a simple way to prevent neural networks from overfitting", Journal of Machine Learning Research, 15(1), pp.1929~1958 (2014)
  19. S. Ioffe, "Batch normalization: accelerating deep network training by reducing internal covariate shift", Proceedings of the 32nd International Conference on Machine Learning (ICML), pp.448~456 (2015)
  20. X. Glorot, "Understanding the difficulty of training deep feedforward neural networks", Proceedings of the 13th International Conference on Artificial Intelligence and Statistics (AISTATS), pp.249~256 (2010)
  21. K. Cho, "Learning phrase representations using RNN encoder-decoder for statistical machine translation", Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp.1724~1734 (2014)
  22. "Google's neural machine translation system: bridging the gap between human and machine translation" (2016)[URL]
  23. N. Yu, "Signalign : an ontology of DNA as signal for comparative gene structure prediction using information-coding-and-processing techniques", IEEE Transactions on Nanobioscience, 15(2), pp.119~130 (2016)
  24. N. Yu, "DNA AS X: an information-coding-based model to improve the sensitivity in comparative gene analysis", Proceedings of International Symposium on Bioinformatics Research and Applications (ISBRA), pp.366~377 (2015)
  25. I. Cosic, "Macromolecular bioactivity : is it resonant interaction between macromolecules? Theory and applications", IEEE Transactions on Biomedical Engineering, 41(12), pp.1101~1114 (1994)
  26. S. B. Arniker, "DNA numerical representation and neural network based human promoter prediction system", Proceedings of 2011 Annual IEEE India Conference (INDICON), pp.1~4 (2011)
  27. G. Kauer, "Applying signal theory to the analysis of biomolecules", Bioinformatics, 19(16), pp.2016~2021 (2003)
  28. K. Jabbari, "Cytosine methylation and CpG, TpG (CpA) and TpA frequencies", Gene, 333, pp.143~149 (2004)
  29. G. L. Rosen, "Examining coding structure and redundancy in DNA", IEEE Engineering in Medicine and Biology Magazine, 25(1), pp.62~68 (2006)
  30. K. He, "Deep residual learning for image recognition", Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp.770~778 (2016)
  31. D. Mishkin, "All you need is a good init", Proceedings of the International Conference on Learning Representations (ICLR), pp.1~13 (2016)
  32. I. Sutskever, "On the importance of initialization and momentum in deep learning", Proceedings of the International Conference on Machine Learning (ICML), pp.1139~1147 (2013)
  33. H. Larochelle, "Exploring strategies for training deep neural networks", Journal of Machine Learning Research, 10, pp.1~40 (2009)
  34. R. Pascanu, "On the difficulty of training recurrent neural networks", Proceedings of the International Conference on Machine Learning (ICML), pp.1310~1318 (2013)
  35. M. Bianchini, "On the complexity of shallow and deep neural network classifiers", Proceedings of 22nd European Symposium on Artificial Neural Networks (ESANN), pp.371~376 (2014)
  36. "Inception-v4, inception-ResNet and the impact of residual connections on learning" (2016)[URL]
  37. Y. Bengio, "Neural Networks:Tricks of the Trade", pp.437~478 (2012), Springer
  38. J. Bergstra, "Algorithms for hyper-parameter optimization", Advances in Neural Information Processing Systems, 24, pp.2546~2554 (2011)
  39. J. Duchi, "Adaptive subgradient methods for online learning and stochastic optimization", Journal of Machine Learning Research, 12, pp.2121~2159 (2011)
  40. "Adam: a method for stochastic optimization" (2014)[URL]
  41. J. F. G. de Freitas, "Bayesian methods for neural networks", Ph.D, pp.2000
  42. J. Snoek, "Practical Bayesian optimization of machine learning algorithms", Advances in Neural Information Processing Systems, 25, pp.2951~2959 (2012)
  43. F. Hutter, "Learning and Intelligent Optimization", pp.507~523 (2011), Springer
  44. J. Bergstra, "Random search for hyper-parameter optimization", Journal of Machine Learning Research, 13, pp.281~305 (2012)
  45. J. Ngiam, "On optimization methods for deep learning", Proceedings of the 28th International Conference on Machine Learning (ICML), pp.265~272 (2011)
  46. J. Martens, "Deep learning via Hessian-free optimization", Proceedings of the 27th International Conference on Machine Learning (ICML), pp.735~742 (2010)
  47. R. Raina, "Large-scale deep unsupervised learning using graphics processors", Proceedings of the 26th Annual International Conference on Machine Learning (ICML), pp.873~880 (2009)
  48. Q. Ho, "More effective distributed ml via a stale synchronous parallel parameter server", Advances in Neural Information Processing Systems, 26, pp.1223~1231 (2013)
  49. Y. Bengio, "Innovations in Machine Learning", pp.137~186 (2006), Springer
  50. M. Li, "Scaling distributed machine learning with the parameter server", Proceedings of the 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI), pp.583~598 (2014)
  51. J. Dean, "Large scale distributed deep networks", Advances in Neural Information Processing Systems, 25, pp.1223~1231 (2012)
  52. C. Angermueller, "Deep learning for computational biology", Molecular Systems Biology, 12, pp.1~16 (2016)
  53. "DeepSpark: spark-based deep learning supporting asynchronous updates and Caffe compatibility" (2016)[URL]
  54. "Tensorflow: large-scale machine learning on heterogeneous distributed systems" (2016)[URL]

관련 논문AI추천

이 간행물의 다른 논문 (15건)