Gradients in a deep neural network and their Python implementations
0
조회
0
다운로드
0
인용
0
참고문헌
키워드
초록
This is an expository article about the gradients in deep neural network. It is hard to find a place where gradients in a deep neural network are dealt in details in a systematic and mathematical way. We review and compute the gradients and Jacobians to derive formulas for gradients which appear in the backpropagation and implement them in vectorized forms in Python.
Abstract
This is an expository article about the gradients in deep neural network. It is hard to find a place where gradients in a deep neural network are dealt in details in a systematic and mathematical way. We review and compute the gradients and Jacobians to derive formulas for gradients which appear in the backpropagation and implement them in vectorized forms in Python.
참고문헌 (5)
- A. G´eron, "Hands-on Machine Learning with Scikit-Learn & TensorFlow(핸즈온 머신러닝)" (2018), Hanbit Media
- "Note on neural network and deep learning"[URL]
- "Verifying gradient formulas by PyTorch"[URL]
- T. Rashid, "Make your own neural network(신경망 첫걸음)" (2017), Hanbit Media
- J. Stewart, "Calculus" (2021), Books-Hill