This repository summarizes the basic concepts, types and usage scenarios of activation functions in Deep Learning.
The notes contain the modules outlined below:
|No.| Module| Gist|
|---|---|---|
First of all, I would like to recommend an interesting figure, which depicts various activation functions using comics, as shown below:
