The Rectifier function is the most used in Hidden layers . In the Output layer, the Sigmoid function is most used in if the output has 2 categories; or Softmax if the Output layer has more than 2 categories.
Machine Learning A-Z
Thoughts and flashcards derived from Udemy’s course Machine Learning A-Z.