Activation function

Activation functions are computational functions for neuron computation and interaction. They are functions that engages each neuron cell in active learning of patterns between input data and its corresponding target data. To mention a few, we have sigmoid, rectified linear units (relu), exponential linear unit (elu), tanh etc.