Softmax function - Wikipedia

The softmax function, also known as softargmax[1]: 184 or normalized exponential function,[2]: 198 converts a tuple of K real numbers into a probability distribution of K possible outcomes. It is a generalization of the logistic function to multiple dimensions, and is used in multinomial logistic regression. The softmax function is often used as the last activation function of a neural network t

[IanLewis]

The softmax activation function is a neural transfer function. In neural networks, transfer functions calculate a layer's output from its net input. It is a biologically plausible approximation to the maximum operation [1].