Swish function

Thus, it can be viewed as a smoothing function which nonlinearly interpolates between a linear function and the ReLU function. ... This function uses non- ...