Sigmoid-weighted linear unit (SiLU)
AISigmoid-weighted linear unit (SiLU): An activation, also called Swish, that multiplies each input by its sigmoid, giving a smooth curve that can output small negative values.
Sigmoid-weighted linear unit (SiLU): An activation, also called Swish, that multiplies each input by its sigmoid, giving a smooth curve that can output small negative values.