Gaussian error linear unit (GELU)
AIGaussian error linear unit (GELU): A smooth activation that scales each input by the probability, under a standard normal distribution, that a value falls below it.
Gaussian error linear unit (GELU): A smooth activation that scales each input by the probability, under a standard normal distribution, that a value falls below it.