Rectified linear unit (ReLU)
AIRectified linear unit (ReLU): A simple activation that outputs the input if positive and zero otherwise, adding non-linearity while being cheap to compute.
Rectified linear unit (ReLU): A simple activation that outputs the input if positive and zero otherwise, adding non-linearity while being cheap to compute.