[Activation] 4. Swish, Mish, SwiGLU, GEGLU
Swish, Mish, SwiGLU, GEGLU 에 대해 알아보자
Activation
[Activation] 3. ELU, SELU, CELU, GELU, GLU
ELU, SELU, CELU, GELU, GLU 에 대해 알아보자
[Activation] 2. ReLU, Softplus, ReLU6, Leaky ReLU, PReLU, RReLU, Maxout
ReLU, ReLU6, PReLU, Leaky ReLU, Maxout 에 대해 알아보자
[Activation] 1. Activation Function
활성화 함수(Activation Function)와 Sigmoid, Softmax, Tanh 에 대해 알아보자