OD
(Choose 1 answer)
What is weight decay?
A. A regularization technique (such as L2 regularization) that results in gradient descent shrinking the weights on every iteration.
B. Gradual corruption of the weights in the neural network if it is trained in noisy data.
C. The process of gradually decreasing the learning rate during training
D. A technique to avoid vanishing gradient by imposing a ceiling on the values of the weights
Exit 7
