Posted on 29th March 2024
Leaky ReLU is an effort to fix the "dying ReLU" difficulty. Rather of the function is zero while x < 0, a leaky ReLU will rather hold a tiny negative slope approximately 0.01.
Improve your knowledge in Keras from scratch using Keras Online Course.
STILL GOT QUERIES?