Leaky_Relu in Caffe

Question

I am trying to use the Leaky_Relu layer in caffe and cannot figure out where to define it. From the layer descriptions here , I see that ReLu has an optional parameter called negative_slope that can be used to determine leaky_relu, but I can't figure out where this negative_slope parameter goes into.

The definition of ReLu is as follows:

layer { name: "relu1" type: "ReLU" bottom: "conv1" top: "conv1" } 

I tried to do this, but this generated an error:

 layer { name: "relu1" type: "ReLU" negative_slope: 0.1 bottom: "conv1" top: "conv1" } 

Any help is greatly appreciated.

Thanks!

Answer 1

As indicated in the documentation, the negative_slope parameter is a parameter. And the parameters are defined as follows. Try the following:

 layer { name: "relu1" type: "ReLU" bottom: "conv1" top: "conv1" relu_param{ negative_slope: 0.1 } }