Can I set the transfer function of a feedforward NN "relu"? If not, how can I apply "relu" to the feedforward NN?

I want to use "relu" in feedforward NN, can I? Can I set the transfer function of a feedforward NN "relu"? If not, how can I apply "relu" to the feedforward NN? Thanks a lot!

Answer 1

[Kyana Shayan]

As far as I know you can set it to

net.layers{1}.transferFcn= 'poslin'

which would give the same result as rectifier function, however, not sure how the non-differentiability at 0 would effect the results.

Hope it helps.