ReLU op

[finncatling]

Hi, thanks for your work on this library.

I would like to use a ReLU op within my pymc model. I can't find one within pytensor since the removal of pytensor.tensor.nnet so am currently relying on aesara.tensor.nnet.basic.relu. However, aesara.tensor.nnet is deprecated and I believe will soon be removed.

Are there any plans to add this functionality back to pytensor, please? Thanks again.

[ricardoV94]

You can create a relu with pytensor.tensor.switch:

import pytensor.tensor as pt

def relu(x):
  return pt.switch(pt.lt(x, 0), 0, x)

No need for a custom Op

[finncatling]

Many thanks!