Monday, 21 October 2019

ReLU as a Function of Single Infinite Domain


In machine learning, ReLU = max(0,x); this leads to a function with 2 domains:
  • f = 0 for x<0
  • f = x for x>=0
However, ReLU can be expressed as a function in infinite domain:

ReLU = f(x) = [ abs(x) + x ] / 2

No comments:

Post a Comment