ABI - Advanced Business Intelligence - Tech Blog
Monday, 21 October 2019
ReLU as a Function of Single Infinite Domain
In machine learning, ReLU = max(0,x); this leads to a function with 2 domains:
f = 0 for x<0
f = x for x>=0
However, ReLU can be expressed as a function in infinite domain:
ReLU = f(x) = [ abs(x) + x ] / 2
No comments:
Post a Comment
Newer Post
Older Post
Home
Subscribe to:
Post Comments (Atom)
No comments:
Post a Comment