Indeed. Note that softplus is linear when x is positive though, so that makes all of this easier most of the time (in comparison to exp for instance)
1 Like
Indeed. Note that softplus is linear when x is positive though, so that makes all of this easier most of the time (in comparison to exp for instance)