Beatmup
Activation functions serialization

In the serialized representation, activation functions are specified with a single keyword.

  • default: identity clipped to 0..1 range
  • brelu6: 0.167 times identity clipped to 0..1 range
  • sigmoid_like: a piecewise-linear sigmoid function approximation