上QQ阅读APP看书,第一时间看更新
Linear activation units
A linear activation unit outputs the total input to the neuron that is attenuated, as shown in the following graph:
Figure 1.5: Linear neuron
If x is the total input to the linear activation unit, then the output, y, can be represented as follows: