silu

std.elementwise.silu · Level L0

SiLU (also called swish): x times its own sigmoid.

x·σ(x)

Signature

silu(x: f64[n]) → f64[n]

Structure

The function as NOVA stores it: one box per input, operation and output, and arrows that carry values. A double border marks a call to another library function; select it to open that function.

xf64[n]SigmoidgateMultiplyyyf64[n]
  • input
  • operation
  • constant
  • call
  • output

Verification

  • Signature proven by NOVA’s shape solver, for every size.
  • Agrees with the reference x / (1 + np.exp(-x)) to 80 digits (100-digit arithmetic), on all 40 test cases.
  • All 162 float64 results inside the running error bound; the closest uses 17% of it.
  • Interpreter and NumPy backend return bit-identical results.
Accuracy in detail
correctly rounded (the float64 nearest the exact value)
59%
bit-equal to the NumPy formula in float64
83%
largest error, in units in the last place
1.72

Identity

Calls
—
Called by
—
sha256:a4869515e283f2a1932bee4529de2e531e46a04e17f20bc21fbca8d036e4b112

The semantic hash of the graph. It changes when the program changes, and never when only its documentation does.