NF Elementwise Bounds: Unary Operations #
approxT bound for scaling by a runtime constant (scale_spec) over arbitrary tensor shapes.
This is the tensor-level wrapper around the scalar scaling lemma approx_scale_nf.
approxT bound for elementwise negation (neg_spec) over arbitrary tensor shapes.
approxT bound for elementwise absolute value (abs_spec) over arbitrary tensor shapes.
approxT bound for elementwise exponentiation (exp_spec) over arbitrary tensor shapes.
This lifts the scalar mean-value-theorem bound approx_exp_nf.
approxT bound for elementwise hyperbolic tangent (tanh) over arbitrary tensor shapes.
Currently uses the coarse unconditional scalar bound approx_tanh_nf (boundedness of tanh).
Rounded ReLU scalar op for NF: apply max · 0 then round.
Instances For
Per-entry bound tensor for ReLU (max · 0).
ReLU is 1-Lipschitz (|max x 0 - max y 0| ≤ |x - y|), so the only new error is the final rounding
step in reluR.
Instances For
approxT bound for elementwise ReLU (max · 0) over arbitrary tensor shapes.
Combines the 1-Lipschitz property of max with one rounding step for reluR.