Mean-reduction adjoint #
Mean reduction and its reverse map are adjoint for every finite coordinate map whose fibers are nonempty.
The reverse map for mean reduction divides each output cotangent by the cardinality of the input fiber to which it is broadcast.
The definition is geometric: it depends only on the coordinate map and not on the primal tensor. Nonemptiness and characteristic zero are needed by the forward mean and its adjoint theorem, not to evaluate this map.
Instances For
Mean reduction and meanReduceVjp are adjoint under the finite tensor
pairing.
This is a theorem for every finite coordinate map, not only maps produced by einops. The positive-cardinality premise rules out empty means. The proof partitions the input pairing into the same fibers used by the forward reduction and does not assume commutative multiplication.