CUDA Tape Operations: Shape and Reduction Nodes

Reductions / views

def Runtime.Autograd.Cuda.Tape.sum {s : Spec.Shape} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Reduce-sum of all entries, producing a scalar.

def Runtime.Autograd.Cuda.Tape.flatten {s : Spec.Shape} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Flatten s into a 1D vector of length Spec.Shape.size s.

def Runtime.Autograd.Cuda.Tape.reshape {s₁ s₂ : Spec.Shape} (t : Tape) (xId : ℕ) (_h : s₁.size = s₂.size) : Result (Tape × ℕ)

Reshape a buffer while preserving number of elements.

This is a no-copy view operation: it reuses the same contiguous buffer.

def Runtime.Autograd.Cuda.Tape.swapAdjacentAtDepth {s : Spec.Shape} (t : Tape) (depth xId : ℕ) : Result (Tape × ℕ)

Swap adjacent axes at a given depth in an N-D buffer.

If depth is out of range, this is treated as the identity (matches the spec-layer helper).

def Runtime.Autograd.Cuda.Tape.broadcastTo {s₁ s₂ : Spec.Shape} (t : Tape) (cb : s₁.CanBroadcastTo s₂) (xId : ℕ) : Result (Tape × ℕ)

Broadcast x : s₁ to s₂.

Forward: broadcastTo. Backward: sum-reduce broadcasted axes (reduceFromBroadcastTo).

def Runtime.Autograd.Cuda.Tape.reduceSum {s : Spec.Shape} (axis : ℕ) [_valid : Spec.Shape.HasNonemptyAxis axis s] [_wf : s.WellFormed] (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Reduce-sum along axis.

def Runtime.Autograd.Cuda.Tape.reduceMean {s : Spec.Shape} (axis : ℕ) [valid : Spec.Shape.HasNonemptyAxis axis s] [_wf : s.WellFormed] (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Reduce-mean along axis.