CUDA Tape Operations: Shape and Reduction Nodes

Reductions / views

def Runtime.Autograd.Cuda.Tape.sum {s : Spec.Shape} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Reduce-sum of all entries, producing a scalar.

def Runtime.Autograd.Cuda.Tape.flatten {s : Spec.Shape} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Flatten s into a 1D vector of length Shape.size s.

def Runtime.Autograd.Cuda.Tape.reshape {s₁ s₂ : Spec.Shape} (t : Tape) (xId : ℕ) (_h : s₁.size = s₂.size) : Result (Tape × ℕ)

Reshape a buffer while preserving number of elements.

This is a no-copy view operation: it reuses the same contiguous buffer.

def Runtime.Autograd.Cuda.Tape.transpose2d {m n : ℕ} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Transpose an m × n CUDA buffer and register the matching transpose rule for backpropagation.

def Runtime.Autograd.Cuda.Tape.swapAdjacentAtDepth {s : Spec.Shape} (t : Tape) (depth xId : ℕ) : Result (Tape × ℕ)

Swap adjacent axes at a given depth in an N-D buffer.

If depth is out of range, this is treated as the identity (matches the spec-layer helper).

def Runtime.Autograd.Cuda.Tape.transpose3dFirstToLast {a b c : ℕ} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Permute a 3D tensor (a,b,c) → (b,c,a).

def Runtime.Autograd.Cuda.Tape.transpose3dLastToFirst {a b c : ℕ} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Permute a 3D tensor (a,b,c) → (c,a,b).

def Runtime.Autograd.Cuda.Tape.transpose3dLastTwo {a b c : ℕ} (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Swap the last two axes of a 3D tensor (a,b,c) → (a,c,b).

def Runtime.Autograd.Cuda.Tape.broadcastTo {s₁ s₂ : Spec.Shape} (t : Tape) (cb : s₁.CanBroadcastTo s₂) (xId : ℕ) : Result (Tape × ℕ)

Broadcast x : s₁ to s₂.

Forward: broadcastTo. Backward: sum-reduce broadcasted axes (reduceFromBroadcastTo).

def Runtime.Autograd.Cuda.Tape.reduceSum {s : Spec.Shape} (axis : ℕ) [valid : Spec.Shape.valid_axis_inst axis s] [wf : s.WellFormed] (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Reduce-sum along axis.

def Runtime.Autograd.Cuda.Tape.reduceMean {s : Spec.Shape} (axis : ℕ) [valid : Spec.Shape.valid_axis_inst axis s] [wf : s.WellFormed] (t : Tape) (xId : ℕ) : Result (Tape × ℕ)

Reduce-mean along axis.