TorchLean API

NN.Proofs.Analysis.Dropout

Dropout analysis properties #

TorchLean splits stochastic training-mode dropout into two pieces:

This file records the spec-level identity for the deterministic inference map. The fixed-mask training-mode derivative infrastructure lives with the autograd tape-node proofs.

Reference: Srivastava et al., 2014, “Dropout: A Simple Way to Prevent Neural Networks from Overfitting”.

Evaluation-mode dropout is the identity for every configured training probability.