TorchLean API

NN.Spec.RL

Spec reinforcement learning #

Umbrella import for RL environments and MDP specifications.

The files here keep transition systems, rewards, and policy-facing environment contracts separate from runtime training code, so RL examples can be checked against a small pure semantics.

Folder map:

Deterministic finite MDPs live in Spec.RL, finite stochastic MDPs in Spec.RL.FiniteStochastic, and measurable-space MDPs in Spec.RL.Markov. Each namespace supplies the definitions its representation needs. Keeping these layers separate avoids forcing every RL development into the heaviest probability-theory abstraction.