RL Example Artifacts

This umbrella collects the editor-side RL artifact viewers.

The executable trainers live under NN.Examples.Models because they are runnable model/training examples:

• lake exe -K cuda=true torchlean ppo_gridworld --cuda --updates 1 --eval-every 1 --eval-episodes 1 --eval-max-steps 8
• lake exe -K cuda=true torchlean ppo_cartpole --cuda --updates 1 --eval-every 1 --eval-episodes 1 --eval-max-steps 8
• lake exe torchlean dqn_replay

The files under NN/Examples/RL are the companion layer: widget viewers, Python Gymnasium boundary helpers, and rollout exporters. Keeping that split prevents the example tree from having two competing PPO implementations while still making RL artifacts easy to inspect.

The Pong RAM files are kept as an optional ALE/Gymnasium boundary example. They are not advertised as part of the default runner quick-check list because they depend on a compatible external ale-py / gymnasium installation.