RL Example Artifacts

This umbrella collects the editor-side RL artifact viewers.

The executable trainers live under NN.Examples.Models because they are runnable model/training examples:

• lake -R -K cuda=true exe torchlean ppo_gridworld --device cuda --updates 1 --eval-every 1 --eval-episodes 1 --eval-max-steps 8
• lake -R -K cuda=true exe torchlean ppo_cartpole --device cuda --updates 1 --eval-every 1 --eval-episodes 1 --eval-max-steps 8
• lake exe torchlean dqn_replay

The files under NN/Examples/RL are the companion layer: widget viewers, Python Gymnasium boundary helpers, and rollout exporters. Keeping that split prevents the example tree from having two competing PPO implementations while still making RL artifacts easy to inspect.

The Pong RAM files are kept as an optional ALE/Gymnasium boundary example. They are not advertised as part of the default runner quick-check list because they depend on a compatible external ale-py / gymnasium installation.