RNN Text Example

Runnable torchlean rnn example. It reads a local text corpus, takes a short byte window from the front, and trains a vanilla RNN plus a time-distributed linear head.

The model constructor is exposed as TorchLean.nn.models.RNNWithLinearHead. The local code names the architecture, builds the text dataset, and trains through the public Trainer surface.

Scope

This is the plain recurrent baseline. It keeps the text window short so the example stays focused on the recurrent cell, the time-distributed head, and the public Trainer API. For generation and longer contexts, use chargpt, gpt2, or text_gpt2.

python3 scripts/datasets/download_example_data.py --tiny-shakespeare
lake build -R -K cuda=true && lake exe torchlean rnn --cuda --tiny-shakespeare --steps 1

def NN.Examples.Models.Sequence.Rnn.exeName : String

CLI subcommand name used in terminal banners and error messages.

def NN.Examples.Models.Sequence.Rnn.defaultLogJson : System.FilePath

Default JSON loss-curve path for this command.

def NN.Examples.Models.Sequence.Rnn.seqLen : ℕ

Number of byte-level timesteps in the training window.

def NN.Examples.Models.Sequence.Rnn.inputSize : ℕ

Tiny one-hot token width for the example dataset.

def NN.Examples.Models.Sequence.Rnn.hiddenSize : ℕ

Hidden state width of the vanilla recurrent cell.

def NN.Examples.Models.Sequence.Rnn.cfg : TorchLean.nn.models.SeqRnnHeadConfig

Shared shape/config record for the reusable RNN-with-head constructor.

@[reducible, inline]

abbrev NN.Examples.Models.Sequence.Rnn.σ : Shape

Input shape: one token vector per timestep.

@[reducible, inline]

abbrev NN.Examples.Models.Sequence.Rnn.τ : Shape

Output shape: one prediction row per timestep.

def NN.Examples.Models.Sequence.Rnn.model : TorchLean.nn.M (TorchLean.nn.Sequential σ τ)

Vanilla RNN followed by a time-distributed linear output head.

def NN.Examples.Models.Sequence.Rnn.sample (corpus : String) : TorchLean.SupervisedSample Float σ τ

Build one next-token training sample from the loaded corpus prefix.

def NN.Examples.Models.Sequence.Rnn.train (opts : TorchLean.Options) (corpusFlags : RealData.TextCorpusFlags) (flags : TorchLean.ModelZoo.LoggedTrainFlags) : IO Unit

Train the vanilla RNN with the public Trainer surface.

def NN.Examples.Models.Sequence.Rnn.main (args : List String) : IO UInt32

CLI entrypoint for the vanilla RNN text command.