LSTM Text Example

Runnable torchlean lstm example. It reads a local text corpus, takes a short byte window from the front, and trains an LSTM plus a time-distributed linear head.

The model constructor is exposed as TorchLean.nn.models.LSTMWithLinearHead. The local code names the architecture, builds the text dataset, and trains through the public Trainer surface.

Scope

This is the gated recurrent baseline. It keeps the text window short so the example stays focused on the LSTM cell, the time-distributed head, and the public Trainer API. For generation and longer-context language-model behavior, use one of:

• torchlean chargpt (Karpathy-style, single-file char-level GPT),
• torchlean gpt2 (byte-level GPT-2-style model + save/reload),
• torchlean text_gpt2 (CUDA corpus trainer).

python3 scripts/datasets/download_example_data.py --tiny-shakespeare
lake build -R -K cuda=true && lake exe torchlean lstm --cuda --tiny-shakespeare --steps 1

def NN.Examples.Models.Sequence.Lstm.exeName : String

CLI subcommand name used in terminal banners and error messages.

def NN.Examples.Models.Sequence.Lstm.defaultLogJson : System.FilePath

Default JSON loss-curve path for this command.

def NN.Examples.Models.Sequence.Lstm.seqLen : ℕ

Number of byte-level timesteps in the training window.

def NN.Examples.Models.Sequence.Lstm.inputSize : ℕ

Tiny one-hot token width for the example dataset.

def NN.Examples.Models.Sequence.Lstm.hiddenSize : ℕ

Hidden state width of the LSTM cell.

def NN.Examples.Models.Sequence.Lstm.cfg : TorchLean.nn.models.SeqRnnHeadConfig

Shared shape/config record for the reusable LSTM-with-head constructor.

@[reducible, inline]

abbrev NN.Examples.Models.Sequence.Lstm.σ : Shape

Input shape: one token vector per timestep.

@[reducible, inline]

abbrev NN.Examples.Models.Sequence.Lstm.τ : Shape

Output shape: one prediction row per timestep.

def NN.Examples.Models.Sequence.Lstm.model : TorchLean.nn.M (TorchLean.nn.Sequential σ τ)

LSTM followed by a time-distributed linear output head.

def NN.Examples.Models.Sequence.Lstm.sample (corpus : String) : TorchLean.SupervisedSample Float σ τ

Build one next-token training sample from the loaded corpus prefix.

def NN.Examples.Models.Sequence.Lstm.train (opts : TorchLean.Options) (corpusFlags : RealData.TextCorpusFlags) (flags : TorchLean.ModelZoo.LoggedTrainFlags) : IO Unit

Train the LSTM with the public Trainer surface.

def NN.Examples.Models.Sequence.Lstm.main (args : List String) : IO UInt32

CLI entrypoint for the LSTM text command.