TorchLean Text Runtime Facade

Tokenizer, corpus, generation, and interactive text options.

def TorchLean.text.InteractiveTrainOptions.parse (exeName : String) (args : List String) (defaultLogJson : System.FilePath) (defaultSteps : ℕ) (defaultLr : Float) (allowZeroSteps : Bool := false) : Except String (InteractiveTrainOptions × List String)

Parse the shared "train + interactive" option surface.

def TorchLean.text.WindowedTrainGenerationOptions.parse (exeName : String) (args : List String) (defaultLogJson : System.FilePath) (defaultSteps : ℕ) (defaultLr : Float) (defaultWindows : ℕ) (genDefaults : GenerationOptions) (allowZeroSteps : Bool := false) : Except String (WindowedTrainGenerationOptions × List String)

Parse the standard "train + generate + windows" option surface.

def TorchLean.text.CheckpointedWindowedTrainGenerationOptions.parse (exeName : String) (args : List String) (defaultLogJson : System.FilePath) (defaultSteps : ℕ) (defaultLr : Float) (defaultWindows : ℕ) (genDefaults : GenerationOptions) (allowZeroSteps : Bool := false) : Except String (CheckpointedWindowedTrainGenerationOptions × List String)

Parse the shared "train + generate + windows + checkpoint" option surface.

def TorchLean.text.BatchedCheckpointedWindowedTrainGenerationOptions.parse (exeName : String) (args : List String) (defaultLogJson : System.FilePath) (defaultSteps : ℕ) (defaultLr : Float) (defaultWindows defaultBatch defaultSeqLen : ℕ) (genDefaults : GenerationOptions) (allowZeroSteps : Bool := false) : Except String (BatchedCheckpointedWindowedTrainGenerationOptions × List String)

Parse the shared "train + generate + windows + checkpoint + batch + seq-len" option surface.

def TorchLean.text.InteractiveCheckpointedWindowedTrainGenerationOptions.parse (exeName : String) (args : List String) (defaultLogJson : System.FilePath) (defaultSteps : ℕ) (defaultLr : Float) (defaultWindows : ℕ) (genDefaults : GenerationOptions) (allowZeroSteps : Bool := false) : Except String (InteractiveCheckpointedWindowedTrainGenerationOptions × List String)

Parse the full "train + generate + windows + checkpoint + interactive" option surface.