Module noam

Expand description

Noam learning rate scheduler

Structs§

NoamLrScheduler
Noam learning rate scheduler as described in Attention Is All You Need.
NoamLrSchedulerConfig
Configuration to create a noam learning rate scheduler.