Module decay

Expand description

Weight decay module for optimizers.

Structsยง

WeightDecay
Weight decay implementation that transforms gradients.
WeightDecayConfig
Configuration to create weight decay.
WeightDecayState
State of weight decay.
WeightDecayStateItem
The record item type for the module.