Module adam

Notice

The module was adapted from the source code of Burn v0.14.0.

Differences between the original module and this adaptation include:

1. Improved accessibility: All structs and properties being public.
2. Greater flexibility and interoperability with other modules.
3. Easier debugging and testing due to public visibility.

License

MIT License

Copyright (c) 2022 Nathaniel Simard & Burn Framework Contributors

Structs

• Adam
  Adam optimizer as described in the paper: “Adam: A Method for Stochastic Optimization”.
• AdamConfig
  Configuration for Adam optimizer.
• AdamState
  State for Adam optimizer.
• AdamStateItem
  The record item type for the module.
• Tensor
  A tensor with a given backend, shape and data type.

Traits

• AutodiffBackend
  Trait that allows a backend to support autodiff.
• Backend
  This trait defines all types and functions needed for a backend to be used with burn.
• Config
  Configuration trait.
• Record
  Trait to define a family of types which can be recorded using any settings.

Type Aliases

• AdamRecord
  Record for Adam optimizer.

Derive Macros

• Config
  Derive macro for the config.
• Record
  Derive macro for the record.