Natural-Gradient

• Information Geometry: Statistical Manifolds, the Fisher Information Metric, and Natural Gradient Descent · 2022-07-12

  A rigorous journey through information geometry—the Riemannian geometry of statistical models, the Fisher metric as the unique invariant metric, natural gradient, and the dually flat structure of exponential families.