Blog Posts

2021

• Part VI: Handling Parameter Constraints of Exponential Family In Natural-gradient Methods — December 22, 2021
• Part V: Efficient Natural-gradient Methods for Exponential Family — December 14, 2021
• Part IV: Natural Gradient Descent and its Extension---Riemannian Gradient Descent — November 15, 2021
• Part III: Invariance of Natural-Gradients — November 02, 2021
• Part II: Derivation of Natural-gradients — October 04, 2021
• Part I: Smooth Manifolds with the Fisher-Rao Metric — September 06, 2021
• Structured Natural Gradient Descent (ICML 2021) — July 05, 2021