Blog posts

2021

Part III: Invariance of Natural-Gradients

13 minute read

Goal (edited: 01-Jan-23) This blog post focuses on invariant properties of natural-gradients. We will discuss transformation rules of natural-gradients, ...

Part II: Derivation of Natural-gradients

15 minute read

Goal (edited: 01-Jan-23) This blog post focuses on the derivation of natural-gradients, which are known as Riemannian gradients with the Fisher-Rao metric. W...

2020

GD and NGD

1 minute read

%matplotlib inline from jax.config import config; config.update("jax_enable_x64", True) import jax.numpy as jnp from jax import grad, jit, value_and_grad imp...