New workshop paper on Structured second-order methods via natural gradient descent out. Will be presented at the Beyond first-order methods in ML systems Workshop at ICML2021, see the spotlight talk.