Hello there! I'm a research scientist at DeepMind, where I work on reinforcement learning and representation learning. In my spare time, I blog about things that interest me and occasionally tweet about papers.


Publications

See my google scholar profile for an up-to-date list of publications.


Talks

I've given a few talks over the years. Most of these weren't recorded, but the slides might still be useful to give a narrative overview of some of the projects I've worked on.


Blog

Warning! This blog is not optimized for mobile devices and contains a lot of long equations that will be a pain to view on your phone. Unless you enjoy suffering, I strongly recommend reading it on large screens only.

A post-rigorous derivation of the Gauss-Newton matrix | Why take a Hessian when a gradient will do?

Paper review: Auditing language models for hidden objectives | What's in an objective?

Can you train a neural network forever? | Understanding trainability in neural networks

Deep dive into the edge of stability | Making loss landscapes trendy again.

Evaluating understanding in LLMs | It's surprisingly hard.

When do adaptive optimizers fail to generalize? | A case study

Do we know why deep learning generalizes yet? | It depends on your epistemology.

The Importance of Making Mistakes in RL | A tale of two NeurIPS papers

How to Win Scholarships and Influence Donors | All of my thoughts on scholarships in one place

Auxiliary tasks in RL | Maybe the real reward was the representation we learned along the way.

Power to the people, but how? | From muffins to marathons

A Bayesian Perspective on Training Speed and Model Selection | As presented at NeurIPS 2020

Why I'm Learning Biology | And why yoou should too

Causality, Generalization, and Reinforcement Learning | Oh my!

In praise of the logarithm | Why are logarithms so magical?

Causality | If causation isn't correlation, then what is it?

What makes the distributional perspective on RL different? | Stuff I did in 2018

Probabilistic Graphical Models | Why I shouldn't quit my PhD to go into the coffee business.

Reflections on my first month in grad school | DPhil life

A semi-coherent summary of set theory pt 2 | Or how set theorists are bad at naming things

A semi-coherent summary of set theory | Or why math really really needs rules

Week 1 in Oxford | I'm in Oxford!

School starts, as do the cool proofs | Infinity is still really cool.

What Work is Worth | Or, how getting grossed out by blood was possibly the most profitable personality trait I ended up with.

First Week at Microsoft | Or how I installed more microsoft products in two days than I had in the last two years.

On Entering the Real World | Or, on getting a job at a big tech company.

A gentle introduction to infinities | Infinity is bigger than you think.

A round-up of my favourite proofs from introductory math courses | I spent a lot of time proving things this year.