Publications

My thesis

Generalization Through the Lens of Learning Dynamics. (arXiv link)

2023

Understanding plasticity in neural networks. Clare Lyle, Zeyu Zheng, Evgenii Nikishin, Bernardo Avila Pires, Razvan Pascanu, Will Dabney. ICML 2023 (Oral). (arxiv)

Quantile Credit Assignment. Thomas Mesnard, Wenqi Chen, Alaa Saade, Yunhao Tang, Mark Rowland, Theophane Weber, Clare Lyle, Audrunas Gruslys, Michal Valko, Will Dabney, Georg Ostrovski, Eric Moulines, Remi Munos. ICML 2023 (Oral)

DiscoBAX Discovery of optimal intervention sets in genomic experiment design. Clare Lyle, Arash Mehrjou, Pascal Notin, Andrew Jesson, Stefan Bauer, Yarin Gal, Patrick Schwab. ICML 2023

Understanding self-predictive learning for reinforcement learning Yunhao Tang, Zhaohan Daniel Guo, Pierre Harvey Richemond, Bernardo Avila Pires, Yash Chandak, Rémi Munos, Mark Rowland, Mohammad Gheshlaghi Azar, Charline Le Lan, Clare Lyle, András György, Shantanu Thakoor, Will Dabney, Bilal Piot, Daniele Calandriello, Michal Valko. ICML 2023

The Statistical Benefits of Quantile Temporal-Difference Learning for Value Estimation Mark Rowland, Yunhao Tang, Clare Lyle, Rémi Munos, Marc G Bellemare, Will Dabney. ICML 2023 (arxiv version)

Deep Reinforcement Learning with Plasticity Injection. Evgenii Nikishin, Junhyuk Oh, Georg Ostrovski, Clare Lyle, Razvan Pascanu, Will Dabney, André Barreto. NeurIPS 2023. (arxiv)

2022

Learning Dynamics and Generalization in Reinforcement Learning. Clare Lyle, Mark Rowland, Will Dabney, Marta Kwiatkowska, Yarin Gal. ICML 2022, RLDM Spotlight. (arXiv link).

Understanding and Preventing Capacity Loss in Reinforcement Learning Clare Lyle, Mark Rowland, Will Dabney. ICLR 2022 (arXiv link).

2021

Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning. Jannik Kossen, Neil Band, Clare Lyle, Aidan N. Gomez, Tom Rainforth, and Yarin Gal. NeurIPS 2021. (arXiv link).

Revisiting the train loss: an efficient performance estimator for neural architecture search. Binxin Ru*, Clare Lyle*, Lisa Schut, Mark van der Wilk, and Yarin Gal. NeurIPS 2021. (arXiv link).

Provable Guarantees on the Robustness of Decision Rules to Causal Interventions Benjie Wang*, Clare Lyle*, Marta Kwiatkowska. IJCAI 2021. (arXiv link).

PsiPhi-Learning: Reinforcement Learning with Demonstrations using Successor Features and Inverse Temporal Difference Learning Angelos Filos, Clare Lyle, Yarin Gal, Sergey Levine, Natasha Jaques, Gregory Farquhar. ICML 2021. (arXiv link).

On The Effect of Auxiliary Tasks on Representation Dynamics Clare Lyle*, Mark Rowland*, Georg Ostrovski, Will Dabney, AISTATS 2021. (arXiv link).

2020

A Bayesian Perspective on Training Speed and Model Selection Clare Lyle, Lisa Schut, Binxin Ru, Yarin Gal, Mark van der Wilk, NeurIPS 2020. (arXiv link).

Invariant Causal Prediction for Block MDPs Amy Zhang*, Clare Lyle*, Shagun Sodhani, Angelos Filos, Marta Kwiatkowska, Joelle Pineau, Yarin Gal, Doina Precup, ICML 2020. (arXiv link).

An Analysis of the Effect of Invariance on Generalization in Neural Networks. Clare Lyle, Marta Kwiatkowska, Yarin Gal, 2019. ICML 2019 Workshop on Understanding and Improving Generalization in Deep Learning. [paper]

A Geometric Perspective on Optimal Representations in Reinforcement Learning. Marc G. Bellemare, Will Dabney, Robert Dadashi, Adrien Ali Taiga, Pablo Samuel Castro, Nicolas Le Roux, Dale Schuurmans, Tor Lattimore, Clare Lyle, 2019. [arXiv]

2019

A Comparative Analysis of Expected and Distributional Reinforcement Learning. Clare Lyle, Pablo Samuel Castro, Marc G. Bellemare. Proceedings of the Thirty-First AAAI Conference, 2019. [arXiv]

2018

The Malicious Use of Artificial Intelligence: Forecasting, Prevention, and Mitigation Miles Brundage, Shahar Avin, Jack Clark, Helen Toner, Peter Eckersley, Ben Garfinkel, Allan Dafoe, Paul Scharre, Thomas Zeitzoff, Bobby Filar, Hyrum Anderson, Heather Roff, Gregory C Allen, Jacob Steinhardt, Carrick Flynn, Seán Ó hÉigeartaigh, Simon Beard, Haydn Belfield, Sebastian Farquhar, Clare Lyle, Rebecca Crootof, Owain Evans, Michael Page, Joanna Bryson, Roman Yampolskiy, Dario Amodei. Technical Report.

Preprints and Workshop Papers

Resolving Causal Confusion in Reinforcement Learning via Robust Exploration . Clare Lyle, Amy Zhang, Minqi Jiang, Joelle Pineau, Yarin Gal. ICLR Self-Supervised RL Workshop 2021. (openreview link)

Unpacking Information Bottlenecks: Unifying Information-Theoretic Objectives in Deep Learning. Andreas Kirsch, Clare Lyle, Yarin Gal. ICML Uncertainty in Deep Learning Workshop 2020. (arXiv link)

On the Benefits of Invariance in Neural Networks. Clare Lyle, Mark van der Wilk, Marta Kwiatkowska, Yarin Gal, Benjamin Bloem-Reddy, NeurIPS Workshop on Machine Learning with Guarantees, 2019. (arXiv link)

GAN Q-learning. Thang Doan, Bogdan Mazoure, Clare Lyle (arXiv link)