Dr Michael Murray
Lecturer, University of Bath
I am a Lecturer in the Department of Mathematical Sciences and I am interested in using mathematics to better understand and improve deep learning algorithms. In particular, using theory to reconcile modern phenomena with conventional machine learning wisdom, as well as using intuition gained from theory to identify algorithmic innovations to lower training and inference costs. Some broad areas of interest include optimization (e.g., implicit regularization, geometry of the loss landscape), generalization (benign and tempered overfitting, phase transitions in model performance with compute and data) as well as understanding new and emerging systems (e.g., in-context learning, transformers).