~/jakub_vrabel

The site is under construction — sorry for the (temporarily) limited information.

I am a postdoctoral researcher at CEITEC with interests in technical AI safety, security, and the science of deep learning. I hold a PhD in applied physics and have worked on interpretable machine learning for spectroscopy as well as foundational aspects of deep learning. I also collaborate with KASL and was previously a visiting Ph.D. student at the University of Cambridge, advised by David Krueger.

My current research focuses on foundational topics in machine learning — loss-landscape geometry, parameter-space symmetries, mode connectivity, and overparameterization — with the broader aim of advancing AI security and safety. I combine empirical and theoretical approaches, often grounded in physics, to better understand deep learning and improve its interpretability and robustness.

When I'm not busy with ML experiments, you can find me bouldering or cycling. I also enjoy hiking, playing guitar, and reading physics books from my vast collection.

News

Research interests

Current projects

Input space mode connectivity

We generalized the concept of loss-landscape mode connectivity to the input space of deep neural networks.

Sparse, interpretable ANNs for spectroscopic data

We study custom loss penalization for MLPs that leads to interpretable and spectroscopically relevant weights in the first layer.

Lottery tickets vs. double descent

A solo project studying intrinsic limitations of lottery-ticket performance as it depends on the initial effective complexity.

Selected past projects

Spectral library transfer between two LIBS systems

We used a composed model (VAE + MLP) to transfer spectra between two distinct instruments.