Network reconstruction for the masses
Complexity Speaker Series
Tiago Peixoto
Associate Professor, Central European University
Past Talk
Hybrid talk
Friday
Apr 12, 2024
Watch video
11:00 am
EST
Virtual
177 Huntington Ave.
11th floor
Devon House
58 St Katharine's Way
London E1W 1LP, UK
Online
Register here
The observed functional behavior of a wide variety of large-scale systems is often the result of a network of pairwise interactions. However, in many cases these interactions are hidden from us, because they are either impossible or very costly to be measured directly. In such situations, we are required to infer the network of interactions from indirect information. Network reconstruction is an important problem with a long history, but most approaches so far proposed suffer from serious limitations, such as poor scalability and statistical inconsistency. In this talk, I present a principled Bayesian framework to perform network reconstruction that lifts two major limitations: 1. It removes a seemingly unavoidable quadratic algorithmic complexity — corresponding to the putative requirement of each possible pairwise coupling being contemplated at least once — in favor of a subquadratic log-linear complexity; 2. We introduce a nonparametric regularization scheme based on weight quantization that does not rely on weight shrinkage to promote sparsity. Our approach follows the minimum description length (MDL) principle, and uncovers the network structure and weight distribution that allows for the most compression of the data, thus avoiding overfitting without requiring time-consuming and suboptimal cross-validation. Taken together both advances yield an overall approach that is not only substantially faster and simpler to employ than the current state of the art, but is also statistically principled and extensible to specialized generative models.
About the speaker
About the speaker
Tiago Peixoto is an Associate Professor in the Department of Network and Data Science at the Central European University (CEU), Vienna, Austria. He received his Habilitation in Theoretical Physics at the University of Bremen in 2017, and his PhD in Physics at the University of São Paulo. Previously, he was an Assistant Professor in Applied Mathematics at the University of Bath (2016-2019), External Researcher at the ISI Foundation (2015-2020), and post-doc researcher at the University of Bremen (2011-2016) and Technical University of Darmstadt (2008-2011). His research group works at the interface between Computational Statistics, Information Theory, Bayesian Inference, Machine Learning, and Statistical Physics, and has as its main focus the methodological foundations of Network Science and the study of Complex Systems. His work was recognized with the Erdős-Rényi Prize from the Network Science Society in 2019. Web page: https://skewed.de/tiago.
Tiago Peixoto is an Associate Professor in the Department of Network and Data Science at the Central European University (CEU), Vienna, Austria. He received his Habilitation in Theoretical Physics at the University of Bremen in 2017, and his PhD in Physics at the University of São Paulo. Previously, he was an Assistant Professor in Applied Mathematics at the University of Bath (2016-2019), External Researcher at the ISI Foundation (2015-2020), and post-doc researcher at the University of Bremen (2011-2016) and Technical University of Darmstadt (2008-2011). His research group works at the interface between Computational Statistics, Information Theory, Bayesian Inference, Machine Learning, and Statistical Physics, and has as its main focus the methodological foundations of Network Science and the study of Complex Systems. His work was recognized with the Erdős-Rényi Prize from the Network Science Society in 2019. Web page: https://skewed.de/tiago.