|Talks|

Bound by semanticity: universal laws governing the generalization-identification tradeoff

Visiting speaker
Hybrid
Past Talk
Marco Nurisso
PhD Student, Politecnico di Torino
Jul 29, 2025
11:00 am
EST
Jul 29, 2025
11:00 am
In-person
Portsoken Street
London, E1 8PH, UK
The Roux Institute
Room
100 Fore Street
Portland, ME 04101
Network Science Institute
2nd floor
Network Science Institute
11th floor
177 Huntington Ave
Boston, MA 02115
Network Science Institute
2nd floor
Room
58 St Katharine's Way
London E1W 1LP, UK
Register for talk
Register for talk

Talk recording

Intelligent systems must deploy internal representations that are simultaneously structured — to support broad generalization — and selective — to preserve input identity. We expose a fundamental tradeoff between these two properties. By assuming the presence of limits on the agent's capability to compute representational similarities, we derive closed-form expressions that pin the probability of correct generalization and identification to a universal Pareto front independent of input space geometry. Extending the analysis to multiple simultaneous inputs predicts that well-generalizing representations impose hard constraints on the agent's parallel processing capability, echoing known results in cognitive science and artificial intelligence. A minimal ReLU network trained end-to-end reproduces these laws: during learning, a resolution emerges, and empirical trajectories closely follow the theoretical curves. Finally, we show that analogous limits appear in the markedly more complex setting of LLMs and VLMs prompted to perform simple behavioral tasks.

About the speaker
Marco Nurisso is a Ph.D. student in Pure and Applied Mathematics at Politecnico di Torino and member of CENTAI Institute. His research interests lie in the field of applied topology and geometry and their applications to network science, artificial intelligence and cognitive science. His current research focuses on the topology of learning of neural networks and the processing limits induced by representational geometry.
Share this page:
Jul 29, 2025