[Triumf-seminars] TRIUMF seminar

[TRIUMF Seminars]

Due to unforeseen circumstances, the Early Career Talk by Dr. Anindita Maiti is cancelled today.

Sorry for the inconvenience,
Douglas (on behalf of the Early Career Talks organizing committee)


______________________________

Detailed information available can be found at https://www.triumf.ca/research-program/lectures-conferences/upcoming-seminars-lectures<x-msg://39/'https://www.triumf.ca/research-program/lectures-conferences/upcoming-seminars-lectures'>

Date/Time: Mon Feb 10 2025 at 10:00

Location: Theory Room/Remote

Speaker: Anindita Maiti (Perimeter Institute)

Title: A Wilsonian RG framework for Regression Tasks in Supervised Learning (Early Career Talks)

Abstract: The performance of machine learning (ML) models fundamentally hinges on their ability to discriminate between relevant and irrelevant features in data. We introduce a first-of-its-kind Wilsonian RG framework to analyze the predictions of overparameterized neural networks (NN), which are models characterized by an excess of parameters relative to the complexity of the task. These networks, trained via supervised learning, are known to produce noisy outputs in regression tasks. In our formulation, irrelevant features within the data are systematically coarse-grained through momentum shell RG, inducing an RG flow that governs the evolution of noise in the predictions. When the irrelevant features follow a Gaussian distribution, this RG flow exhibits universality across different NN architectures. In contrast, non-Gaussian features give rise to more intricate, data-dependent RG flows. This approach reveals novel behaviors in NNs that have eluded conventional ML methods. By advancing beyond philosophical analogies between RG and ML, our framework offers a field theory-based methodology for understanding feature learning. This talk is based on the paper https://arxiv.org/abs/2405.06008. Remote access: https://ubc.zoom.us/j/61921073667?pwd=4Drp97meGJ3yq4Ro6k6LaoDncvJXaS.1 Meeting ID: 619 2107 3667 Passcode: 609573 Coffee and cookies available 15min before. BYO mug/cup.

Early Career Talks

______________________________

Detailed information available can be found at https://www.triumf.ca/research-program/lectures-conferences/upcoming-seminars-lectures<x-msg://39/'https://www.triumf.ca/research-program/lectures-conferences/upcoming-seminars-lectures'>

_______________________________________________
Triumf-seminars mailing list
Triumf-seminars at lists.triumf.ca<mailto:Triumf-seminars at lists.triumf.ca>
https://lists.triumf.ca/mailman/listinfo/triumf-seminars

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.triumf.ca/pipermail/triumf-seminars/attachments/20250210/95236ddd/attachment.html>