Workshop
GroundedML: Anchoring Machine Learning in Classical Algorithmic Theory
Perouz Taslakian · Pierre-André Noël · David Vazquez · Jian Tang · Xavier Bresson
Fri 29 Apr, 5:45 a.m. PDT
Recent advances in Machine Learning (ML) have revolutionized our ability to solve complex problems in a myriad of application domains. Yet, just as empirical data plays a fundamental role in the development of such applications, the process of designing these methods has also remained empirical: we have learned which of the known methods tend to perform better for certain types of problems, and have developed intuition guiding our discovery of new methods.
In contrast, classical algorithmic theory provides tools directly addressing the mathematical core of a problem, and clear theoretical justifications motivate powerful design techniques. At the heart of this process is the analysis of the correctness and time/space efficiency of an algorithm, providing actionable bounds and guarantees. Problems themselves may be characterized by bounding the performance of any algorithm, providing a meaningful reference point to which concrete algorithms may be compared. While ML models may appear to be an awkward fit for such techniques, some research in the area has succeeded in obtaining results with the “definitive” flavour associated with algorithms, complementary to empirical ones. Are such discoveries bound to be exceptions, or can they be part of a new algorithmic theory?
The GoundedML workshop seeks to bring together researchers from both the algorithmic theory and machine learning communities, starting a dialogue on how ideas from theoretical algorithm design can inspire and guide future research in machine learning.
Schedule
Fri 5:45 a.m. - 6:00 a.m.
|
Opening Remarks
(
Remarks
)
>
|
Perouz Taslakian · Pierre-André Noël · David Vazquez · Jian Tang · Xavier Bresson 🔗 |
Fri 6:00 a.m. - 6:45 a.m.
|
Learning Algorithmic Tasks with Graph Neural Networks: Generalization and Extrapolation
(
Invited Talk
)
>
SlidesLive Video |
Stefanie Jegelka 🔗 |
Fri 6:45 a.m. - 7:30 a.m.
|
Enabling Empirically and Theoretically Sound Algorithmic Alignment
(
Invited Talk
)
>
SlidesLive Video |
Petar Veličković 🔗 |
Fri 7:30 a.m. - 7:40 a.m.
|
Coffee Break
|
🔗 |
Fri 7:40 a.m. - 8:25 a.m.
|
Local Signal Adaptivity: Feature learning in Neural networks beyond kernels
(
Invited Talk
)
>
|
Aarti Singh 🔗 |
Fri 8:25 a.m. - 8:35 a.m.
|
Graph Attention Retrospective
(
Contributed Talk
)
>
SlidesLive Video |
Kimon Fountoulakis · Amit Levi · Shenghao Yang · Aseem Baranwal · Aukosh Jagannath 🔗 |
Fri 8:35 a.m. - 8:45 a.m.
|
The CLRS Algorithmic Reasoning Benchmark
(
Contributed Talk
)
>
SlidesLive Video |
Petar Veličković · Adria Puigdomenech Badia · David Budden · Razvan Pascanu · Andrea Banino · Misha Dashevskiy · Raia Hadsell · Charles Blundell 🔗 |
Fri 8:45 a.m. - 9:15 a.m.
|
Poster Session (through GatherTown) ( Poster Session ) > link | 🔗 |
Fri 9:15 a.m. - 9:50 a.m.
|
Lunch Break
|
🔗 |
Fri 9:50 a.m. - 10:20 a.m.
|
Panel/Q&A for Morning Invited Talks
(
Panel/Q&A
)
>
|
Stefanie Jegelka · Petar Veličković · Aarti Singh · Perouz Taslakian · Pierre-André Noël · David Vazquez · Jian Tang · Xavier Bresson 🔗 |
Fri 10:20 a.m. - 11:05 a.m.
|
Deep learning theory vs traditional theory of algorithms
(
Invited Talk (live)
)
>
|
Sanjeev Arora 🔗 |
Fri 11:05 a.m. - 11:50 a.m.
|
Optimization Algorithms in the Large: Exact Dynamics, Average-case Analysis, and Stepsize Criticality
(
Invited Talk
)
>
SlidesLive Video |
Courtney Paquette 🔗 |
Fri 11:50 a.m. - 12:00 p.m.
|
Coffee Break
|
🔗 |
Fri 12:00 p.m. - 12:45 p.m.
|
Continuous cutting plane algorithms in integer programming
(
Invited Talk
)
>
SlidesLive Video |
Andrea Lodi 🔗 |
Fri 12:45 p.m. - 1:30 p.m.
|
Distribution-dependent generalization bounds for noisy, iterative learning algorithms
(
Invited Talk
)
>
|
Gintare Dziugaite 🔗 |
Fri 1:30 p.m. - 1:40 p.m.
|
Coffee Break
|
🔗 |
Fri 1:40 p.m. - 2:10 p.m.
|
Panel/Q&A for Afternoon Invited Talks
(
Panel/Q&A
)
>
|
Sanjeev Arora · Courtney Paquette · Gintare Dziugaite · Andrea Lodi · Perouz Taslakian · Pierre-André Noël · David Vazquez · Jian Tang · Xavier Bresson 🔗 |
Fri 2:10 p.m. - 2:30 p.m.
|
Prizes and Closing Remarks
(
Remarks
)
>
|
Perouz Taslakian · Pierre-André Noël · David Vazquez · Jian Tang · Xavier Bresson 🔗 |
-
|
Dual Conservative Policy Update for Efficient Model-Based Reinforcement Learning ( Poster (GatherTown) ) > link | Shenao Zhang 🔗 |
-
|
K-level SLOPE: Simplified and Adaptive Variable Selection for Optimization of Estimation Risk ( Poster (GatherTown) ) > link | Zhiqi Bu · Rachel Wu 🔗 |
-
|
Graph Attention Retrospective ( Poster (GatherTown) ) > link | Kimon Fountoulakis · Amit Levi · Shenghao Yang · Aseem Baranwal · Aukosh Jagannath 🔗 |
-
|
Learning heuristics for A* ( Poster (GatherTown) ) > link | Danilo Numeroso · Davide Bacciu · Petar Veličković 🔗 |
-
|
Meta Mirror Descent: Optimiser Learning for Fast Convergence ( Poster (GatherTown) ) > link | Boyan Gao · Henry Gouk · Hae Beom Lee · Timothy Hospedales 🔗 |
-
|
Graph Neural Networks are Dynamic Programmers ( Poster (GatherTown) ) > link | Andrew Dudzik · Petar Veličković 🔗 |
-
|
The CLRS Algorithmic Reasoning Benchmark ( Poster (GatherTown) ) > link | Petar Veličković · Adria Puigdomenech Badia · David Budden · Razvan Pascanu · Andrea Banino · Misha Dashevskiy · Raia Hadsell · Charles Blundell 🔗 |
-
|
Continuous Neural Algorithmic Planners ( Poster (GatherTown) ) > link | Yu He · Petar Veličković · Pietro Lio · Andreea Deac 🔗 |