Workshop
Workshop on Agent Learning in Open-Endedness
Minqi Jiang · Jack Parker-Holder · Michael D Dennis · Mikayel Samvelyan · Roberta Raileanu · Jakob Foerster · Edward Grefenstette · Tim Rocktaeschel
Fri 29 Apr, 1:45 a.m. PDT
Open-ended learning processes that co-evolve agents and their environments resulted in human intelligence, but producing such a system, which generates endless, meaningful novelty, remains an open problem in AI research. We hope our workshop provides a forum both for bridging knowledge across a diverse set of relevant fields as well as sparking new insights that can enable agent learning in open-endedness.
Chat is not available.
Timezone: America/Los_Angeles
Schedule
Fri 1:45 a.m. - 2:00 a.m.
|
Introductory Remarks ( Introduction ) > link | Minqi Jiang 🔗 |
Fri 2:00 a.m. - 2:30 a.m.
|
Open-Ended Learning Leads to Generally Capable Agents
(
Invited Talk
)
>
SlidesLive Video |
Wojciech M Czarnecki 🔗 |
Fri 2:30 a.m. - 3:00 a.m.
|
Environments and Representations for Open-Ended Discovery ( Invited Talk ) > link | Sebastian Risi 🔗 |
Fri 3:00 a.m. - 3:15 a.m.
|
Walk the Random Walk: Learning to Discover and Reach Goals Without Supervision ( Spotlight, Poster ) > link | Lina Mezghani · Piotr Bojanowski · Karteek Alahari · Sainbayar Sukhbaatar 🔗 |
Fri 3:15 a.m. - 3:30 a.m.
|
Towards Evaluating Adaptivity of Model-Based Reinforcement Learning
(
Spotlight, Poster
)
>
link
SlidesLive Video |
Yi Wan · Ali Rahimi-Kalahroudi · Janarthanan Rajendran · Ida Momennejad · Sarath Chandar · Harm van Seijen 🔗 |
Fri 3:30 a.m. - 3:45 a.m.
|
Don't Freeze Your Embedding: Lessons from Policy Finetuning in Environment Transfer
(
Spotlight, Poster
)
>
link
SlidesLive Video |
Victoria Dean · Daniel Toyama · Doina Precup 🔗 |
Fri 3:45 a.m. - 4:45 a.m.
|
Virtual Poster Session #1 ( Poster Session ) > link | 🔗 |
Fri 4:45 a.m. - 5:30 a.m.
|
Lunch Break and Discussions link | 🔗 |
Fri 5:30 a.m. - 6:00 a.m.
|
Using Quality-Diversity to Co-Learn Generators that Illuminate the Space of Agent Abilities ( Invited Talk ) > link | Sam Earle 🔗 |
Fri 6:00 a.m. - 6:30 a.m.
|
General Infomax Agents through World Models
(
Invited Talk
)
>
SlidesLive Video |
Danijar Hafner 🔗 |
Fri 6:30 a.m. - 7:00 a.m.
|
Virtual Coffee Break link | 🔗 |
Fri 7:00 a.m. - 8:00 a.m.
|
Live Panel Discussion #1 ( Discussion Panel ) > link | 🔗 |
Fri 8:00 a.m. - 8:15 a.m.
|
Virtual Coffee Break link | 🔗 |
Fri 8:15 a.m. - 8:30 a.m.
|
Accelerated Quality-Diversity for Robotics through Massive Parallelism
(
Spotlight, Poster
)
>
link
SlidesLive Video |
Bryan Lim · Maxime Allard · Luca Grillotti · Antoine Cully 🔗 |
Fri 8:30 a.m. - 8:45 a.m.
|
DSA-ME: Deep Surrogate Assisted MAP-Elites
(
Spotlight, Poster
)
>
link
SlidesLive Video |
Yulun Zhang · Matthew Fontaine · Amy Hoover · Stefanos Nikolaidis 🔗 |
Fri 8:45 a.m. - 9:00 a.m.
|
Differentiable Quality Diversity for Reinforcement Learning by Approximating Gradients
(
Spotlight, Poster
)
>
link
SlidesLive Video |
Bryon Tjanaka · Matthew Fontaine · Julian Togelius · Stefanos Nikolaidis 🔗 |
Fri 9:00 a.m. - 9:30 a.m.
|
Beyond Agents and Environments? ( Invited Talk ) > link | Julian Togelius 🔗 |
Fri 9:30 a.m. - 10:00 a.m.
|
Emergent Complexity and Zero-Shot Transfer with PAIRED ( Invited Talk ) > link | Natasha Jaques 🔗 |
Fri 10:00 a.m. - 10:15 a.m.
|
Virtual Coffee Break link | 🔗 |
Fri 10:15 a.m. - 10:45 a.m.
|
Open Questions in Creating Safe Open-Ended AI: Tensions Between Control and Creativity ( Invited Talk ) > link | Joel Lehman 🔗 |
Fri 10:45 a.m. - 11:15 a.m.
|
Why Open-Endedness Matters to Machine Learning
(
Invited Talk
)
>
SlidesLive Video |
Kenneth Stanley 🔗 |
Fri 11:15 a.m. - 12:15 p.m.
|
Live Panel Discussion #2 ( Discussion Panel ) > link | 🔗 |
Fri 12:15 p.m. - 12:25 p.m.
|
Closing Remarks ( Conclusion ) > link | 🔗 |
Fri 12:25 p.m. - 1:15 p.m.
|
Virtual Poster Session #2 ( Poster Session ) > link | 🔗 |
-
|
Meta-World Conditional Neural Processes
(
Poster
)
>
link
SlidesLive Video |
Suzan Ece Ada · Emre Ugur 🔗 |
-
|
A little taxonomy of open-endedness ( Poster ) > link | Asiiah Song 🔗 |
-
|
Dojo: A Large Scale Benchmark for Multi-Task Reinforcement Learning ( Poster ) > link | Dominik Schmidt 🔗 |
-
|
Streaming Inference for Infinite Non-Stationary Clustering ( Poster ) > link | Rylan Schaeffer · Gabrielle Liu · Yilun Du · Scott Linderman · Ila Fiete 🔗 |
-
|
Ensemble Learning as a Peer Process
(
Poster
)
>
link
SlidesLive Video |
Ehsan Beikihassan · Ali Parviz · Amy Hoover · Ioannis Koutis 🔗 |
-
|
Watts: Infrastructure for Open-Ended Learning ( Poster ) > link | Aaron Dharna · Charlie Summers · Rohin Dasari · Julian Togelius · Amy Hoover 🔗 |
-
|
Generalization Games for Reinforcement Learning ( Poster ) > link | Manfred Diaz · Charlie Gauthier · Glen Berseth · Liam Paull 🔗 |
-
|
A Study of Off-Policy Learning in Environments with Procedural Content Generation ( Poster ) > link | Andrew Ehrenberg · Robert Kirk · Minqi Jiang · Edward Grefenstette · Tim Rocktaeschel 🔗 |
-
|
SkillHack: A Benchmark for Skill Transfer in Open-Ended Reinforcement Learning ( Poster ) > link | Michael Matthews · Mikayel Samvelyan · Jack Parker-Holder · Edward Grefenstette · Tim Rocktaeschel 🔗 |
-
|
Meta-Gradients in Non-Stationary Environments
(
Poster
)
>
link
SlidesLive Video |
Jelena Luketina · Sebastian Flennerhag · Yannick Schroecker · David Abel · Tom Zahavy 🔗 |
-
|
Bayesian Generational Population-Based Training ( Poster ) > link | Xingchen Wan · Cong Lu · Jack Parker-Holder · Philip Ball · Vu Nguyen · Binxin Ru · Michael Osborne 🔗 |
-
|
Open-Ended Reinforcement Learning with Neural Reward Functions
(
Poster
)
>
link
SlidesLive Video |
Robert Meier · Asier Mujika 🔗 |
-
|
Diversity Policy Gradient for Sample Efficient Quality-Diversity Optimization ( Poster ) > link | Thomas PIERROT · Valentin MacĂ© · Felix Chalumeau · Arthur Flajolet · Geoffrey Cideron · Karim Beguir · Antoine Cully · Olivier Sigaud · Nicolas Perrin-Gilbert 🔗 |
-
|
Discovering Unsupervised Behaviours from Full State Trajectories
(
Poster
)
>
link
SlidesLive Video |
Luca Grillotti · Antoine Cully 🔗 |
-
|
Specialization and Exchange in Neural MMO ( Poster ) > link | Joseph Suarez · Phillip Isola 🔗 |
-
|
Subjective Learning for Conflicting Data
(
Poster
)
>
link
SlidesLive Video |
Tianren Zhang · Yizhou Jiang · Xin Su · Shangqi Guo · Chongkai Gao · Feng Chen 🔗 |
-
|
Zero-Shot Reward Specification via Grounded Natural Language ( Poster ) > link | Parsa Mahmoudieh · Deepak Pathak · trevor darrell 🔗 |
-
|
Learning Object-Centered Autotelic Behaviors with Graph Neural Networks
(
Poster
)
>
link
SlidesLive Video |
Ahmed Akakzia · Olivier Sigaud 🔗 |
-
|
Learning to Walk Autonomously via Reset-Free Quality-Diversity
(
Poster
)
>
link
SlidesLive Video |
Bryan Lim · Alexander Reichenbach · Antoine Cully 🔗 |
-
|
Agent, do you see it now? systematic generalisation in deep reinforcement learning
(
Poster
)
>
link
SlidesLive Video |
Borja G. Leon · Murray Shanahan · Francesco Belardinelli 🔗 |
-
|
Mixture-of-Variational-Experts for Continual Learning ( Poster ) > link | Heinke Hihn · Daniel Braun 🔗 |
-
|
Backdoors Stuck At The Frontdoor: Multi-Agent Backdoor Attacks That Backfire ( Poster ) > link | Siddhartha Datta · Nigel Shadbolt 🔗 |
-
|
When to Go, and When to Explore: The Benefit of Post-Exploration in Intrinsic Motivation
(
Poster
)
>
link
SlidesLive Video |
Zhao Yang · Thomas Moerland · Mike Preuss · Aske Plaat 🔗 |
-
|
On Credit Assignment in Hierarchical Reinforcement Learning ( Poster ) > link | joery de Vries · Thomas Moerland · Aske Plaat 🔗 |
-
|
Neuroevolution of Recurrent Architectures on Control Tasks
(
Poster
)
>
link
SlidesLive Video |
Maximilien Le Clei · Pierre Bellec 🔗 |
-
|
Model-Value Inconsistency as a Signal for Epistemic Uncertainty ( Poster ) > link | Angelos Filos · Eszter Vertes · Zita Marinho · Gregory Farquhar · Diana Borsa · Abram Friesen · Feryal Behbahani · Tom Schaul · Andre Barreto · Simon Osindero 🔗 |
-
|
An Empirical Investigation of Mutual Information Skill Learning
(
Poster
)
>
link
SlidesLive Video |
Faisal Mohamed · Benjamin Eysenbach · Ruslan Salakhutdinov 🔗 |