1

Adversarial Soft Advantage Fitting: Imitation Learning without Policy Optimization
Adversarial Imitation Learning alternates between learning a discriminator – which tells apart expert’s demonstrations from …
An empirical study of loss landscape geometry and evolution of the data-dependent Neural Tangent Kernel
In suitably initialized wide networks, small learning rates transform deep neural networks (DNNs) into neural tangent kernel (NTK) …
Differentiable Causal Discovery from Interventional Data
Learning a causal directed acyclic graph from data is a challenging task that involves solving a combinatorial problem for which the …
In search of robust measures of generalization
One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community …
Measuring Systematic Generalization in Neural Proof Generation with Transformers
We are interested in understanding how well Transformer language models (TLMs) can perform reasoning tasks when trained on knowledge …
Online Fast Adaptation and Knowledge Accumulation: a New Approach to Continual Learning
Continual learning studies agents that learn from streams of tasks without forgetting previous ones while adapting to new ones. Two …
Promoting Coordination through Policy Regularization in Multi-Agent Deep Reinforcement Learning
In multi-agent reinforcement learning, discovering successful collective behaviors is challenging as it requires exploring a joint …
Sharpened Generalization Bounds based on Conditional Mutual Information and an Application to Noisy-Gradient Iterative Algorithms
The information-theoretic framework of Russo and J. Zou (2016) and Xu and Raginsky (2017) provides bounds on the generalization error …
Synbols: Probing Learning Algorithms with Synthetic Datasets
Progress in the field of machine learning has been fueled by the introduction of benchmark datasets pushing the limits of existing …
Unsupervised Learning of Dense Visual Representations
Contrastive self-supervised learning has emerged as a promising approach to unsupervised visual representation learning. In general, …