Benchmark

The Stack: 3 TB of permissively licensed source code

The Stack: 3 TB of permissively licensed source code

Large Language Models (LLMs) play an ever-increasing role in the field of Artificial Intelligence (AI)–not only for natural …

Denis Kocetkov, Raymond Li, Loubna Ben Allal, Jia Li, Chenghao Mou, Carlos Muñoz Ferrandis, Yacine Jernite, Margaret Mitchell, Sean Hughes, Thomas Wolf , Dzmitry Bahdanau, Leandro von Werra, Harm de Vries

Transactions on Machine Learning Research (TMLR), 2022.

In search of robust measures of generalization

In search of robust measures of generalization

One of the principal scientific challenges in deep learning is explaining generalization, i.e., why the particular way the community …

Gintare Karolina Dziugaite, Alexandre Drouin, Brayden (Brady) Neal, Nitarshan Rajkumar, Ethan Victor Caballero, Linbo Wang, Ioannis Mitliagkas, Daniel M. Roy

Conference on Neural Information Processing Systems (NeurIPS), 2020.