Code Generation

We seek to overcome limitations to code retrieval quality posed by the scarcity of data containing pairs of code snippets and natural …

Workshop at the International Conference on Learning Representations (ICLR), 2023.

The BigCode project is an open-scientific collaboration working on the responsible development of large language models for code. This …

Workshop at the International Conference on Learning Representations (ICLR), 2023.

Large Language Models (LLMs) play an ever-increasing role in the field of Artificial Intelligence (AI)–not only for natural …

Transactions on Machine Learning Research (TMLR), 2022.

This paper explores the capabilities of current transformer-based language models for program evaluation of simple functional …

Conference on Neural Information Processing Systems (NeurIPS), 2021.

Large pre-trained language models for textual data have an unconstrained output space; at each decoding step, they can produce any of …

Conference on Empirical Methods in Natural Language Processing (EMNLP), 2021.

Recent neural text-to-SQL models can effectively translate natural language questions to corresponding SQL queries on unseen databases. …

North American Chapter of the Association for Computational Linguistics (NAACL), 2021.