ServiceNow AI Research

Arkil Patel

Publications

SafeArena: Evaluating the Safety of Autonomous Web Agents. Ada Tur, Nicholas Meade, Xing Han Lu, Alejandra Zambrano, Arkil Patel, Esin Durmus, Spandana Gella, Karolina Stanczak, Siva Reddy. At International Conference on Machine Learning (ICML),  2025.

PDF Cite Code

Evaluating In-Context Learning of Libraries for Code Generation. Arkil Patel, Siva Reddy, Dzmitry Bahdanau, Pradeep Dasigi. At North American Chapter of the Association for Computational Linguistics (NAACL),  2024.

PDF Cite Code

MAGNIFICO: Evaluating the In-Context Learning Ability of Large Language Models to Generalize to Novel Interpretations. Arkil Patel, Satwik Bhattamishra, Siva Reddy, Dzmitry Bahdanau. At Conference on Empirical Methods in Natural Language Processing (EMNLP),  2023.

PDF Cite Code