ServiceNow AI Research

Xing Han Lu

Xing Han Lu

Visiting Researcher

AI Research Partnerships & Ecosystem​

I am a graduate student at McGill University and Mila, where I work on NLP research under the supervision of Dr. Siva Reddy, and a Visiting Researcher at ServiceNow Research. Previously, I was at Plotly, where I lead various ML initiatives, developed open-source libraries, and contributed to Dash core components. Before that, I spent a summer as a data science intern at Deloitte working on summarization engines, and another at the McGill Clinical and Health Informatics lab as a research assistant in ML for Taxation Modelling. I also share notebooks on Kaggle, where I am a Kernels Grandmaster.

Publications

WebArena-Pro: A Heterogeneous, Multimodal, Reproducible Benchmark for Web Agents. Imene Kerboua, Fatemeh Pesaran, Xing Han Lu, Weijian Qi, Alexander Miller, Junyi Song, Yunjia Tian, Dongjin Kang, Seyeon Choi, Marzia Nouri, Ewen Gueguen, Matteo Boglioni, Fengyuan Liu, Zeyi Liao, Mengqi Yuan, Yue Li, Alexandre Lacoste, Alexandre Drouin, Spandana Gella, Huan Sun, Gunhee Kim, Siva Reddy. At Workshop at the International Conference of Machine Learning (ICML),  2026.

Paper Cite

DRBench: A Realistic Benchmark for Enterprise Deep Research. Amirhossein Abaskohi, Tianyi Chen, Miguel Muñoz-Mármol, Curtis Fox, Amrutha Ramesh, Étienne Marcotte, Xing Han Lu, Nicolas Chapados, Spandana Gella, Christopher Pal, Alexandre Drouin, Issam H. Laradji. At International Conference on Learning Representations,  2026.

Paper Cite Code

Grounding Computer Use Agents on Human Demonstrations. Aarash Feizi, Shravan Nayak, Xiangru Jian, Kevin Qinghong Lin, Kaixin Li, Rabiul Awal, Xing Han Lu, Johan Obando, Juan A. Rodriguez, Nicolas Chapados, David Vazquez, Adriana Romero Soriano, Reihaneh Rabbany, Perouz Taslakian, Christopher Pal, Spandana Gella, Sai Rajeswar Mudumba. At International Conference on Learning Representations,  2026.

Paper Cite Code

SafeArena: Evaluating the Safety of Autonomous Web Agents. Ada Tur, Nicholas Meade, Xing Han Lu, Alejandra Zambrano, Arkil Patel, Esin Durmus, Spandana Gella, Karolina Stanczak, Siva Reddy. At International Conference on Machine Learning (ICML),  2025.

Paper Cite Code

MMTEB: Massive Multilingual Text Embedding Benchmark. Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, Márton Kardos, Ashwin Mathur, David Stap, Jay Gala, Wissam Siblini, Dominik Krzeminski, Genta Indra Winata, Saba Sturua, Saiteja Utpala, Mathieu Ciancone, Marion Schaeffer, Gabriel Sequeira, Diganta Misra, Shreeya Dhakal, Jonathan Rystrøm, Roman Solomatin, Ömer Çagatan, Akash Kundu, Martin Bernstorff, Shitao Xiao, Akshita Sukhlecha, Bhavish Pahwa, Rafał Poswiata, Kranthi Kiran GV, Shawon Ashraf, Daniel Auras, Björn Plüster, Jan Philipp Harries, Loïc Magne, Isabelle Mohr, Mariya Hendriksen, Dawei Zhu, Hippolyte Gisserot-Boukhlef, Tom Aarsen, Jan Kostkan, Konrad Wojtasik, Taemin Lee, Marek Šuppa, Crystina Zhang, Roberta Rocca, Mohammed Hamdy, Andrianos Michail, John Yang, Manuel Faysse, Aleksei Vatolin, Nandan Thakur, Manan Dey, Dipam Vasani, Pranjal Chitale, Simone Tedeschi, Nguyen Tai, Artem Snegirev, Michael Günther, Mengzhou Xia, Weijia Shi, Xing Han Lu, Jordan Clive, Gayatri Krishnakumar, Anna Maksimova, Silvan Wehrli, Maria Tikhonova, Henil Pancha, Aleksandr Abramov, Malte Ostendorff, Zheng Liu, Simon Clematide, Lester James Miranda, Alena Fenogenova, Guangyu Song, Ruqiya Bin Saf, Wen-Ding Li, Alessia Borghini, Federico Cassano, Hongjin Su, Jimmy Lin, Howard Yen, Lasse Hansen, Sara Hooker, Chenghao Xiao, Vaibhav Adlakha, Orion Weller, Siva Reddy, Niklas Muennighoff. At International Conference of Learning Representations (ICLR),  2025.

Paper Cite Code

Evaluating Correctness and Faithfulness of Instruction-Following Models for Question Answering. Vaibhav Adlakha, Parishad BehnamGhader, Xing Han Lu, Nicholas Meade, Siva Reddy. At Transactions of the Association for Computational Linguistics (TACL),  2024.

Paper Cite Code

The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents. Xing Han Lu, Siva Reddy, Harm de Vries. At European Chapter of the Association for Computational Linguistics (EACL),  2023.

Paper Cite