Xiangru Jian

Publications

Grounding Computer Use Agents on Human Demonstrations. Aarash Feizi, Shravan Nayak, Xiangru Jian, Kevin Qinghong Lin, Kaixin Li, Rabiul Awal, Xing Han Lu, Johan Obando, Juan A. Rodriguez, Nicolas Chapados, David Vazquez, Adriana Romero Soriano, Reihaneh Rabbany, Perouz Taslakian, Christopher Pal, Spandana Gella, Sai Rajeswar Mudumba. At International Conference on Learning Representations, 2026.

AlignVLM: Bridging Vision and Language Latent Spaces for Multimodal Document Understanding. Ahmed Masry, Juan A. Rodriguez, Tianyu Zhang, Suyuchen Wang, Chao Wang, Aarash Feizi, Akshay Kalkunte, Abhay Puri, Xiangru Jian, Pierre-André Noël, Sathwik Madhusudhan, Marco Pedersoli, Bang Liu, Nicolas Chapados, Yoshua Bengio, Enamul Hoque Prince , Christopher Pal, Issam H. Laradji, David Vazquez, Perouz Taslakian, Spandana Gella, Sai Rajeswar Mudumba. At Neural Information Processing Systems (NeurIPS), 2025.

PDF Citation Vidéo

AlignVLM: Bridging Vision and Language Latent Spaces for Multimodal Document Understanding. Perouz Taslakian, Sai Rajeswar Mudumba, Spandana Gella, Ahmed Masry, Tianyu Zhang, Juan A. Rodriguez, Chao Wang, Abhay Puri, Xiangru Jian, Pierre-André Noël, Issam H. Laradji. At NOW AI, 2025.

StarUI: Learning to Ground Agentic Perception in Desktop GUIs. Aarash Feizi, Shravan Nayak, Kevin Qinghong Lin, Kaixin Li, Rabiul Awal, Xiangru Jian, Juan A. Rodriguez, Nicolas Chapados, David Vazquez, Reihaneh Rabbany, Adriana Romero Soriano, Perouz Taslakian, Christopher Pal, Spandana Gella, Sai Rajeswar Mudumba. At NOW AI, 2025.

UI-Vision: A Desktop-centric GUI Benchmark for Visual Perception and Interaction. Shravan Nayak, Xiangru Jian, Kevin Lin, Juan A. Rodriguez, Motek Kalsi, Nicolas Chapados, Tamer Özsu, Aishwarya Agrawal, David Vazquez, Christopher Pal, Perouz Taslakian, Spandana Gella, Sai Rajeswar Mudumba. At International Conference on Machine Learning (ICML), 2025.

PDF Citation Vidéo

AlignVLM: Bridging Vision and Language Latent Spaces for Multimodal Understanding. Ahmed Masry, Juan A. Rodriguez, Tianyu Zhang, Suyuchen Wang, Chao Wang, Aarash Feizi, Akshay Kalkunte, Abhay Puri, Xiangru Jian, Pierre-André Noël, Sathwik Madhusudhan, Marco Pedersoli, Bang Liu, Nicolas Chapados, Yoshua Bengio, Enamul Hoque Prince , Christopher Pal, Issam H. Laradji, David Vazquez, Perouz Taslakian, Spandana Gella, Sai Rajeswar Mudumba. At Workshop at the International Conference of Learning Representation (ICLR), 2025.

BigDocs: An Open and Permissively-Licensed Dataset for Training Multimodal Models on Document and Code Tasks. Juan A. Rodriguez, Xiangru Jian, Siba Smarak Panigrahi, Tianyu Zhang, Aarash Feizi, Abhay Puri, Akshay Kalkunte, Francois Savard, Ahmed Masry, Shravan Nayak, Rabiul Awal, Mahsa Massoud, Amirhossein Abaskohi, Zichao Li, Suyuchen Wang, Pierre-André Noël, Mats L. Richter, Saverio Vadacchino, Shubham Agarwal, Sanket Biswas, Sara Shanian, Ying Zhang, Sathwik Tejaswi Madhusudhan, João Monteiro, Krishnamurthy (Dj) Dvijotham, Torsten Scholak, Nicolas Chapados, Sepideh Kharaghani, Sean Hughes, Tamer Özsu, Siva Reddy, Marco Pedersoli, Yoshua Bengio, Christopher Pal, Issam H. Laradji, Spandana Gella, Perouz Taslakian, David Vazquez, Sai Rajeswar Mudumba. At International Conference of Learning Representations (ICLR), 2025.

PDF Citation Vidéo

BigDocs: A Permissively-Licensed Dataset for Training Vision-Language Models on Document and Code Tasks. Juan A. Rodriguez, Xiangru Jian, Siba Smarak Panigrahi, Tianyu Zhang, Aarash Feizi, Abhay Puri, Akshay Kalkunte, Francois Savard, Amirhossein Abaskohi, Ahmed Masry, Shravan Nayak, Mahsa Massoud, Rabiul Awal, Pierre-André Noël, Mats L. Richter, Saverio Vadacchino, Shubham Agarwal, Sanket Biswas, Ying Zhang, Sathwik Tejaswi Madhusudhan, João Monteiro, Krishnamurthy (Dj) Dvijotham, Torsten Scholak, Nicolas Chapados, Sean Hughes, Tamer Özsu, Aishwarya Agrawal, Marco Pedersoli, Christopher Pal, Perouz Taslakian, David Vazquez, Issam H. Laradji, Spandana Gella, Sai Rajeswar Mudumba. At Workshop at the Neural Information Processing Systems (NeurIPS), 2024.

PDF Citation Vidéo