ServiceNow Research

Reasoning

WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation
WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation
Understanding diverse web data and automating web development presents an exciting challenge for agentic AI. While existing benchmarks …
Workshop at the Computer Vision and Pattern Recognition Conference (CVPR),  2025.
PDF Cite
WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation
WebMMU: A Benchmark for Multimodal Multilingual Website Understanding and Code Generation
Understanding diverse web data and automating web development presents an exciting challenge for agentic AI. While existing benchmarks …
Workshop at the International Conference of Learning Representation (ICLR),  2025.
PDF Cite
Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoning
Decoder-only Transformers often struggle with complex reasoning tasks, particularly arithmetic reasoning requiring multiple sequential …
International Conference of Learning Representations (ICLR),  2025.
PDF Cite Code Slides Video
Evaluating Interventional Reasoning Capabilities of Large Language Models
Evaluating Interventional Reasoning Capabilities of Large Language Models
Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners …
Workshop at the Neural Information Processing Systems (NeurIPS),  2024.
PDF Cite
Are Diffusion Models Vision-And-Language Reasoners?
Are Diffusion Models Vision-And-Language Reasoners?
Text-conditioned image generation models have recently shown immense qualitative success using denoising diffusion processes. However, …
Conference on Neural Information Processing Systems (NeurIPS),  2023.
PDF Cite Code
Egocentric Planning for Scalable Embodied Task Achievement
Egocentric Planning for Scalable Embodied Task Achievement
Embodied agents face significant challenges when tasked with performing actions in diverse environments, particularly in generalizing …
Conference on Neural Information Processing Systems (NeurIPS),  2023.
PDF Cite
Explaining Graph Neural Networks Using Interpretable Local Surrogates
Explaining Graph Neural Networks Using Interpretable Local Surrogates
We propose an interpretable local surrogate (ILS) method for understanding the predictions of black-box graph models. Explainability …
Workshop at the International Conference on Machine Learning (ICML),  2023.
PDF Cite
OC-NMN: Object-centric Compositional Neural Module Network for Generative Visual Analogical Reasoning
OC-NMN: Object-centric Compositional Neural Module Network for Generative Visual Analogical Reasoning
Imagination is a crucial aspect of human intelligence that enables us to combine concepts in novel ways and make sense of new …
Workshop at the International Conference on Machine Learning (ICML),  2023.
PDF Cite
Knowledge Hypergraph Embedding Meets Relational Algebra
Knowledge Hypergraph Embedding Meets Relational Algebra
Embedding-based methods for reasoning in knowledge hypergraphs learn a representation for each entity and relation. Current methods do …
Journal of Machine Learning Research (JMLR),  2023.
PDF Cite Code
Visual Question Answering From Another Perspective: CLEVR Mental Rotation Tests
Visual Question Answering From Another Perspective: CLEVR Mental Rotation Tests
Different types of mental rotation tests have been used extensively in psychology to understand human visual reasoning and perception. …
Pattern Recognition (PR),  2022.
PDF Cite