1
Understanding diverse web data and automating web development presents an exciting challenge for agentic multimodal models. While …
We present WebMMU, a multilingual benchmark that evaluates three core web tasks: (1) website visual question answering, (2) code …
While numerous recent benchmarks focus on evaluating generic Vision-Language Models (VLMs), they fall short in addressing the unique …
Forecasting in real-world settings requires models to integrate not only historical data but also relevant contextual information, …
Charts are essential to data analysis, transforming raw data into clear visual representations that support human decision-making. …
Neural sentence embedding models for dense retrieval typically rely on binary relevance labels, treating query-document pairs as …
We present DoomArena, a security evaluation framework for AI agents. DoomArena is designed on three principles: 1) It is a …
Merging parameter-efficient task experts has recently gained growing attention
as a way to build modular architectures that can be …
We present significant extensions to diffusion-based sequence generation models, blurring the line with autoregressive language models. …
Large Language Models (LLMs) such as GPT-4o can handle a wide range of complex tasks with the right prompt. As per token costs are …