ServiceNow Research

Natural Language Processing

S-LLM: Semi-Supervised Large Language Model for Chat Summarization
As producing high-quality summaries of chat dialogues currently requires large labeled datasets, we propose a method to efficiently …
Countering Language Drift with KL Regularization
End-to-end interactive learning of dialogue systems has been all-but-abandoned in favour of other approaches using more labelled data, …
Competition exacerbates Language Drift
A Planning based Neural-Symbolic Approach for Embodied Instruction Following
The ALFRED environment features embodied instruction following tasks in simulated home environments. However, end-to-end deep learning …
Data Augmentation for Intent Classification with Off-the-shelf Large Language Models
Data augmentation alleviates the problem of data scarcity when training language models (LMs) by generating new examples based on the …
TopiOCQA: Open-domain Conversational Question Answering with Topic Switching
In a conversational question answering scenario, a questioner seeks to extract information about a topic through a series of …
Geoscience language models and their intrinsic evaluation
Geoscientists use observations and descriptions of the rock record to study the origins and history of our planet, which has resulted …
Picard: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models
Large pre-trained language models for textual data have an unconstrained output space; at each decoding step, they can produce any of …
DuoRAT: Towards Simpler Text-to-SQL Models
Recent neural text-to-SQL models can effectively translate natural language questions to corresponding SQL queries on unseen databases. …
Understanding by Understanding Not: Modeling Negation in Language Models
Negation is a core construction in natural language. Despite being very successful on many tasks, state-of-the-art pre-trained language …