ServiceNow Research

Machine Learning

On the Value of ML Models
We argue that, when establishing and benchmarking Machine Learning (ML) models, the research community should favour evaluation metrics …
The Variational Bandwidth Bottleneck: Stochastic Evaluation on an Information Budget
In many applications, it is desirable to extract only the relevant information from complex input data, which involves making a …
Deep Complex Separators
Retrieving Signals in the Frequency Domain with Deep Complex Extractors
Recent advances have made it possible to create deep complex-valued neural networks. Despite this progress, the potential power of …
Hinted Networks
We present Hinted Networks: a collection of architectural transformations for improving the accuracies of neural network models for …
Data-dependent PAC-Bayes priors via differential privacy
The Probably Approximately Correct (PAC) Bayes framework (McAllester, 1999) can incorporate knowledge about the learning algorithm and …
Improving Explorability in Variational Inference with Annealed Variational Objectives
Despite the advances in the representational capacity of approximate distributions for variational inference, the optimization process …
Sparse Attentive Backtracking: Temporal Credit Assignment Through Reminding
Learning long-term dependencies in extended temporal sequences requires credit assignment to events far back in the past. The most …
Deep Complex Networks
At present, the vast majority of building blocks, techniques, and architectures for deep learning are based on real-valued operations …
Deep Prior
The recent literature on deep learning offers new tools to learn a rich probability distribution over high dimensional data such as …