ServiceNow Research attends EMNLP 2022

  • 2023
  • ServiceNow Research
January 25, 2023

ServiceNow Research at EMNLP 2022

The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) was held in Abu Dhabi, United Arab Emirates, Dec. 7-11, 2022.

ServiceNow Research had three papers accepted at EMNLP 2022:

Azimuth system demo

Orlando Marquez, an applied research scientist in the Advanced Technologies Group at ServiceNow, attended the event in person and presented the poster and system demo for Azimuth on Dec. 9. Azimuth is an open-source tool for error analysis in natural language processing (NLP) text classification. It is designed to help artificial intelligence (AI) practitioners find and address areas in which their models are not performing optimally by supplying a range of techniques for data set analysis and model quality assessment.

Orlando Marquez, applied research scientist at ServiceNow, presenting his poster

For data set analysis, Azimuth provides AI practitioners with tools for understanding the characteristics of the data set, including class distribution and any class imbalances that may exist. It also allows users to analyze the quality of the data, such as by identifying data shifts between data set splits and finding errors and inconsistencies.

For model quality assessment, Azimuth uses a range of techniques to help AI practitioners understand how the model is making decisions, recognize patterns in its errors, assess confidence in its predictions, and learn how it behaves under different conditions.

Azimuth has the potential to significantly improve the error analysis stage of the machine learning (ML) development cycle, making it more systematic and efficient. The reception to Azimuth was incredibly positive, as it’s a well-designed, open-source tool to help perform systematic error analysis of NLP models.

We received feedback regarding the need to support other tasks, such as summarization, and more languages, such as Arabic. We invite the AI community to contribute to the project by helping us add support for new tasks and languages.

Thank you and congratulations to the organizers and volunteers for hosting another momentous event, and to all the researchers who had their work accepted at the conference.

Find out more about ServiceNow Research.

© 2023 ServiceNow, Inc. All rights reserved. ServiceNow, the ServiceNow logo, Now, and other ServiceNow marks are trademarks and/or registered trademarks of ServiceNow, Inc. in the United States and/or other countries. Other company names, product names, and logos may be trademarks of the respective companies with which they are associated.


  • Knowledge 2023 takeaways: a group of women raising their hands
    4 takeaways from Knowledge 2023
    Knowledge 2023 united thousands of ServiceNow customers and colleagues at the first single global user conference in three years. Here are four key takeaways.
  • DEI data analytics: group of diverse workers in conversation
    Using DEI data analytics to know where we are and to strategize
    It's impossible to truly embody DEI without first knowing the current state through DEI data analytics. Find out how ServiceNow uses DEI data.
  • Wide view of thousands of people seated to hear the Knowledge 2023 keynote
    Knowledge 2023 keynote recap: Putting yes to work
    The Knowledge 2023 keynote in Las Vegas was standing room only. Against the theme of “Putting Yes to Work,” speakers shared well-honed insights. Learn more.

Trends & Research

  • ESG technology: green surrounding a river, woman smiling, 2 government employees in conversation
    Cybersecurity and Risk
    Survey says ESG technology drives results
  • RPA: group of workers gathered around a conference table looking at a laptop
    AI and Automation
    Forrester report: ServiceNow debuts as a Strong Performer in RPA
  • Digital innovation: three workers looking at a computer monitor
    AI and Automation
    Survey says digital innovation is the way to navigate macro uncertainty