ServiceNow Research attends EMNLP 2022

  • 2023
  • ServiceNow Research
January 25, 2023

ServiceNow Research at EMNLP 2022

The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) was held in Abu Dhabi, United Arab Emirates, Dec. 7-11, 2022.

ServiceNow Research had three papers accepted at EMNLP 2022:

Azimuth system demo


Orlando Marquez, an applied research scientist in the Advanced Technologies Group at ServiceNow, attended the event in person and presented the poster and system demo for Azimuth on Dec. 9. Azimuth is an open-source tool for error analysis in natural language processing (NLP) text classification. It is designed to help artificial intelligence (AI) practitioners find and address areas in which their models are not performing optimally by supplying a range of techniques for data set analysis and model quality assessment.

Orlando Marquez, applied research scientist at ServiceNow, presenting his poster


For data set analysis, Azimuth provides AI practitioners with tools for understanding the characteristics of the data set, including class distribution and any class imbalances that may exist. It also allows users to analyze the quality of the data, such as by identifying data shifts between data set splits and finding errors and inconsistencies.

For model quality assessment, Azimuth uses a range of techniques to help AI practitioners understand how the model is making decisions, recognize patterns in its errors, assess confidence in its predictions, and learn how it behaves under different conditions.

Azimuth has the potential to significantly improve the error analysis stage of the machine learning (ML) development cycle, making it more systematic and efficient. The reception to Azimuth was incredibly positive, as it’s a well-designed, open-source tool to help perform systematic error analysis of NLP models.

We received feedback regarding the need to support other tasks, such as summarization, and more languages, such as Arabic. We invite the AI community to contribute to the project by helping us add support for new tasks and languages.

Thank you and congratulations to the organizers and volunteers for hosting another momentous event, and to all the researchers who had their work accepted at the conference.

Find out more about ServiceNow Research.

© 2023 ServiceNow, Inc. All rights reserved. ServiceNow, the ServiceNow logo, Now, and other ServiceNow marks are trademarks and/or registered trademarks of ServiceNow, Inc. in the United States and/or other countries. Other company names, product names, and logos may be trademarks of the respective companies with which they are associated.

Topics

  • Total experience companies outperform: prism refraction with an arrow pointing to the right
    Employee Experience
    Survey says: Total experience-focused companies outperform
    Organizations are aligning employee experience and customer experience to create a positive total experience. See findings from the latest research.
  • Engaging employee experience: woman in a hijab smiling at a laptop
    Employee Experience
    4 steps to an engaging employee experience
    Helping workers fulfill their purpose can increase employee satisfaction and decrease turnover. Learn four steps to create an engaging employee experience.
  • Hybrid work environment: person sitting in front of a laptop on a video call
    Employee Experience
    4 steps to optimize a hybrid work environment
    Hybrid work combines the collaborative atmosphere offices provide with the perks of working remotely. Explore four ways to manage a hybrid work environment.

Trends & Research

  • Total experience companies outperform: prism refraction with an arrow pointing to the right
    Employee Experience
    Survey says: Total experience-focused companies outperform
  • Forrester Wave Leader 2022: Value Stream Management
    IT Management
    Forrester: ServiceNow is a Leader in value stream management solutions
  • Gartner Magic Quadrant Enterprise Low-Code Application Platforms
    Application Development
    A Magic Quadrant™ Leader in Low-Code Application Platforms for third year

Year