Using Now Assist in Virtual Agent conversations with Microsoft Teams
Summarize
Summary of Using Now Assist in Virtual Agent conversations with Microsoft Teams
Now Assist enhances Virtual Agent conversations within Microsoft Teams by integrating large language model (LLM)-based AI conversational capabilities. This enables richer, multi-turn interactions with Now Virtual Agent or Self-configured bots, providing users with faster and more intuitive access to information directly through Teams channels.
Show less
The Custom Engine Agent (CEA) replaces the earlier Declarative Agent integration, making Virtual Agent discoverable by Microsoft Copilot and supporting full Now Assist functionalities. To utilize these features, ServiceNow customers must have Microsoft Teams plugin version 10.1.1 or higher, with version 10.2 enabling CEA by default.
Integrating Microsoft Teams with Virtual Agent
- Integration supports both Now Virtual Agent bots and Self-configured bots.
- Customers should follow the respective guides to connect their bots to Microsoft Teams, enabling LLM-powered conversational experiences.
Key Features of Now Assist in Microsoft Teams
- Legal Disclaimer: The first message from Now Assist includes a clear AI-generated message disclaimer along with a greeting and available LLM-enabled topics.
- Pagination and Search: Users can navigate through multiple pages of choices and search for specific items or users within conversations. This is controlled by provider properties that enable pagination and set page limits, enhancing usability for topics with many options.
- Generative AI QnA Card: Allows users to ask questions and receive AI-generated answers displayed in an easy-to-read card format, including the legal disclaimer and citation for transparency.
- Synthesized Responses: The integration with Microsoft Copilot offers summarized, conversational responses using LLMs, reducing the need to browse multiple carousel cards for information.
Practical Benefits for ServiceNow Customers
- Enables seamless, AI-powered virtual agent interactions inside Microsoft Teams, improving user engagement and efficiency.
- Supports multi-turn conversations with intelligent navigation and search capabilities, making it easier to find relevant information quickly.
- Provides transparent AI-generated content with disclaimers and citations to maintain trust and compliance.
- Integrates with Microsoft Copilot for an enhanced conversational experience, delivering synthesized and concise answers to user queries.
The Now Assist provides you with the large language model (LLM)-based conversational experience during your conversations with a Now Virtual Agent bot or a Self-configured bot that is integrated with Microsoft Teams.
You must have version 10.1.1 or higher of the Microsoft Teams plugin to have CEA support. In version 10.2 of the Microsoft Teams plugin, streaming is inactive by default and CEA is active by default.
To enable a bot with LLM-based capabilities and experience the LLM-based conversations with the Now Assist, you must first integrate your Now Virtual Agent bot or a Self-configured bot with Microsoft Teams.
Integrating Microsoft Teams with Virtual Agent
You can integrate Virtual Agent with Microsoft Teams either with your Now Virtual Agent bot or the Self-configured bot.
To integrate Microsoft Teams with the Now Virtual Agent, see Integrate Virtual Agent with Microsoft Teams.
To integrate Microsoft Teams with a Self-configured bot, see Integrating Virtual Agent with Microsoft Teams using the self-configured bot.
Conversational experience with Now Assist in Microsoft Teams
- Legal DisclaimerThe first message in a conversation with Now Assist displays a legal disclaimer indicating that it is an AI-generated message followed by the Now Assist greeting message and LLM-enabled topics.
Figure 1. Legal Disclaimer Figure 2. LLM Topics - Pagination and SearchYou can navigate through multiple pages of choices and search for specific items or users, using the Search bar.
Figure 3. Pagination and Search When you select an LLM-enabled topic, the Search bar is displayed along with the available choices related to the selected topic and the More options button. You can either search for an item or user using the Search bar or pick an item or user from the available choices. If you want to look for more available options, you can navigate to the next page using the More Options button. If you would like to go back to the previously listed choices, you can use the Previous Options button.
If you have searched for a user or an item, the choices related to your search term are displayed. You can either select from the choices available or reset the search and pagination.Tip:You can reset the Pagination and Search by selecting Enter in the Search bar.The Pagination and Search capabilities are managed by the following provider properties:- picker_pagination_experience_supported: Enables the pagination experience in your LLM conversations with Now Assist. The default value of this property is true.
- picker_pagination_limit: Sets the page limit value for an adapter for displaying the choices. The maximum page limit value that can be set for an
adapter is 100.
For example, if a topic has fewer than 100 choices available and the limit is set to 100, then the More Options button is not displayed. If a topic has more than 100 choices available when the limit is to 100, then the More Options button is displayed.
- Generative AI QnA cardUse this feature to ask questions and get answers from Now Assist through LLM in a card format. The response is displayed with a sparkle image, the legal disclaimer, and the citation about the question asked.
Figure 4. Generative AI QnA Card
For more information about enabling LLM for your bots integrated with Microsoft Teams, see .