Indexing and searching external content in AI Search

  • Release version: Yokohama
  • Updated July 16, 2025
  • 5 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Indexing and Searching External Content in AI Search

    The External Content for AI Search plugin enables ServiceNow AI Search users to index and search documents stored outside the ServiceNow AI Platform, such as SharePoint, Confluence, and remote tables. This integration allows content and metadata from external repositories to be searchable alongside native ServiceNow records without duplicating documents in the platform. When users select search results from external content, they are redirected to the original document location.

    Show full answer Show less

    External Content Indexing Tools

    There are three primary methods to index external content for AI Search:

    • Search Connector Applications: Pre-built apps available in the ServiceNow Store that simplify indexing for specific external sources by automatically creating necessary schema tables and configurations. Examples include connectors for SharePoint Online and multi-source connectors.
    • Integration Hub AI Search Spoke: Provides Workflow Studio drag-and-drop actions to ingest documents or download them via URL for indexing, with options to set security permissions. It offers flexible configuration with an easy-to-use interface.
    • External Content REST API: Offers detailed endpoints to send document content, metadata, and binary data for indexing, requiring appropriate roles (aisexternalcontent or admin). This method provides maximum flexibility but requires more complex setup.

    Prerequisites for Indexing External Content

    • An active subscription to the External Content for AI Search plugin is required.
    • Create an external content schema table that maps AI Search index fields to the external document fields. This table does not store content but defines how indexing occurs. One schema table can serve multiple sources if they share fields and unique document IDs; otherwise, separate tables are needed.
    • Set up an indexed source that uses the external content schema table to send document data to the AI Search index.
    • Create one or more search sources to define which subsets of external documents are searchable.

    Security and Access Control

    AI Search respects user and group security permissions configured on external documents. You can map external users and groups to ServiceNow AI Platform users, ensuring secure and controlled access to external content search results.

    Practical Benefits for ServiceNow Customers

    • Enables unified search experience by incorporating external content into AI Search results without duplicating data.
    • Supports various external repositories through flexible tools ranging from simple connector apps to REST APIs and workflow actions.
    • Maintains security by preserving access controls defined on external documents.
    • Allows customers to extend AI Search functionality to include their enterprise’s diverse content sources, improving search comprehensiveness and user productivity.

    With a subscription for the External Content for AI Search plugin, you can enable AI Search users to search content and metadata from documents in external repositories and remote tables.

    The External Content for AI Search plugin enables you to index documents located outside of your ServiceNow AI Platform® instance, such as those stored in SharePoint collections, Confluence sites, and remote tables. Indexing these documents makes their content and metadata searchable in AI Search.

    AI Search displays search results for indexed external documents just as it does for indexed ServiceNow AI Platform records. Users don't need to perform any special searches to match content and metadata from external documents.

    Indexing doesn't duplicate external documents as records in your ServiceNow AI Platform instance. When a user selects an external document search result, they are directed to the source document in its original location.

    External content indexing tools

    The following diagram illustrates how AI Search provides indexing and search for external document content and metadata:

    Figure 1. AI Search external content architecture diagram
    Diagram showing AI Search indexing and search options for external documents.

    As shown in the architecture diagram, you can index content and metadata from external documents using any or all of the following tools:

    External content indexing tool Description
    Search connector applications Search connector applications available in the ServiceNow Store provide simple tools for indexing content and metadata from documents in supported external sources. They handle some of the configuration work, such as creation of external content schema tables, for you.

    Each search connector application supports a specific external document source (or set of sources). For example, the SharePoint Online Search Connector only supports documents in SharePoint collections, while the Raytion Connector Hub for AI Search supports multiple document sources. If no search connector application is available for your external document source, you must use the Integration Hub AI Search spoke or the External Content REST API to index content and metadata for documents from that source.

    Search connector applications provide the most straightforward way to index document content and metadata from supported external sources.
    Integration Hub AI Search spoke The Integration Hub AI Search spoke provides Workflow Studio actions that you can use to ingest external documents for indexing:
    • Ingest Document: Define property name-value pairs for an external document and submit the document to AI Search for indexing.
    • Ingest Document Using Download URL: Specify an external document's URL and have AI Search download it for indexing.

    You can specify security principal access permissions for documents ingested using these actions. To learn more about access permissions and security for external document content, see External content security for AI Search.

    For the full list of Workflow Studio actions provided by the AI Search spoke, see AI Search spoke.

    The Integration Hub AI Search spoke combines flexible configuration and handling with the simple drag-and-drop Workflow Studio interface.
    External Content REST API The External Content REST API provides endpoints that you can use to index content and metadata from external documents:
    • Send external document text content and metadata to AI Search for indexing using the ingestDocuments API endpoint.
    • Upload external document binary content to AI Search using the storeContent API endpoint. You can associate the stored binary content with a document fed using the ingestDocuments endpoint.
    Note:
    To access the External Content REST API endpoints, you need either the ais_external_content role or the admin role.

    You can specify security principal access permissions for documents ingested using the ingestDocuments endpoint. To learn more about access permissions and security for external document content, see External content security for AI Search.

    For full descriptions of the External Content REST API endpoints, see External Content Ingestion REST API.

    The External Content REST API is the most complex tool for indexing content and metadata from your external documents, but it offers the most flexibility.

    External content search prerequisites

    Before you can index external document content and metadata for search in AI Search, you must satisfy the following requirements. Except as noted in the table, these requirements apply regardless of which external content indexing tools you use.

    Requirement Description
    Have an active subscription for the External Content for AI Search plugin (com.glide.ais.external_content) The External Content for AI Search plugin provides functionality for indexing content from external data sources.

    For instructions on purchasing a subscription for the plugin and activating it, see Request the External Content for AI Search plugin.
    Define an external content schema table for the external document source An external content schema table doesn't store external document content in the database. Instead, its columns serve as a map of AI Search index fields to populate when you index content from external data sources.

    For instructions on creating a new external content schema table, see Create an external content schema table.

    When documents from multiple external data sources share the same set of fields and have unique document identifiers, you can use a single external content schema table for all of them. To avoid data loss, the external data sources must satisfy these conditions:
    • All documents in the external data sources must include the same fields, matching the columns defined in the content schema table.
    • Every document in the external data sources must have a unique identifier so that documents don't overwrite one another in the AI Search index.

    If the external data sources can't satisfy these conditions, create a separate external content schema table for each data source.

    Note:
    Search connector applications from the ServiceNow Store automatically create external content schema tables as needed. You only need to create your own external content schema tables when indexing external documents using the Integration Hub AI Search spoke or the External Content REST API.
    Create an indexed source with your external content schema table specified as the table to index The indexed source sends external documents' content and metadata to the AI Search index.

    For instructions on creating an indexed source, see Create an indexed source.
    Create one or more search sources for the indexed source Each search source specifies a subset of external documents from the indexed source whose content you want to make searchable in AI Search.

    For instructions on creating search sources, see Create a search source for AI Search.