Exploring External Content Connectors
Summarize
Summary of Exploring External Content Connectors
The External Content Connectors application in ServiceNow AI Search enables indexing and searching of content and metadata from numerous external repositories such as Atlassian Confluence Cloud, Microsoft SharePoint Online, Adobe Acrobat Sign, GitHub Enterprise Cloud, and many others. This expansion allows users to locate information more quickly by including external data sources in AI Search results while preserving the original access permissions from those sources through AI Search’s content security model.
Show less
This application is supported only on cloud-hosted ServiceNow AI Platform® instances and not on on-premise deployments.
Key Features
- Wide Range of Connectors: Supports over 40 external content connectors covering popular platforms like Microsoft Teams, Slack, Dropbox, Jira Cloud, and ServiceNow instances.
- Configurable Crawls: Connector administrators can schedule or run on-demand crawls for content and user permissions, controlling crawl scope with inclusion/exclusion filters and crawl start points.
- Integration Hub Transactions: Crawling consumes Integration Hub transactions, which can be monitored via the Integration Hub Usage Dashboard to manage subscription usage.
- Indexed Sources & Search Profiles: Each connector creates its own indexed source; these can be configured and included in search profiles just like native indexed sources.
- Semantic Vector Indexing: All connectors support semantic vector indexing for enhanced search relevance when using features dependent on semantic vector search with the Now LLM Service.
- Security and Permissions: User and group access permissions from source systems are maintained, ensuring users only see content they are authorized to access.
Operational Limits and Management
- Each connector indexes up to 1,000,000 content items; beyond this, only deletions and updates are processed, and errors are logged for excess content.
- Warnings appear at 800,000 indexed items, and errors appear upon reaching the limit, prompting administrators to adjust crawl settings or request limit increases via ServiceNow support.
- User permissions crawls support up to 500,000 users and groups; exceeding this may result in incorrect permission application and unsearchable content.
Practical Workflow
Connector administrators configure connectors, define crawl schedules and scopes, and monitor crawl histories and metrics to optimize indexing. AI Search users then benefit from integrated search results that include external content while respecting access controls. Content crawls retrieve searchable data and permissions, feeding AI Search for indexing and search presentation.
Benefits for ServiceNow Customers
- Expanded Search Reach: Access to a broad array of external content sources directly within AI Search applications improves productivity by reducing time spent searching across multiple systems.
- Security-Aligned Access: Maintains source system permissions to ensure compliance and data security.
- Administrative Control: Flexible crawl scheduling and filtering empower administrators to tailor indexing to organizational needs and data volumes.
- Integration with Now Assist: External content search results can be included in Now Assist Multi-Content Response Genius Result answers, enhancing AI-powered assistance in Virtual Agent chat and AI Search.
Configuration Considerations
- Source system administrators must configure external systems to allow indexing and permission retrieval before connectors can be created.
- Connector administrators handle creation and configuration of connectors and crawl settings, ensuring efficient and relevant content retrieval.
- Domain separation is not supported for External Content Connectors, so data and administrative tasks are not isolated by domains in this context.
Next Steps for Customers
To leverage External Content Connectors, ensure your ServiceNow instance is cloud-hosted and plan the scope of content indexing based on source system document volumes. Monitor Integration Hub transaction usage to avoid overages. Adjust crawl settings proactively to manage content volume limits or request limit increases if necessary through ServiceNow support.
Using External Content Connectors, AI Search applications can search content and metadata from external content repositories such as Atlassian Confluence Cloud and Microsoft SharePoint Online. Expanding search recall to include external content makes it easier and faster for search users to locate the information they need.
External Content Connectors overview
The External Content Connectors application adds support for indexing content and metadata from external source systems to make those systems searchable in AI Search applications. Indexing preserves the content's original user access permissions from the source system using AI Search's content security model.
- Adobe Acrobat Sign external content connector
- Adobe Experience Manager as a Cloud Service external content connector
- Aha! Roadmaps external content connector
- Amazon S3 external content connector
- Asana external content connector
- Atlassian Confluence Cloud external content connector
- Atlassian Jira Cloud external content connector
- Box external content connector
- Cornerstone external content connector
- Docusign external content connector
- Fluid Topics external content connector
- Dropbox external content connector
- GitHub Enterprise Cloud external content connector
- GitLab external content connector
- Google Drive external content connector
- HubSpot external content connector
- Lucidchart external content connector
- ManageEngine external content connector
- Microsoft OneDrive external content connector
- Microsoft SharePoint Online external content connector
- Microsoft Teams external content connector
- Microsoft Viva Engage external content connector
- Miro external content connector
- monday.com external content connector
- Notion external content connector
- SAP DMS external content connector
- SAP SuccessFactors external content connector
- ServiceNow documentation external content connector
- ServiceNow instance external content connector
- Slack external content connector
- Smartsheet external content connector
- Trello external content connector
- Webcrawler external content connector
- WordPress external content connector
- Workday external content connector
- Workvivo external content connector
- Zendesk Guide external content connector
- Zoom external content connector
Each external content connector has its own indexed source for crawled content. You can configure search sources for an external content connector's indexed source and include those search sources in your search profiles, just as you would for any other indexed source. To learn more about indexed sources, see Indexed sources in AI Search.
All external content connectors support semantic vector indexing of content retrieved from crawled source systems. Only features which use semantic vector search with the Now LLM Service can take advantage of this support. For details on semantic vector indexing and search, see Semantic vector search in AI Search.
External Content Connectors availability
The External Content Connectors application is only supported on cloud-hosted ServiceNow AI Platform® instances. It's not supported on on-premise (self-hosted) instances.
External Content Connectors workflow
In this infographic, see a sample workflow of how different users in an organization interact with External Content Connectors to enable indexing and search of content and metadata from supported external sources.
- Connector administrators configure connection settings for external content connectors, configure crawl start points and inclusion/exclusion filters to define the scope of connector crawls, and define schedules that specify when crawls run.
- The system runs connectors at their scheduled times or when connector administrators start one-time crawls. When crawling, connectors retrieve searchable content and security principals from their source systems and feed them to AI Search for indexing.
- Search users are presented with content and metadata from external content source systems when interacting with AI Search applications. AI Search's content security model retains user and group access permissions set in the source system, so users can only view content that they have permission to access.
- Connector administrators review and analyze crawl metrics, crawl histories, and user permission data to understand how external data is crawled and indexed, allowing for more effective tuning of crawl settings for their external content connectors.
By default, each external content connector can index up to one million (1,000,000) content items from its source system. When a connector exceeds this limit, it continues to crawl the source system, but only sends content item deletions and updates to AI Search for indexing, ignoring new content items. The connector logs an error message for every 10,000 content items it crawls beyond the indexing limit.
When a connector's indexed content item count exceeds 800,000, a warning message appears in the connector's UI to indicate that it's approaching the indexing limit. If the connector reaches the indexing limit, an error message appears in its UI.
External content connectors that support user permissions crawls can handle permissions for up to five hundred thousand (500,000) users and their groups. If a connector retrieves users in excess of this limit, user and group permissions may not be correctly applied to the connector's retrieved content. As a result, the content may not be searchable.
If one of your connectors reaches the content indexing limit, you can update its crawl settings and file inclusion/exclusion filters to reduce the number of content items it retrieves. Alternatively, if you need a connector to index more than 1,000,000 content items, you can create a Customer Service and Support case at https://support.servicenow.com/now to request a limit increase for the connector.
External Content Connectors benefits
| Benefit | Feature | Users |
|---|---|---|
| Configure source systems for external content indexing | Configuring source systems for external content indexing | Source system administrators |
| Create connectors to retrieve searchable content and metadata and user permissions from supported external data source systems | Creating external content connectors | Connector administrators |
| Control the scope of external content connector crawls by specifying source system locations to crawl and content types to feed to AI Search for indexing | Configuring crawl settings for external content connectors | Connector administrators |
| Update searchable content and metadata from source systems on demand or on a scheduled recurring basis | Create a content crawl for an external content connector | Connector administrators |
| Update user and group access permissions from source systems on demand or on a scheduled recurring basis | Create a user permission crawl for an external content connector | Connector administrators |
| Review metrics for source system items retrieved by content crawls | Review crawl history for an external content connector | Connector administrators |
| Review user and group access permissions retrieved by user permission crawls | Review user permissions for an external content connector | Search high security administrators |
| Search content and metadata indexed from external data source systems | Searching in AI Search | AI Search users |
Interaction with Now Assist Genius Results
If you have the Now Assist in AI Search and Now Assist in Virtual Agent ServiceNow Store applications installed, external content search results are eligible for inclusion in Now Assist Multi-Content Response Genius Result answers. This includes answers generated in Now Assist in Virtual Agent chat.
External content search results are ignored when generating Now Assist Q&A or Now Assist Actions Genius Result answers.