--- sourceDocument: Australia ServiceNow AI Platform Administration sourceDocumentLink: https://www.servicenow.com/docs/r/australia/platform-administration Release : - australia ft:locale : - en-US ft:publication_title : - Australia ServiceNow AI Platform Administration ft:clusterId : - platadm bundleId : - platadm workflow : - Platform --- # Statistics for content crawls # Statistics for external content connector content crawls {#ariaid-title1} Release version: Australia Updated October 21, 2026 ![](https://www.servicenow.com/docs/portal-asset/ico-clock) 2 minutes to read Summarize ![AI sparkle icon](https://servicenow.com/docs/portal-asset/ai-sparkle-icon) Summarized using AI This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete. ## Summary of Statistics for External Content Connector Content Crawls ServiceNow provides detailed statistics for each external content connector content crawl to help customers monitor and understand the indexing process of searchable documents (items or files with metadata). These statistics track how many documents were processed, indexed, skipped, or encountered errors during a crawl, enabling effective management of the AI Search index. Show full answer Show less ## Document Statistics For each content crawl, the system records various document-related metrics: * **Indexed:** Total new and updated items successfully included in the AI Search index. * **Added:** Number of items newly added to the AI Search index. * **Updated:** Number of items updated in the AI Search index. * **Deleted:** Items removed from the AI Search index. * **Unchanged:** Items processed without any index changes. * **Error:** Count of error-level alerts during the crawl (details available in the Alerts tab). * **Warning:** Count of warning-level alerts during the crawl (viewable in Alerts tab). * **Discovered:** Total items processed during the crawl, categorized by result status. ## Discovered Item Result Statuses The crawl categorizes items into three main result statuses: * **Indexed:** Items successfully added or updated in the AI Search index. * **Not Indexed:** Items failed to be added or updated due to processing errors. * **Skipped:** Items discovered but not indexed for reasons such as: * Exclusion by inclusion/exclusion filters set in connector crawl settings. * Unsupported binary file formats (only supported formats are indexed). * Files exceeding the 25 MB size limit. * Items exceeding connector-specific content indexing limits (typically capped at 1 million items). * Items excluded by connector content validation rules. Note: Items in excluded folders or locations are not discovered and thus not counted as skipped. Customers can use the index inspector to review why individual items were skipped. ## Performance Statistics The crawl also tracks performance metrics such as the **Average Crawl Speed**, indicating how many documents were processed per second during the crawl. ## Practical Benefits for ServiceNow Customers * Gain clear visibility into the success and issues of content crawls to maintain a high-quality AI Search index. * Identify and troubleshoot indexing errors and warnings through detailed alert counts. * Understand filtering and file size constraints affecting content inclusion in the search index. * Monitor crawl performance to optimize indexing speed and resource usage. * Use the index inspector to investigate specific skipped items for precise content management. Each crawl history entry for an external content connector's content crawl includes statistics about the documents (items or files with searchable content and metadata) retrieved by the crawl. {#document-statistics-external-content-connectors__table_ivm_wxv_5gc__entry__2} | Document statistics entry | Description | |-|-| | Indexed | Score shows the total number of new and updated items that were successfully processed by the content crawl and are included in the AI Search index. | | Added | Score shows the number of items that were added to the AI Search index by the content crawl. | | Updated | Score shows the number of items that were updated in the AI Search index by the content crawl. | | Deleted | Score shows the number of items that were deleted from the AI Search index by the content crawl. | | Unchanged | Score shows the number of items that were processed by the content crawl without requiring changes to the AI Search index. | | Error | Score shows the number of Error-level alerts recorded for the content crawl. Select Details to view the Alerts tab for the crawl history entry. | | Warning | Score shows the number of Warning-level alerts recorded for the content crawl. Select Details to view the Alerts tab for the crawl history entry. | | Discovered | Score shows the total number of items that were processed during the content crawl. Chart shows the number of items processed by the content crawl for each result status shown in the following Discovered item result statuses table. | [Table 1. Document statistics entries] {#document-statistics-external-content-connectors__table_ivm_wxv_5gc} {#document-statistics-external-content-connectors__table_jkg_htx_skc__entry__2} | Result status | Description | |-|-| | Indexed | The number of items successfully added to or updated in the AI Search index. | | Not indexed | The number of items that weren't added to or updated in the AI Search index because of processing errors. | | Skipped | The number of items that were discovered but not added to or updated in the AI Search index. This count includes the following items: Items excluded by an inclusion or exclusion filter specified in the connector's crawl settings : The connector skips a content item if it's not included in your specified inclusion filter. It similarly skips an item if it's explicitly included in your specified exclusion filter. Note: Items in folders or other locations that are excluded by your inclusion or exclusion filter aren't discovered and so aren't included in the Skipped count. Binary files or attachments with unsupported formats : The connector skips binary files and attachments with unsupported formats. For the list of supported binary file formats, see [Binary file extensions supported in External Content Connectors](https://www.servicenow.com/docs/wyAI934z2WbwQ_js9LjRqA "Connector administrators can restrict the binary file types an external content connector retrieves by specifying file extensions in inclusion or exclusion filters."). Binary files or attachments that exceed the maximum attachment file-size limit : The connector skips binary files and attachments that exceed the 25 MB maximum file-size limit. Items in excess of the connector's content indexing limit : When the connector reaches its content indexing limit, it skips all newly found content items. Most connectors are limited to indexing a maximum of one million content items, but some connector types have different content indexing limits. Items excluded by connector content validation rules : Individual external content connectors may skip content items for other reasons. To see why a content item was skipped, you can view its record in the index inspector. For details about using the index inspector, see [Review indexing status for individual content items](https://www.servicenow.com/docs/iAZ0CAELaN59jPjhPo3iPg "View indexing status, selected fields, errors, and user and group access permissions for individual content items using the Index inspector tool in the external content connector editor."). | [Table 2. Discovered item result statuses] {#document-statistics-external-content-connectors__table_jkg_htx_skc} {#document-statistics-external-content-connectors__table_svq_4nz_ygc__entry__2} | Performance statistics entry | Description | |-|-| | Average crawl speed | Score shows the average speed of the content crawl, expressed in documents (items) processed per second of crawl time. | [ ] {#document-statistics-external-content-connectors__table_svq_4nz_ygc}