SharePoint Online External Content Connector

Kynan1
Tera Contributor

I have configured the connector using a new MS App registration which has full control for all sites. 

I have set 6 specific sites to be indexed. Some of the content is indexed but I am getting 500 internal server error errors for 2 of the sites.  I can see that these sites and related document libraries have 10s of thousands of items as this SharePoint environment has been in use for over 10 years.  I suspect that the internal server errors are likely due to some MS API rate limit as the queries must be very large.  I can also see warnings in the SharePoint document libraries highlighting the fact that we are over the 5K document list view threshold. Copilot indexes these sites with no issues as I have read that MS has designed it to navigate these limits.  Is anyone else having similar issues and if so, what have you done to get around it? 

 

Here are the things I am seeing in the logs. 

 

Enumerating items for Document Library 'Site Pages' failed!

Cause: Unknown request failure!
Context: Batched request for version of list items.
Resolution: Please contact ServiceNow Support.

com.raytion.sdk.azure.datasource.event.DatasourceEventException: com.raytion.sdk.azure.datasource.clients.sharepoint.response.exception.DetailedHttpResponseException: status code: 500, reason phrase: Internal Server Error, response message: Cannot complete this action.  

1 REPLY 1

Kynan1
Tera Contributor

This is what copilot says about the errors. 

 

Your ServiceNow Raytion connector is sending a very large SharePoint REST $batch request to the Site Pages library to fetch item versions, and the call is timing out (java.net.SocketTimeoutException: Read timed out). The batch contains version lookups like Versions(636416) and Versions(69120), which are extremely high (likely invalid) for SharePoint item version indexes. The combination of oversized/invalid version requests and SharePoint throttling causes the POST to _api/$batch to fail.