Receiving HTTP 401 Errors When Multi-threading Data Extracts via REST API

David Schafer · ‎11-25-2024

All,

We are attempting to extract tables within the APM space into a Data Lake for the extended reporting capabilities we have available there. We are using the OOB 'table API' for this purpose.

During initial extract/load, we regularly run into a situation where one/several queued extract(s) receive a '401' error.

We have found that if we wait 15 minutes or so(somewhat unreliable), we can start again. Programming around this behavior is possible - but certainly not optimal.

Can someone shed some light on what might be happening here?

Thank you.

nateanderson · ‎11-25-2024

Depending on the number of threads, you might be maxing out the maximum simultaneous connections. In which you'll be put into a queue that has a timeout. Also important to note that this connection pool is shared with UI Transactions as well (anything that hits the Application Node via HTTPs).

It's been a while since I did any real testing on this to recall what HTTP Status would get returned. Ideally you'd get something like a 408 / 504 back... but SN might just dump the generic 401 un-authorized.

If you check the Service Account when this occurs, does it show locked out = true? This would happen if one of the threads is trying a bad PW for some reason..

Regarding the suggestion of cookies, the /api/now/table/{table_name} api does not leverage cookies, but instead requires authentication to be passed on every request. In that regard, are you using Basic Auth or OAuth? If it's possible to swap to some form of OAuth to get an access/refresh token... you might see some speed improvements as well. I've found in testing that the Basic Auth header has to be digested, salted, hashed, and tested on every API Call. Where an access token is just checked against the value on hand in the oauth_credentials table.

Anywho... bunch of stuff that may or may not help..

From a diagnostics point, if the system your using can "log the response payload" there might be some additional detail in there that could help isolate what's going on.

View solution in original post

David Schafer · ‎11-29-2024

Thanks for your input Kieran.