Performance issue on the PDI

RobertH87910571
Kilo Explorer

When i am using RestAPI i am getting 500 errors occasionally.  How can I check the performance of the instance? I want to monitor the load of the instance with the polling I am doing for devices. I want to find out how i can improve or reduce amount of traffic my instance is getting for monitoring device health using app engine.

Thanks

4 REPLIES 4

Tarun Rekandar
Mega Guru

Hi @RobertH87910571,

 

You can start by checking System Logs > Transactions (syslog_transaction) to monitor the REST API requests coming from your integration user. Check the response time, SQL execution time, and Business Rule execution time to identify slow transactions.

 

Also, check System Logs > Errors around the time the 500 errors occur to identify any script-related issues.

To monitor instance performance, you can use:

  • Performance Homepage / stats.do – Monitor node health, memory, and semaphore usage.

  • Instance Observer – Monitor transactions, slow queries, and instance performance (if available).

  • REST API Rate Limit Rules – Control the number of inbound requests from your integration user.

To reduce unnecessary API traffic, consider the following approaches:

  1. Use sys_updated_on to retrieve only recently modified records instead of fetching all device records repeatedly.

  2. Use sysparm_fields and sysparm_limit to reduce response size.

  3. Use the REST Batch API to combine multiple requests.

  4. Introduce appropriate polling intervals and exponential backoff when API errors occur.

  5. Consider a push-based approach using Event Management, Event API, or Import Sets instead of frequent polling.

I would suggest first analyzing the transaction logs to understand whether the 500 errors are caused by instance load, slow queries, or script execution. Based on those findings, you can optimize the integration accordingly.

 

Accept the solution if it assisted you with your question & Mark this response as Helpful.


Regards,

Tarun

We looked further into the 500 errors. The request doesn't even reach the server. It looks like the load balancer is rejecting the requests. I am attaching the screenshot for curl requests. Is there anything we can do to reduce these 500 errors.

 

Thanks

Hi @RobertH87910571,

Check weather the API is working properly in the postman or not, if the API is working properly in postman then it will work properly in any integration.

Accept the solution if it assisted you with your question & Mark this response as Helpful.


Regards,

Tarun