INTEGARTION - Pagination

gj1
Kilo Expert

Hi Community
We have used Integration hub and we are fetching data through integration by using Flow-designer, We recently faced an issue of size limit as the data fetched is exceeding 5mb so as an interim solution we created a system property and increased the limit to 10mb, so in the long run , we were advised to use pagination concept and here are the below details that i am looking for and that would help me out :
1.We were asked to hit the platform 1st time to fetch the total records and the number of pages that it further require to hit the target instance.
2.what changes do we need to make at ServiceNow end to achieve pagination.
3.Would it have any performance issues if we run this using pagination method as it would loop itself multiple times until the data is fetched.


3 REPLIES 3

Maik Skoddow
Tera Patron
Tera Patron

Hi

please check the following resources:

Kind regards
Maik

 

Hi @gj 

In case you think I was able to answer your question, I would be happy if you mark the appropriate response as "correct" so that the question will appear as resolved for other users who may have a similar question in the future.

If not, please tell me what you are still missing!

Many thanks & kind regards
Maik

gj1
Kilo Expert

Hi Maik @Maik Skoddow 


Thankyou for the reply and sorry to trouble you but your help here would be of great help to us.

 
We did set up everything but the data that is being fetched doesn't have any KEY in it where we can use it in ITEM PATH of the Splitter step, and we are receiving only arrays.

find_real_file.png
We tried all the possibilities by giving all arrays as a combination like $.name.id.A.B.C.D but even then it didn't help, So any suggestion or solution to this would be of great help to me.

This is the response we are getting into the system through REST API :

[
  {
    "email2": "__USER_EMAIL_2__",
    "salesrepId": "",
    "name": "xyz",
    "id": "00000000-0000-0000-0000000000000000",
    "active": 1,
    "username": "__USER_USERNAME__",
    "email": "__USER_EMAIL__",
    "groups": [
      {
        "name": "abcd",
        "id": "00000000-0000-0000-0000000000000000"
      },
      {
        "name": "qrst",
        "id": "00000000-0000-0000-0000000000000000"
      }
    ]