How do I set up a Data Source using REST (IntegrationHub) with pagination enabled .

MARKHOLDERN
Tera Contributor

I have created a data source to retrieve data from a REST source. Due to the size of the data that will be returned I need this to use pagination. Currently I have the data source set up as follows:
Type: REST (IntegrationHub)
Support Pagination: ticked
Limit: 100

Offset: 0

When I run this it only brings back 100 records, as the test data we have set up has 719 records I was expecting it to use pagination to bring back the full 719 records in blocks of 100 until all the records were retrieved.

Am I missing something that I need to configure in either the DataSource or the Request Action? The Docs I have found only speak about the options above but do not explain how this works in practice.

2 REPLIES 2

Omkar Kumbhar
Mega Sage

Thanks Omkar. Can this not be done using the type REST (IntegrationHub)? The Docs seem to imply it will work with that type? Create a REST (Integration Hub) type data source shows the Support Pagination option.

I was hoping not to have to use DataStreams as I've not used those before.