String variable error when huge datasets are retrieved

themrindy
Tera Expert

‎08-28-2018 10:54 PM

String variable error when huge datasets are retrieved

I get this error message when retrieving responses from a REST endpoint.

InternalError: String object has exceeded maximum permitted size of 33554432

/C

 

 

Labels:
0 Helpfuls
  • 2,682 Views
3 REPLIES 3

SanjivMeher
Kilo Patron
Kilo Patron

‎08-28-2018 10:55 PM

Yes. There is a size limit in REST and you can't control it. You will have to get the data in chunks if possible.


Please mark this response as correct or helpful if it assisted you with your question.
0 Helpfuls

rags484
Kilo Contributor

‎01-27-2019 08:35 PM

I also have a similar issue.Any possible solution / Workaround?

0 Helpfuls

themrindy
Tera Expert

‎01-28-2019 01:44 AM

Hi,

After struggling with this and many business impacts trough out our Company. I decided to develop my own integration engine for huge datasets. 

 

Please see this blog post for detailed info how to do this. Feel free to use it and optimise.

https://gass.se/en/handle-huge-datasets-from-3rd-party-integrations/

Regards,

Christian, GASS

0 Helpfuls