Export Sets | JSON Format | Is there an ability to split records onto their own line?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 11:40 AM - edited 04-03-2024 11:41 AM
When a JSON format export set is created, the entire contents of the export is on a single line. For large exports, especially at table that has a lot of fields, the single line will be quite large and causes issues with downstream processes trying to consume the export file. If each record were on its own line, there would not be an issue.
Currently, an export file looks like the following.
{"records":[{"id": 1},{"id": 2},{"id": 3},.....{"id": 4000000}]}
Is there any way to get each record onto its own line like the following?
{"records":[
{"id": 1},
{"id": 2},
{"id": 3},
...
{"id": 4000000}
]}
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 02:31 PM
No one would be consuming the json file manually.
code editor will have json beautifier options for your use case.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 02:41 PM
Not sure I understand your response. No one (person) would be consuming the JSON file manually. The JSON file is >16MB - in great part due to the number of columns/fields included which are necessary. Downstream external partners have trouble ingesting a file because the single line in the file is >16MB.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 02:48 PM
if there loading this json to a tool. it should not be a problem.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
04-03-2024 02:52 PM
The downstream partner is pre-staging the record into a database of some kind and because the record is on a single line in the export file, it is trying to be put into a single field wherein there is a 16MB limit on the size data.