Export Sets | JSON Format | Is there an ability to split records onto their own line?

George Cutrell
Tera Expert

When a JSON format export set is created, the entire contents of the export is on a single line.  For large exports, especially at table that has a lot of fields, the single line will be quite large and causes issues with downstream processes trying to consume the export file.  If each record were on its own line, there would not be an issue.

 

Currently, an export file looks like the following.

{"records":[{"id": 1},{"id": 2},{"id": 3},.....{"id": 4000000}]}

 

Is there any way to get each record onto its own line like the following?

{"records":[
{"id": 1},
{"id": 2},
{"id": 3},
...
{"id": 4000000}
]}

5 REPLIES 5

luffy3478
Tera Guru

No one would be consuming the json file manually.

code editor will have json beautifier options for your use case.

Not sure I understand your response.  No one (person) would be consuming the JSON file manually.  The JSON file is >16MB - in great part due to the number of columns/fields included which are necessary.  Downstream external partners have trouble ingesting a file because the single line in the file is >16MB.

luffy3478
Tera Guru

if there loading this json to a tool. it should not be a problem.

The downstream partner is pre-staging the record into a database of some kind and because the record is on a single line in the export file, it is trying to be put into a single field wherein there is a 16MB limit on the size data.