Configure batch import for data
Configure batch import of data to specify the pagination method for importing large data sets.
Before you begin
Role required: sn_ac.automation_technical_user or sn_ac.automation_admin
Proceed from the Select an action section. For information on selecting a spoke, see Select an action.
Procedure
-
Provide the details on the form.
Table 1. Define source form Field Description Action details Review input and output details to customize the data flow for your specific needs. Select output type Select the output type value from the list. Only actions that have the output type as "array.output" have a value displayed here.
Select batch import method Select a batch import method. The right batch import method helps to manage data efficiently. Batching can help improve performance, handle errors, and ensure data freshness in large imports.
The following batch import methods are available:- None: Import data in a single request. Select this if you do not want to use the pagination method provided in Automation Center.
- Offset: Import data in batches using an offset value.
- Time based: Import data in batches based on time intervals.
- Token based: Import data in batches using a continuation token.
Generate flow template Select this button to generate a flow. After the flow is generated, edit it to set up input parameters and pagination for large imports.- Establish the necessary input parameters (static or dynamic): For example, when you import automation records from a third-party tool, send a dynamic value such as Automation Status, or a static value such as "Retry Limit = 3".
- Link pagination for large data sets: For example, if you have 1,000 or more automation records, setup the pagination to process 100 records per page by indicating both the page number and page size.
The flow is generated and you are guided to edit the flow.
-
Select Continue to edit flow.
The Workflow Studio page is displayed.Note:Edit the flow as per your requirement. For information on editing a flow, see Edit flow in Workflow Studio.
Do not activate the flow at this point.
-
Select Verify flow to verify if the flow is correct.
This step verifies if the selected action is available in the flow.
-
Select Save and continue.
The Verify and test section is displayed.