How to run the look up records in batches

[Prithvi Ramesh1]

There are a total of 90,000 records in the sys_user table, which need to be used in a Lookup Records action. By default, the action retrieves only 1,000 records. How can we run the flow in batches to process all records each time it executes?

[M Iftikhar]

Hi @Prithvi Ramesh1 ,

To handle all 90,000 sys_user records in Flow Designer, you must run the flow in batches, because Lookup Records has a 1,000-record limit. 

For more detail and patterns, see:

• Max results in Lookup Records Flow Action

• ServiceNow Docs – Lookup Records Action

• Workato – Search Records Action

• How to process large number of records in batch (Scheduled)

• Flow or Subflow batch processing of records

Thanks & Regards,
Muhammad Iftikhar
If my response helped, please mark it as the accepted solution so others can benefit as well.

[Mark Manders]

What's your use case that you need more than 1000 records returned in a flow action? Performing actions on that many records could become a performance issue. 

[mayankkumar]

Hi @Prithvi Ramesh1,
Please refer this article -> Process Large Data Sets Smoothly with Flow Designe... - ServiceNow Community
-------------------------------------------------------------------------------------------------------------------------------------------------
Please mark my response helpful and accept as solution
Thanks & Regards
Mayank

[Ankur Bawiskar · Accepted solution]

@Prithvi Ramesh1 

what's your actual business requirement?

You can always apply some filter to reduce the records

OR

You can use Custom Flow Action and use GlideRecord there

If my response helped please mark it correct and close the thread so that it benefits future readers.