Need help in loading the data through load data module?

ginjupalli
Kilo Contributor

I have a Excel file which has around 250 K records I want to load these records in my instance. How can I achieve this?

What is the maximum limit of the records that we can load through the load data module?  

1 ACCEPTED SOLUTION

nayanawadhiya1
Kilo Sage

For importing does not have limit criteria but for exporting the records has limit criteria for that 

Navigate to System Proerties -> Import Export 

Excel sheet is 1,048,576 rows so excel sheet contains 250K records in multiple sheets.

And I don't think there is a limit. However as a best practice Break a very large data set into multiple, smaller jobs for faster results. Consider import sets under 100,000 records as a guideline. For example, importing 10 sets of 100,000 records completes faster than one import of 1 million records even though the total data imported is the same.

 

View solution in original post

5 REPLIES 5

nayanawadhiya1
Kilo Sage

For importing does not have limit criteria but for exporting the records has limit criteria for that 

Navigate to System Proerties -> Import Export 

Excel sheet is 1,048,576 rows so excel sheet contains 250K records in multiple sheets.

And I don't think there is a limit. However as a best practice Break a very large data set into multiple, smaller jobs for faster results. Consider import sets under 100,000 records as a guideline. For example, importing 10 sets of 100,000 records completes faster than one import of 1 million records even though the total data imported is the same.

 

I have one more question how to do validation ones the file is loaded in to the system?

 

When you put Label then it will create a temporary Table as u_label like below check on that table - 

But it's a temporary data holder right. We Want to do validations ones the transform is done, i.e all the records are loaded in to the target table.