How many records at a time should be imported in import set table for better performance?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎11-23-2017 11:11 PM
I wants to import bulk data from CSV file to an import set table?
What amount of data(number of rows) should i import for better performance, which do not create any issue?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎11-24-2017 12:05 AM
Importing data performance is based on multiple points, not a single one.
I would say to look at least at these points:
- you should proper coalesce fields for the import. The coalesce fields need to be indexed for better performance.
- do you really need to "Run business rules" on your import? If not, disable it and it will help performance
- what type of scripts are running for the import"? Before/after, etc
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎11-24-2017 12:38 AM
Thanks Sergui,
I am importing the csv data using the rest call and do not know what limit should set for that csv file.
The business rule as of now is not decided in transformation. we just want to let the user decide the business rule at UI and pust the records using rest call.
Thanks
Azam
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎11-24-2017 12:40 AM
Let me ask you this: have you tried importing all the data you have within one CSV file and had issues? If not, why not trying it in the first place and see what happens.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
‎11-24-2017 12:52 AM
Thanks Sergiu,
I tried with bulk data at UI didn't face any issue but do not know the maximum limit which i can fix for the user doint the same with the above POST call i mentioned.
Second thing is the url i mentioned giving me response 200 ok , but the data is not getting added in the import set table.
Can you please help me on this?
Thanks
Azam