Imported data is missing in the table

taqdeer · ‎06-26-2020

Hi All,

I have imported data into a table 7 days ago. I see that data is missing now. Table has become empty. I understand that there will be schedule cleanup for import sets once in a wee. but that is to delete the import set information not the data right? Can any one please tell me what would have been happened?

Joshton1 · ‎06-26-2020

Hello Taqdeer,

The data in the import set table is also cleaned,

You can refer the script include - "ImportSetCleaner "called from the Scheduled job - Import set Deleter .

The clean() Function called, queries the import sets first and then if import set is available it also has a call for removeData and then that calls TableClean,

--------------------------

clean : function() {
var isets = this._queryIsets();

while(isets.length > 0) {
this._removeData(isets);

-------------------------

So to conclude yes the data is also cleaned form the import set extended table which is your staging table.

Thanks,

Joshton

View solution in original post

Pradeep Sharma · ‎06-26-2020

Hi Taqdeer,

Yes, you are right. The import set table will delete the import set records and not records in the target table. Do you have any fix script or scheduled script to delete records in the target table? Hard to debug without having access to your instance.

- Pradeep Sharma

Ashutosh Munot1 · ‎06-26-2020

HI,

The data is flushed after 7 days as well.

YOu should check table cleanups for this.

Thanks,
Ashutosh

taqdeer · ‎06-26-2020

Hi Ashutosh,

I have checked the table clean ups and I don't see anything is responsible for data clean up.

The data is flushed after 7 days as well : Are you sure that data also will be deleted / flushed along with import set data information ?

Ashutosh Munot1 · ‎06-26-2020

Hi,

only the import set rows and data will be flushed but the target data should remain as it is.

Thanks,
Ashutosh