Issue with Scheduled Exports

Sathwik1 · ‎11-28-2020

We had a scheduled Export export which used to export all the incident table data daily at 6.00 am

so I have unchecked "Appended Timestamp" so every time new data will replace in the MID Server..

For first time export all the records, but from second time only new records need to export...so this I can do by taking records which are updated last 24hrs...but here my issue is for saturday and sundays records...because in those two days the end users will not take data from the mid server..

so can any one suggest some alternative for this?

Ankur Bawiskar · ‎11-28-2020

@Sathwik

Yes if they don't pick it up then they will miss as the file doesn't have timestamp and it will get overridden.

So now you have 3 approaches here

1) Inform them to pick the files on Saturday and Sunday as that is by their requirement that they required daily files to be pushed for records updated in last 24hrs

OR

2) Append timestamp so that file doesn't get overridden

OR

3) Approach 3

a) Don't run your existing Scheduled Data Export on Saturday and Sunday using the Condition script

b) Create fresh Scheduled Data Export and make it run Daily; This would only run on Saturday.

Create fresh export Target for this and create Folder for Saturday Export and give that path

You can handle this via Condition Script.

c) Create fresh Scheduled Data Export and make it run Daily; This would only run on Sunday.

Create fresh export Target for this and create Folder for Sunday Export and give that path

You can handle this via Condition Script.

Easiest approach is 1st or 2nd But check with your client and business team on this

Regards
Ankur

Regards,
Ankur
✨ Certified Technical Architect || ✨ 9x ServiceNow MVP || ✨ ServiceNow Community Leader

View solution in original post

DirkRedeker · ‎11-28-2020

Hi

If you do not need the exports on Saturdays and Sundays separately, configure your scheduler, to export only on Monday through Friday and NOT on Saturdays and Sundays.

That way, the records from Saturday and Sunday will be exported automatically on Monday morning, what is what you need to do - as far as I understand...

Let me know if that answers your question and mark my answer as correct and helpful.

BR

Dirk

Sathwik1 · ‎11-28-2020

Hi @Dirk

Here I am using condition to take records from last 24 hrs only....

if schedule is running on monday then only sunday records will get then what about saturday schedue[friday to sat data] and sunday schedule[sat to sun data]?

DirkRedeker · ‎11-28-2020

Hi That may become an issue in the long run. I recommend to ALWAYS export those records, that have not been exported so far. Imagine, what would happen, if your scheduler did not run on some day and you just pick up the records from the last 24h. Then, certainly you will miss one day of records. It is best to always export the records "since last time". I guess the flag you set will automatically take care about it. Let me know if that answered your question and mark my answer as correct and helpful. BR Dirk

Sathwik1 · ‎11-30-2020

Dirk

That's correct, but there is a lot of data...for example I am using incident table..so I am exporting all the records daily, then there must be a performance issue right?

Sathwik1 · ‎12-30-2020

@Ankur Bawiskar

We had a requirement where we need to export a particular item catalog task info to MID Server for every 24hrs..

so I have created a schedule export where item name is "test" and updated a filter condition which takes data for last 24 hrs..

but here client requirement is...they need timestamp after the filename...so here I checked "append timestamp"

but due to this every day a new file is getting placed...here my question is...if daily one file is placing then after an year there will be 365 files in the mid server...so I want to know whether it will be an issue or not?

If issue..then there is any alternative to append timestamp after the file?

please help @Ankur Bawiskar It's a urgent requirement