question Re: [PA AppSec] Daily Data Collection completed with error email in ITSM forum

[PA AppSec] Daily Data Collection completed with error email

sbh — Fri, 16 Apr 2021 22:39:10 GMT

For the first time in the over 2 years we've been using ServiceNow, I got an email in my SNow admin email account with subject "[PA AppSec] Daily Data Collection completed with error". I found the PA job log and filtered for Level = error and got the error below. PDFs, screenshots attached. Does anyone have any idea what could have generated this or where I should look to find more information? Thanks in advance for any help!

Error collecting for 20210416. Clearing the flushed snapshots for job run with log sys_id 9b4287ad1b6320108e1821f8bc4bcb9c java.lang.NullPointerException
   at com.snc.pa.dc.Row.getValue(Row.java:204)
   at com.snc.pa.db.PADBUtils.getPrimaryKeyValue(PADBUtils.java:235)
   at com.snc.pa.dc.DataCollector.map(DataCollector.java:1130)
   at com.snc.pa.dc.DataCollector.collect(DataCollector.java:542)
   at com.snc.pa.dc.DataCollector.collect(DataCollector.java:390)
   at com.snc.pa.dc.DataCollector.collect(DataCollector.java:302)
   at com.snc.pa.dc.DataCollectorJob.collect(DataCollectorJob.java:316)
   at com.snc.pa.dc.DataCollectorJob.collectWithMutex(DataCollectorJob.java:229)
   at com.snc.pa.dc.DataCollectorJob.execute(DataCollectorJob.java:214)
   at com.glide.schedule.JobExecutor.lambda$executeJob$0(JobExecutor.java:113)
   at com.glide.schedule.JobExecutor.executeJob(JobExecutor.java:116)
   at com.glide.schedule.JobExecutor.execute(JobExecutor.java:100)
   at com.glide.schedule_v2.SchedulerWorkerThread.executeJob(SchedulerWorkerThread.java:300)
   at com.glide.schedule_v2.SchedulerWorkerThread.lambda$process$0(SchedulerWorkerThread.java:188)
   at com.glide.worker.TransactionalWorkerThread.executeInTransaction(TransactionalWorkerThread.java:35)
   at com.glide.schedule_v2.SchedulerWorkerThread.process(SchedulerWorkerThread.java:188)
   at com.glide.schedule_v2.SchedulerWorkerThread.run(SchedulerWorkerThread.java:102)

Re: [PA AppSec] Daily Data Collection completed with error email

Surabhi7 — Tue, 20 Apr 2021 15:17:11 GMT

Hello,

Did you get any answer on this? We also started seeing this error in Paris.

Thanks,
Surabhi

Re: [PA AppSec] Daily Data Collection completed with error email

sbh — Tue, 20 Apr 2021 15:31:30 GMT

No, not yet. Yesterday I got an email from support that created a case for this issue. That, plus your experience, makes me wonder if a number of other people are experiencing this. If there's any progress on the case I'll post it here.

Thanks very much for writing. I'm sorry you're experiencing this too but it's good to know we're not the only ones.

Re: [PA AppSec] Daily Data Collection completed with error email

sbh — Thu, 22 Apr 2021 16:21:41 GMT

HI/support created a case from this post and they got back to me asking if we'd gotten the error more than once, and if we'd gotten it on subproduction instances too.

We only got this error once (that I know of) and that was on our production instance the day the Paris patch 7 was applied. Our dev and test instances didn't get this error when the patch was applied to them.

Re: [PA AppSec] Daily Data Collection completed with error email

ServiceNow Tec2 — Fri, 07 May 2021 21:33:21 GMT

This has been resolved by ServiceNow Technical Support. Please refer to KB0799486 for more information.

Re: [PA AppSec] Daily Data Collection completed with error email

Marek Krcma — Mon, 24 May 2021 13:46:35 GMT

Hi, I am also getting the same error for Problem management content pack PA daily job (Paris), sometimes it collects ok, sometimes it ends "Collected with errors". KB article posted here goes to documentation and did not find there how to resolve this issue.

Error collecting for 20210521. Clearing the flushed snapshots for job run with log sys_id 9a91ac95db14b410b79f99fbd3961960 java.lang.IllegalStateException: Sparse storage format has one field, sys_id
at com.glide.db.meta.SparseStorage.getValue(SparseStorage.java:70)
at com.snc.pa.dc.Row.getValue(Row.java:204)
at com.snc.pa.dc.Script.evaluate(Script.java:173)
at com.snc.pa.dc.DataCollector.evaluateScript(DataCollector.java:462)
at com.snc.pa.dc.DataCollector.collect(DataCollector.java:538)
at com.snc.pa.dc.DataCollector.collect(DataCollector.java:390)
at com.snc.pa.dc.DataCollector.collect(DataCollector.java:302)
at com.snc.pa.dc.DataCollectorJob.collect(DataCollectorJob.java:316)
at com.snc.pa.dc.DataCollectorJob.collectWithMutex(DataCollectorJob.java:229)
at com.snc.pa.dc.DataCollectorJob.execute(DataCollectorJob.java:214)
at com.glide.schedule.JobExecutor.lambda$executeJob$0(JobExecutor.java:113)
at com.glide.schedule.JobExecutor.executeJob(JobExecutor.java:116)
at com.glide.schedule.JobExecutor.execute(JobExecutor.java:100)
at com.glide.schedule_v2.SchedulerWorkerThread.executeJob(SchedulerWorkerThread.java:300)
at com.glide.schedule_v2.SchedulerWorkerThread.lambda$process$0(SchedulerWorkerThread.java:188)
at com.glide.worker.TransactionalWorkerThread.executeInTransaction(TransactionalWorkerThread.java:35)
at com.glide.schedule_v2.SchedulerWorkerThread.process(SchedulerWorkerThread.java:188)
at com.glide.schedule_v2.SchedulerWorkerThread.run(SchedulerWorkerThread.java:102)

Re: [PA AppSec] Daily Data Collection completed with error email

Surabhi7 — Mon, 24 May 2021 14:29:10 GMT

Hi, The root case of this was identified as corrupted Index file in Performance Analytics Text Index Configurations for indicator source.

Deleting the corrupted file solved the issue. We performed below steps for deletion. Please try these steps in some sub-prod instance first if it works for you.

1. Open the impacted job
2. Go to the corresponding Indicator and then the Indicator source
3. In the related list of Indicator Source - 'Performance Analytics Text Index Configurations ' , open the corresponding record which is associated with the date you see in error i.e Error collecting for 20210521. Clearing the flushed snapshots for job run with log sys_id

4. From the list , Delete the file generated for date / month mentioned in step 3
5. Execute the PA job.
6. Verify if the job is successful and the data is correct.
7. Rerunning the job should also regenerate the file again in Performance Analytics Text Index Configurations

Thanks

Surabhi

Re: [PA AppSec] Daily Data Collection completed with error email

Marek Krcma — Mon, 24 May 2021 14:53:36 GMT

Thank you Surabhi for your help. I will try it.

Marek

Re: [PA AppSec] Daily Data Collection completed with error email

Tamara11 — Mon, 04 Oct 2021 00:50:20 GMT

This link doesn't go to a kb article about the problem or to a potential resolution.

Apparently this has not been resolved. Our instance just started generating these messages today and we don't have PA activated.

Re: [PA AppSec] Daily Data Collection completed with error email

BethB — Fri, 12 Nov 2021 14:58:36 GMT

This link is not working correctly - having trouble accessing KB0799486

Re: [PA AppSec] Daily Data Collection completed with error email

Jenna — Wed, 18 May 2022 02:53:02 GMT

We are experiencing this same issue, but the link to the KB article isn't valid. Is there an answer for this? I tried the steps above but the indicator did not have a record under 'Performance Analytics Text Index Configurations '.

Re: [PA AppSec] Daily Data Collection completed with error email

sbh — Wed, 18 May 2022 19:28:39 GMT

A consultant who was working with us fixed this by upping the limit on the system property com.snc.pa.dc.max_records. Thank you, @Ofuoma Ikogho !

Re: [PA AppSec] Daily Data Collection completed with error email

Inactive_Use349 — Wed, 18 May 2022 19:37:32 GMT

You are most welcome @sbh

Re: [PA AppSec] Daily Data Collection completed with error email

Penny Cromwell — Thu, 18 Dec 2025 22:04:54 GMT

this KB number is bunk; this is the one I received when I opened a ticket for this; still waiting on support to reach out to me to resolve: KB1444281.