Run two or three "Text index events process" jobs at the same time

mzak
Tera Expert

Hello,
I would like to ask if you have some experiences with running of System Scheduled job "Text index events process" if there will be two or three copies of this job at the same insance and runs in parallel.
We have sometimes problem with too many text indexes in event queue which we can't disabled because we need them for search, but if there is only one text index event process job then everything runs only on one node. We tried to create a copy of this job and run these two jobs together on two different nodes and processing of text indexes was faster.
But I'm not sure if this is correct setup and if there can be some impact to instance and search.
So I would like to ask you for you experiences and recommendations in this problem.

Thank you,
Martin

3 REPLIES 3

Maik Skoddow
Tera Patron
Tera Patron

Hi mzak

in my current project, I'm implementing some high performance importing and processing activities on the same base as you described.

And running several jobs on each node to process same event types is a common and also recommended way by ServiceNow to speed up processing time and spreading the load to different nodes. So everything you made was correct, and thanks for tip with the adding another processor job for text_index events. I will try this out as I also have tons of text_index events.

And finally I don't see any problems. Even with several processing jobs an event is always processed by one job. You can convince yourself by adding the column "claimed by" to the list view. You will see that an event is always processed once by a single dedicated job/node.

Kind regards
Maik

Hi Maik,

Iam having a similar issue where huge amount of text_index events are registered in the backlog. how well can we handle it ? It is blocking other jobs to execute. Can we make this job execute on a different node so that it would not affect other job executions ? If it is feasible, what are the configurations required ?

 

Thanks

Ganapati

mzak
Tera Expert

Hi Maik,

thank you for your answer and confirmation of the way that I used.

Martin