Normalization and transformation data jobs
Summarize
Summary of Normalization and transformation data jobs
ServiceNow uses data jobs to modify field values during normalization and transformation processes. Administrators are required to manually trigger these data jobs to apply changes. By default, transformation records open in Test mode, preventing manual execution of data jobs that alter existing data. Most data jobs include a rollback feature to undo changes if needed.
Show less
Key Features
- Manual Execution: Administrators must start data jobs manually to apply field changes.
- Test Mode: Transformation records open in Test mode by default, blocking job execution until changed.
- Rollback Capability: Most data jobs allow reverting changes after job completion for safety and data integrity.
- Field Normalization Plugin: If active, normalization occurs automatically on record insertions based on rules; if inactive, normalization runs via data jobs preserving previous values for rollback.
Data Jobs and Their Purposes
- Pending value collection: Collects field values to be changed in the next normalization run; does not alter data and has no rollback.
- Normal value change: Applies normalization updates when a normal value changes; supports rollback to previous values.
- Alias application: Normalizes field values matching an alias; rollback reverts to previous values.
- Rule application: Normalizes field values based on rules; rollback restores prior values.
- Coalesce too normal: Normalizes reference fields by consolidating duplicates into a single normalized record; rollback restores duplicates as options but not previous references.
- Transform application: Applies transformations to field values matching conditions; cannot run while in Test mode; supports rollback to previous values.
Practical Implications for ServiceNow Customers
Administrators should understand that data jobs are essential tools for managing data consistency through normalization and transformation. They must manually trigger these jobs and manage rollback options to maintain data integrity. Activation of the Field Normalization plugin automates normalization during record inserts, reducing manual intervention. Awareness of each data job’s role helps efficiently manage data changes and recover from unintended modifications.
The system uses data jobs to change field values during normalization and transformation.
Administrators must manually start data jobs that apply field changes. All transformation records open in Test mode by default, which blocks administrators from running manual data jobs that apply changes to existing data. Most data jobs have a roll back option to revert changes after the job completes. By default, the system provides these data jobs.
If the Field Normalization plugin is active, the normalization engine executes on insert of records into a table according to normalization rules. To learn more about this plugin, see Activate Field Normalization.
If the Field Normalization plugin is not active, a data job runs to normalize the values. The data job saves the previous values in the rolled back fields to revert them if necessary.
| Name | Used for | Description |
|---|---|---|
| Pending value collection | Normalization | The system runs this job to collect field values that will change during the next field normalization run. The system runs this job whenever you insert or update a field normalization record. Since this data job does not change any field values, there is no roll back option. |
| Normal value change | Normalization | Run this job to rerun field normalization and update field values when you change a normal value. The system creates this job whenever you change a normal value. Roll back the data job to revert the normalized fields to the previous normal value. |
| Alias application | Normalization | Run this job to normalize all field values that match an alias. The system creates this job whenever you create or update an alias. Roll back the data job to revert normalized fields to their previous values. |
| Rule application | Normalization | Run this job to normalize all field values that match a rule. The system creates this job whenever you create or update a rule. Roll back the data job to revert normalized fields to their previous values. |
| Coalesce too normal | Normalization | Run this job to normalize the reference field values by replacing references to multiple duplicate records with one reference to a normalized record. The system creates this job whenever you change a normal value that applies to a reference field. Roll back the data job to restore the duplicate records as valid options. The rollback does not restore references to the previous records. |
| Transform application | Transformation | Run this job to transform all field values that match the transformation conditions. You cannot start this job while the Transformation record is in Test mode. The system creates this job whenever you create or update a transformation record. Roll back the data job to revert transformed fields to their previous values. |