Normalization and transformation data jobs
Summarize
Summary of Normalization and Transformation Data Jobs
The system utilizes data jobs to modify field values during normalization and transformation processes. Administrators are required to manually initiate these data jobs. By default, transformation records open in Test mode, preventing manual execution of data jobs on existing data. Most data jobs include a rollback feature to reverse changes post-completion.
Show less
Key Features
- Pending Value Collection: Collects field values for the next normalization run without altering existing values, hence no rollback option is available.
- Normal Value Change: Updates field values when a normal value is changed. The data job allows rollback to revert to previous values.
- Alias Application: Normalizes field values matching a specific alias. Rollback is available to revert normalized fields to their previous state.
- Rule Application: Normalizes field values based on defined rules, with rollback options to restore previous values.
- Coalesce to Normal: Normalizes reference field values by consolidating duplicates into one reference, with rollback restoring duplicate records as valid options (but not previous references).
- Transform Application: Transforms field values according to specified conditions. This job cannot run while the Transformation record is in Test mode and allows for rollback to previous values.
Key Outcomes
By utilizing these data jobs, ServiceNow customers can effectively manage data normalization and transformation, ensuring data integrity and consistency across their systems. The rollback feature provides a safety net, allowing administrators to revert changes as necessary, thereby maintaining control over data modifications.
The system uses data jobs to change field values during normalization and transformation.
Administrators must manually start data jobs that apply field changes. All transformation records open in Test mode by default, which blocks administrators from running manual data jobs that apply changes to existing data. Most data jobs have a roll back option to revert changes after the job completes. By default, the system provides these data jobs.
If the Field Normalization plugin is active, the normalization engine executes on insert of records into a table according to normalization rules. To learn more about this plugin, see Activate Field Normalization.
If the Field Normalization plugin is not active, a data job runs to normalize the values. The data job saves the previous values in the rolled back fields to revert them if necessary.
| Name | Used for | Description |
|---|---|---|
| Pending value collection | Normalization | The system runs this job to collect field values that will change during the next field normalization run. The system runs this job whenever you insert or update a field normalization record. Since this data job does not change any field values, there is no roll back option. |
| Normal value change | Normalization | Run this job to rerun field normalization and update field values when you change a normal value. The system creates this job whenever you change a normal value. Roll back the data job to revert the normalized fields to the previous normal value. |
| Alias application | Normalization | Run this job to normalize all field values that match an alias. The system creates this job whenever you create or update an alias. Roll back the data job to revert normalized fields to their previous values. |
| Rule application | Normalization | Run this job to normalize all field values that match a rule. The system creates this job whenever you create or update a rule. Roll back the data job to revert normalized fields to their previous values. |
| Coalesce too normal | Normalization | Run this job to normalize the reference field values by replacing references to multiple duplicate records with one reference to a normalized record. The system creates this job whenever you change a normal value that applies to a reference field. Roll back the data job to restore the duplicate records as valid options. The rollback does not restore references to the previous records. |
| Transform application | Transformation | Run this job to transform all field values that match the transformation conditions. You cannot start this job while the Transformation record is in Test mode. The system creates this job whenever you create or update a transformation record. Roll back the data job to revert transformed fields to their previous values. |