Normalization and transformation data jobs

  • Release version: Washingtondc
  • Updated February 1, 2024
  • 2 minutes to read
    • Summarize
    Summarized using AI
    This content was generated using new OpenAI-powered functionality. Results are provided on an as is basis and are not guaranteed to be accurate or complete.

    Summary of Normalization and Transformation Data Jobs

    The ServiceNow AI Platform utilizes data jobs for normalizing and transforming field values. Administrators are responsible for manually initiating these data jobs, which are essential for applying changes to existing data. By default, transformation records open in Test mode, preventing immediate execution of changes. Most data jobs include a rollback option to revert changes post-completion.

    Show full answer Show less

    Key Features

    • Pending Value Collection: Gathers field values for upcoming normalization runs without altering existing values; no rollback option available.
    • Normal Value Change: Updates field values based on changes to normal values; allows rollback to previous states.
    • Alias Application: Normalizes field values that match specified aliases; rollback restores prior values.
    • Rule Application: Normalizes field values based on defined rules; rollback capability included.
    • Coalesce to Normal: Normalizes reference fields to reduce duplicate records; rollback restores previous valid options but not references.
    • Transform Application: Executes transformations on field values per defined conditions; cannot run while in Test mode; rollback available.

    Key Outcomes

    By effectively managing these data jobs, ServiceNow customers can ensure data integrity through normalization and transformation processes. Administrators can revert changes when necessary, maintaining control over field values in their system. This functionality is crucial for keeping data consistent and aligned with operational requirements.

    The system uses data jobs to change field values during normalization and transformation.

    Administrators must manually start data jobs that apply field changes. All transformation records open in Test mode by default, which blocks administrators from running manual data jobs that apply changes to existing data. Most data jobs have a roll back option to revert changes after the job completes. By default, the system provides these data jobs.

    Note:

    If the Field Normalization plugin is active, the normalization engine executes on insert of records into a table according to normalization rules. To learn more about this plugin, see Activate Field Normalization.

    If the Field Normalization plugin is not active, a data job runs to normalize the values. The data job saves the previous values in the rolled back fields to revert them if necessary.

    Name Used for Description
    Pending value collection Normalization The system runs this job to collect field values that will change during the next field normalization run. The system runs this job whenever you insert or update a field normalization record. Since this data job does not change any field values, there is no roll back option.
    Normal value change Normalization Run this job to rerun field normalization and update field values when you change a normal value. The system creates this job whenever you change a normal value. Roll back the data job to revert the normalized fields to the previous normal value.
    Alias application Normalization Run this job to normalize all field values that match an alias. The system creates this job whenever you create or update an alias. Roll back the data job to revert normalized fields to their previous values.
    Rule application Normalization Run this job to normalize all field values that match a rule. The system creates this job whenever you create or update a rule. Roll back the data job to revert normalized fields to their previous values.
    Coalesce too normal Normalization Run this job to normalize the reference field values by replacing references to multiple duplicate records with one reference to a normalized record. The system creates this job whenever you change a normal value that applies to a reference field. Roll back the data job to restore the duplicate records as valid options. The rollback does not restore references to the previous records.
    Transform application Transformation Run this job to transform all field values that match the transformation conditions. You cannot start this job while the Transformation record is in Test mode. The system creates this job whenever you create or update a transformation record. Roll back the data job to revert transformed fields to their previous values.