Instance Data Replication system properties

  • Release version: Xanadu
  • Updated August 1, 2024
  • 1 minute to read

    • These system properties control the behavior of the Instance Data Replication (IDR) application.

    To set IDR system properties, navigate to the System Properties [sys_properties] table and add the property.

    Table 1. IDR data comparison properties
    Property Description

    The record batch size for data comparison results

    idr.instance.comparison.batch.size

    		 If the data comparison results exceed 1 million records within the given date range, the request is divided into batches of 10,000 records.
    • Type: integer
    • Default value: 10,000

    The threshold for missing or mismatched records

    idr.dct.mismatched.missing.percentage.threshold

    		 If the number of missing or mismatched records exceeds 50% of the total records found within the given data range, the comparison stops and partial seeding is recommended for the given date range instead.
    • Type: integer
    • Default value: 50

    The maximum number of records

    idr.instance.comparison.max.records

    		 The maximum number of records allowed for processing a data comparison.
    • Type: integer
    • Default value: 500,000

    The maximum runtime

    idr.instance.comparison.max.runtime

    		 The maximum amount of time allowed for running a data comparison.
    • Type: integer
    • Default value: 15 minutes

    Fields to skip

    idr.dct.comparison.skip.fields

    		 The list of fields to skip when comparing records between instances.
    • Type: string
    • Default value: caller_id,sys_created_on,sys_created_by,sys_updated_on,sys_updated_by
    Table 2. System properties
    Property Description

    Stop replication if an out-of-order issue occurs

    idr.message.gap.order_enforcement.enabled

    		 By default, IDR stops replication if an out-or-order issue occurs on the consumer.

    You can change the default behavior when an out of order issue occurs on the consumer by adding this property and setting it to false. This automatically re-queues and replicates missing messages using the most recent record details from the producer without stopping replication.

    • Type: string
    • True: Stop replication
    • False: Don't stop replication and re-queue
    Note:
    Each producer and consumer instance must be on the same family version to use this property. Both instances must be on Vancouver or higher.

    Set attachment size limit

    idr.cdc.replication.table.reader.attachment.size    		 By default, IDR doesn't restrict the size of attachments.

    You can change the default behavior by adding this property and entering a maximum size for attachments.

    • Type: integer (size in bytes)
    • Default value: 100,000,000