Data Validation/Enrichment

[Jbelter]

Hi everyone,

One of the things I am trying to implement with a customer is better data validation so that we can ensure data integrity on the platform. I am curious to see what you guys think as far as what would be good to validate?

For example, ensure that IP addresses adhere to a legitimate IP address format (IPv4/IPv6). Or ensuring that a user can't select a day before "Today" as the start date of a Change Request.

Another part of this is data enrichment, so far we have implemented Discovery and have integrated with two Service Graph Connectors (Ordr and Tanium). I have implemented reconciliation rules to assign priority to data sources for specific CI classes. If there is anything else that I could add (that doesn't require extra plugins/cost) then fire away!

I would love to see what everyone can come up with!

[ColemanStr]

For data validation, you’re already on the right track with IP address and date validations. You might also consider validating email addresses to ensure they conform to standard formats, such as user@domain.com, using regular expressions for accuracy. It’s important to validate phone numbers to ensure they adhere to standard formats, which can vary by country. Numeric fields, such as prices, quantities, or scores, should be validated to ensure they fall within a reasonable range. Additionally, text fields should be checked for length constraints, special character restrictions, and adherence to required patterns like postal codes or serial numbers.

You should also ensure that unique fields, such as usernames or IDs, do not have duplicates to avoid potential issues. For relationships, make sure that foreign key references are valid and point to CRM data enrichment. Mandatory fields must be filled in, and null values should not be accepted where they are not allowed. For file uploads, validating file types, such as images or PDFs, and ensuring they do not exceed size limits is crucial.