AZURE DISCOERY FAILURE ON RESOURCE INVENTORY IDENTIFICATION STEP FROM Azure Resource Inventory PATTERN

randytangco
Mega Guru

‎03-24-2020 08:50 AM

Hello.  I need help troubleshooting a failure in the resource inventory identification step of horizontal discovery using the Azure Resource Inventory pattern.  I adjusted the size of the mid.sm.discolog.max_object_size from 1000 to 2000 and that did not resolve the failure.

Below is the horizontal discovery log.

=======

{
  "name" : "Discovery Log",
  "status" : "FAILURE",
  "children" : [ {
    "name" : "Pre Pattern Execution",
    "id" : "pre_pattern_execution_script",
    "status" : "SUCCESS",
    "level" : 2,
    "messages" : [ {
      "message" : "2020-03-24 15:37:32: Getting pre pattern execution data generated by script."
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(service_account,[{skip_sync=0, operational_status=1, discovery_credentials=95da4d23db6304104b6943ea139619c6, is_validated=1, discovery_source=ServiceNow, first_discovered=2020-03-20 13:28:08, datacenter_discovery_status=2020-03-20 06:31:03: Completed....Reload this form to see an updated datacenter list., object_id=ef225faf-3e3f-4892-bc20-1e782cf1fbba, install_status=1, name=Azure  Service Acct, last_discovered=2020-03-24 05:02:48, can_print=0, sys_class_name=cmdb_ci_cloud_service_account, monitor=0, datacenter_type=cmdb_ci_azure_datacenter, cost_cc=USD, account_id=ef225faf-3e3f-4892-bc20-1e782cf1fbba, should_pull_events=0, attested=0, unverified=0, fault_count=0, is_master_account=0, sys_id=5c605d27db6304104b6943ea13961926}])",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(hosted_relation_type,Hosted on::Hosts)",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(pre_resource_whitelist,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_azure_datacenter,[{skip_sync=0, operational_status=1, discovery_source=ServiceNow, first_discovered=2020-03-20 13:31:03, object_id=westus2, install_status=1, discovery_status=4124923cdb370810bd48c39d13961970, name=West US 2, region=westus2, last_discovered=2020-03-24 05:02:39, can_print=0, sys_class_name=cmdb_ci_azure_datacenter, monitor=0, cost_cc=USD, attested=0, unverified=0, fault_count=0, sys_id=fa01d567db6304104b6943ea13961946}])",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(ldc,[{skip_sync=0, operational_status=1, discovery_source=ServiceNow, first_discovered=2020-03-20 13:31:03, object_id=westus2, install_status=1, discovery_status=4124923cdb370810bd48c39d13961970, name=West US 2, region=westus2, last_discovered=2020-03-24 05:02:39, can_print=0, sys_class_name=cmdb_ci_azure_datacenter, monitor=0, cost_cc=USD, attested=0, unverified=0, fault_count=0, sys_id=fa01d567db6304104b6943ea13961946}])",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(hosted_relation_id,5f985e0ec0a8010e00a9714f2a172815)",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(build_relation_auto,true)",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(pattern_runtime_mode,horizontal)",
      "severity" : "DEBUG"
    } ],
    "type" : "NONE"
  }, {
    "name" : "Selecting Pattern for Execution",
    "id" : "set_pattern_name",
    "status" : "SUCCESS",
    "level" : 2,
    "messages" : [ {
      "message" : "2020-03-24 15:37:32: Pattern: Azure Resource Inventory"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(pattern,Azure Resource Inventory)",
      "severity" : "DEBUG"
    } ],
    "type" : "NONE"
  }, {
    "name" : "Process Detection",
    "status" : "SUCCESS",
    "level" : 2,
    "type" : "NONE"
  }, {
    "name" : "Resource Inventory Identification",
    "status" : "FAILURE",
    "children" : [ {
      "name" : "Check Azure credentials",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:33: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Set Azure discovery name",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:33: setAttribute(azureType,Generic)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:33: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Set Azure query",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:33: setAttribute(azureQuery,https://management.azure.com/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resources?$top=50&api-version=2018-05-01)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:33: Execution time: 15 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Get generic resources paginated and collect tags",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_list,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(cmdb_key_value,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(response,)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: Execution time: 6750 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Filter out empty tag keys",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:40: setAttribute(cmdb_key_value,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Parse resource response",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/appsvc_windows_centralus/providers/Microsoft.Compute/virtualMachines/WMACDSVM%22,%22name%22:%22WMACDSVM_OsDisk_1_54e0588bd99d4bc786d37f6c0843bc0a%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/APPSVC_WINDOWS_CENTRALUS/providers/Microsoft.Compute/disks/WMACDSVM_OsDisk_1_54e0588bd99d4bc786d37f6c0843bc0a%22,%22type%22:%22Microsoft.Compute/disks%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium_LRS%22%7D%7D,%7B%22name%22:%22WMACDSVM%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/appsvc_windows_centralus/providers/Microsoft.Compute/virtualMachines/WMACDSVM%22,%22type%22:%22Microsoft.Compute/virtualMachines%22%7D,%7B%22name%22:%22WMACDSVM/IaaSAntimalware%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22Aporeto-instance1/QualysAgentLinux%22,%22location%22:%22eastus%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/CS-AZURE-POC/providers/Microsoft.Compute/virtualMachines/Aporeto-instance1/extensions/QualysAgentLinux%22,%22type%22:%22Microsoft.Compute/virtualMachines/extensions%22%7D,%7B%22name%22:%22Aporeto-instance-2%22,%22location%22:%22eastus%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/CS-Azure-POC/providers/Microsoft.Compute/virtualMachines/Aporeto-instance-2%22,%22type%22:%22Microsoft.Compute/virtualMachines%22,%22tags%22:%7B%22Name%22:%22Aporeto-pvt%22%7D%7D,%7B%22name%22:%22Aporeto-instance-2/OmsAgentForLinux%22,%22location%22:%22eastus%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/CS-AZURE-POC/providers/Microsoft.Compute/virtualMachines/Aporeto-instance-2/extensions/OmsAgentForLinux%22,%22type%22:%22Microsoft.Compute/v",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22SecurityCenterFree(DefaultWorkspace-ef225faf-3e3f-4892-bc20-1e782cf1fbba-EUS2)%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/DefaultResourceGroup-EUS2/providers/Microsoft.OperationsManagement/solutions/SecurityCenterFree(DefaultWorkspace-ef225faf-3e3f-4892-bc20-1e782cf1fbba-EUS2)%22,%22type%22:%22Microsoft.OperationsManagement/solutions%22,%22plan%22:%7B%22product%22:%22OMSGallery/SecurityCenterFree%22,%22name%22:%22SecurityCenterFree(DefaultWorkspace-ef225faf-3e3f-4892-bc20-1e782cf1fbba-EUS2)%22,%22promotionCode%22:%22%22,%22publisher%22:%22Microsoft%22%7D%7D,%7B%22kind%22:%22v12.0%22,%22name%22:%22nestletest%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/DefaultResourceGroup-EUS2/providers/Microsoft.Sql/servers/nestletest%22,%22type%22:%22Microsoft.Sql/servers%22,%22tags%22:%7B%7D%7D,%7B%22managedBy%22",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22B2CNEWTEST.onmicrosoft.com%22,%22location%22:%22unitedstates%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/IAM/providers/Microsoft.AzureActiveDirectory/b2cDirectories/B2CNEWTEST.onmicrosoft.com%22,%22type%22:%22Microsoft.AzureActiveDirectory/b2cDirectories%22,%22sku%22:%7B%22tier%22:%22A0%22,%22name%22:%22Standard%22%7D,%22tags%22:%7B%7D%7D,%7B%22kind%22:%22StorageV2%22,%22name%22:%22dineshmyname%22,%22location%22:%22southindia%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/IoT-Security-Practice-RG1-dinesh/providers/Microsoft.Storage/storageAccounts/dineshmyname%22,%22type%22:%22Microsoft.Storage/storageAccounts%22,%22sku%22:%7B%22tier%22:%22Standard%22,%22name%22:%22Standard_RAGRS%22%7D,%22tags%22:%7B%7D%7D,%7B%22name%22:%22IoTAcademy%22,%22location%22:%22southindia%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/IoT-Security-",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22kind%22:%22shared%22,%22name%22:%22374a501a-d890-43ec-b3ad-845d606a4788%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Insights/workbooks/374a501a-d890-43ec-b3ad-845d606a4788%22,%22type%22:%22Microsoft.Insights/workbooks%22,%22tags%22:%7B%22hidden-title%22:%22Office%20365%20-%20SIAA%22%7D%7D,%7B%22kind%22:%22shared%22,%22name%22:%224d0fef71-2b13-408e-88d1-59c2d4dc6d47%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Insights/workbooks/4d0fef71-2b13-408e-88d1-59c2d4dc6d47%22,%22type%22:%22Microsoft.Insights/workbooks%22,%22tags%22:%7B%22hidden-title%22:%22Insecure%20Protocols%20-%20SIAA%22%7D%7D,%7B%22kind%22:%22shared%22,%22name%22:%22517bab1b-5d31-4c85-9994-719523a662fb%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/res",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22ThreatIntelligenceDashboard-SIAA%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Portal/dashboards/ThreatIntelligenceDashboard-SIAA%22,%22type%22:%22Microsoft.Portal/dashboards%22,%22tags%22:%7B%22dashboardKey%22:%22ThreatIntelligenceDashboard%22,%22hidden-title%22:%22Threat%20Intelligence%20Dashboard%20-%20SIAA%22,%22workspaceName%22:%22SIAA%22,%22version%22:%221.2%22%7D%7D,%7B%22kind%22:%22StorageV2%22,%22name%22:%22kemisetti%22,%22location%22:%22centralindia%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Storage/storageAccounts/kemisetti%22,%22type%22:%22Microsoft.Storage/storageAccounts%22,%22sku%22:%7B%22tier%22:%22Standard%22,%22name%22:%22Standard_LRS%22%7D,%22tags%22:%7B%22ms-resource-usage%22:%22azure-cloud-shell%22%7D%7D,%7B%22kind%22:%22StorageV2%22,%22name%22:%22phishingema",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22VirusTotal%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/connections/VirusTotal%22,%22type%22:%22Microsoft.Web/connections%22%7D,%7B%22name%22:%22AbuseIPDB%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/customApis/AbuseIPDB%22,%22type%22:%22Microsoft.Web/customApis%22%7D,%7B%22name%22:%22TEST%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/customApis/TEST%22,%22type%22:%22Microsoft.Web/customApis%22%7D,%7B%22name%22:%22VirusTotal%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/customApis/VirusTotal%22,%22type%22:%22Microsoft.Web/customApis%22%7D,%7B%22kind%22:%22func",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/virtualMachines/WCAE-DBserver2%22,%22name%22:%22WCAE-DBserver2_OsDisk_1_8d993710f56c43d999ce4d8bd4a012e1%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/disks/WCAE-DBserver2_OsDisk_1_8d993710f56c43d999ce4d8bd4a012e1%22,%22type%22:%22Microsoft.Compute/disks%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium_LRS%22%7D%7D,%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/virtualMachines/WCAE-F5-BigIPVE%22,%22name%22:%22WCAE-F5-BigIPVE_OsDisk_1_236c658cec2e44fba9ceb2b619e74760%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/disks/WCAE-F5-BigIPVE_OsD",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22WCAE-CloudEnv%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Network/virtualNetworks/WCAE-CloudEnv%22,%22type%22:%22Microsoft.Network/virtualNetworks%22%7D,%7B%22kind%22:%22Storage%22,%22name%22:%22wcaergdiag%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Storage/storageAccounts/wcaergdiag%22,%22type%22:%22Microsoft.Storage/storageAccounts%22,%22sku%22:%7B%22tier%22:%22Standard%22,%22name%22:%22Standard_LRS%22%7D,%22tags%22:%7B%7D%7D,%7B%22name%22:%22wcaepanfw2%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAEPANFW2/providers/Microsoft.Compute/virtualMachines/wcaepanfw2%22,%22type%22:%22Microsoft.Compute/virtualMachines%22,%22plan%22:%7B%22product%22:%22vmseries1%22,%22name%22:%22byol%",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22NestleTest/Policy_81%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Automation/automationAccounts/NestleTest/runbooks/Policy_81%22,%22type%22:%22Microsoft.Automation/automationAccounts/runbooks%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22NestleTest/Policy_84%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Automation/automationAccounts/NestleTest/runbooks/Policy_84%22,%22type%22:%22Microsoft.Automation/automationAccounts/runbooks%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22NestleTest/policy_86%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Automation/automationAccounts/NestleTest/runbooks/policy_86%22,%22type%22:%22Microsoft.Automation/automationAccounts/r",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/virtualMachines/WMAC-SNOW%22,%22name%22:%22WMAC-SNOW_OsDisk_1_ad9d29f6216949a6a72fee6ec350b1ed%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCENV/providers/Microsoft.Compute/disks/WMAC-SNOW_OsDisk_1_ad9d29f6216949a6a72fee6ec350b1ed%22,%22type%22:%22Microsoft.Compute/disks%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium_LRS%22%7D,%22tags%22:%7B%22Name%22:%22WMAC-SNOW%22%7D%7D,%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/virtualMachines/WMAC-SyslogSrv%22,%22name%22:%22WMAC-SyslogSrv_DataDisk_0%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/disks/WMAC-Sy",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22WMAC-ePO-WC/MicrosoftMonitoringAgent%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCENV/providers/Microsoft.Compute/virtualMachines/WMAC-ePO-WC/extensions/MicrosoftMonitoringAgent%22,%22type%22:%22Microsoft.Compute/virtualMachines/extensions%22%7D,%7B%22name%22:%22WMAC-ePOSrv%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/virtualMachines/WMAC-ePOSrv%22,%22type%22:%22Microsoft.Compute/virtualMachines%22%7D,%7B%22name%22:%22WMAC-ePOSrv/MicrosoftMonitoringAgent%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCENV/providers/Microsoft.Compute/virtualMachines/WMAC-ePOSrv/extensions/MicrosoftMonitoringAgent%22,%22type%22:%22Microsoft.Compute/virtualMachines/extensions%22%7D,%7B%22name%22:%22WMAC-",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22emailNotificationActionGroup%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/microsoft.insights/actiongroups/emailNotificationActionGroup%22,%22type%22:%22microsoft.insights/actiongroups%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22Migration_AG1%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/microsoft.insights/actiongroups/Migration_AG1%22,%22type%22:%22microsoft.insights/actiongroups%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22Migration_AG2%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/microsoft.insights/actiongroups/Migration_AG2%22,%22type%22:%22microsoft.insights/actiongroups%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22Test%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22wmac-qulys-vmid493%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/networkInterfaces/wmac-qulys-vmid493%22,%22type%22:%22Microsoft.Network/networkInterfaces%22,%22tags%22:%7B%22Name%22:%22WMAC-Qulys-VMID%22%7D%7D,%7B%22name%22:%22wmac-qulys-vmidcheck283%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/networkInterfaces/wmac-qulys-vmidcheck283%22,%22type%22:%22Microsoft.Network/networkInterfaces%22,%22tags%22:%7B%22Name%22:%22WMAC-Qulys-VMIDCheck%22%7D%7D,%7B%22name%22:%22wmac-snow1189%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/networkInterfaces/wmac-snow1189%22,%22type%22:%22Microsoft.Network/networkInterfaces%22,%22tags%22",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22WMAC-Transit-Route%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/routeTables/WMAC-Transit-Route%22,%22type%22:%22Microsoft.Network/routeTables%22%7D,%7B%22name%22:%22WMACROUTE-INTERNAL%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/routeTables/WMACROUTE-INTERNAL%22,%22type%22:%22Microsoft.Network/routeTables%22%7D,%7B%22name%22:%22WMAC-VGW%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/virtualNetworkGateways/WMAC-VGW%22,%22type%22:%22Microsoft.Network/virtualNetworkGateways%22%7D,%7B%22name%22:%22vNet%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/p",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22NestleTest%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC_NestleTest/providers/Microsoft.ContainerRegistry/registries/NestleTest%22,%22type%22:%22Microsoft.ContainerRegistry/registries%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium%22%7D,%22tags%22:%7B%7D%7D,%7B%22name%22:%22WMAC_Nestle-NetAppTest%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC_NestleTest/providers/Microsoft.NetApp/netAppAccounts/WMAC_Nestle-NetAppTest%22,%22type%22:%22Microsoft.NetApp/netAppAccounts%22%7D,%7B%22name%22:%22WMAC_Nestle-NetAppTest/Pool_NetApp_S_4%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC_NestleTest/providers/Microsoft.NetApp/netAppAccounts/WMAC_Nestle-NetAppTest/capacityPools/Pool_NetApp_S_4%22,%22type%22:%22Microsoft.NetApp/n",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: Execution time: 1922 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Resource type to lowercase",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: Execution time: 47 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Filter resources according to LDC",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: Execution time: 16 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Abort incase no resources in LDC",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:41: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Adjust whitelist",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(pre_resource_whitelist,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 15 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Filter resources according to whitelist",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(merged_resource,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Collect all resources when whitelist is empty",
      "status" : "NOP",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: Step condition is false. step not executed.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Abort incase no resources match whitelist",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Remove duplicate entries",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(merged_resource,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: setAttribute(tmp,)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Create Generic CI",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(cmdb_ci_cmp_resource,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Reference Generic CI tags",
      "status" : "FAILURE",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: Relation and/or reference table cmdb_key_value is not a known CI Type. Check the discovery logs for more details.",
        "severity" : "ERROR"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    } ],
    "level" : 2,
    "type" : "IDENTIFICATION_SECTION_TYPE"
  }, {
    "name" : "discovery",
    "id" : "discovery",
    "status" : "FAILURE",
    "children" : [ {
      "name" : "Check Processing Success",
      "id" : "Check Processing Success",
      "status" : "FAILURE",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 08:38:38: Identification Engine: Discovery status is FAILURE, Identification sections in pattern failed: section: Resource Inventory Identification, error: Relation and/or reference table cmdb_key_value is not a known CI Type. Check the discovery logs for more details..  "
      } ],
      "type" : "NONE"
    } ],
    "level" : 2,
    "type" : "NONE"
  } ],
  "level" : 0,
  "messages" : [ {
    "message" : "2020-03-24 15:37:32: Task is running on MID server azure_mid",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  } ],
  "type" : "NONE"
}

 

@Randy Tangco 

Labels:
0 Helpfuls
  • 1,304 Views
7 REPLIES 7

Community Alums
Not applicable
In response to randytangco

‎07-06-2021 11:42 AM

@randytangco Could you share how you were able to resolve the issue with the missing record?  I believe I am facing the same issue.

0 Helpfuls

Sai Basireddy
Tera Contributor

‎10-27-2020 11:36 AM

Here is the related KB Article for resolving the issue Azure Resource Inventory pattern error

0 Helpfuls

Community Alums
Not applicable
In response to Sai Basireddy

‎07-06-2021 11:17 AM

Hello Sai,

I logged into HI and do not have permission to see the article.  Are you able to open this up to logged in users? 

0 Helpfuls