AZURE DISCOERY FAILURE ON RESOURCE INVENTORY IDENTIFICATION STEP FROM Azure Resource Inventory PATTERN

randytangco
Mega Guru

‎03-24-2020 08:50 AM

Hello.  I need help troubleshooting a failure in the resource inventory identification step of horizontal discovery using the Azure Resource Inventory pattern.  I adjusted the size of the mid.sm.discolog.max_object_size from 1000 to 2000 and that did not resolve the failure.

Below is the horizontal discovery log.

=======

{
  "name" : "Discovery Log",
  "status" : "FAILURE",
  "children" : [ {
    "name" : "Pre Pattern Execution",
    "id" : "pre_pattern_execution_script",
    "status" : "SUCCESS",
    "level" : 2,
    "messages" : [ {
      "message" : "2020-03-24 15:37:32: Getting pre pattern execution data generated by script."
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(service_account,[{skip_sync=0, operational_status=1, discovery_credentials=95da4d23db6304104b6943ea139619c6, is_validated=1, discovery_source=ServiceNow, first_discovered=2020-03-20 13:28:08, datacenter_discovery_status=2020-03-20 06:31:03: Completed....Reload this form to see an updated datacenter list., object_id=ef225faf-3e3f-4892-bc20-1e782cf1fbba, install_status=1, name=Azure  Service Acct, last_discovered=2020-03-24 05:02:48, can_print=0, sys_class_name=cmdb_ci_cloud_service_account, monitor=0, datacenter_type=cmdb_ci_azure_datacenter, cost_cc=USD, account_id=ef225faf-3e3f-4892-bc20-1e782cf1fbba, should_pull_events=0, attested=0, unverified=0, fault_count=0, is_master_account=0, sys_id=5c605d27db6304104b6943ea13961926}])",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(hosted_relation_type,Hosted on::Hosts)",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(pre_resource_whitelist,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_azure_datacenter,[{skip_sync=0, operational_status=1, discovery_source=ServiceNow, first_discovered=2020-03-20 13:31:03, object_id=westus2, install_status=1, discovery_status=4124923cdb370810bd48c39d13961970, name=West US 2, region=westus2, last_discovered=2020-03-24 05:02:39, can_print=0, sys_class_name=cmdb_ci_azure_datacenter, monitor=0, cost_cc=USD, attested=0, unverified=0, fault_count=0, sys_id=fa01d567db6304104b6943ea13961946}])",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(ldc,[{skip_sync=0, operational_status=1, discovery_source=ServiceNow, first_discovered=2020-03-20 13:31:03, object_id=westus2, install_status=1, discovery_status=4124923cdb370810bd48c39d13961970, name=West US 2, region=westus2, last_discovered=2020-03-24 05:02:39, can_print=0, sys_class_name=cmdb_ci_azure_datacenter, monitor=0, cost_cc=USD, attested=0, unverified=0, fault_count=0, sys_id=fa01d567db6304104b6943ea13961946}])",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(hosted_relation_id,5f985e0ec0a8010e00a9714f2a172815)",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(build_relation_auto,true)",
      "severity" : "DEBUG"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(pattern_runtime_mode,horizontal)",
      "severity" : "DEBUG"
    } ],
    "type" : "NONE"
  }, {
    "name" : "Selecting Pattern for Execution",
    "id" : "set_pattern_name",
    "status" : "SUCCESS",
    "level" : 2,
    "messages" : [ {
      "message" : "2020-03-24 15:37:32: Pattern: Azure Resource Inventory"
    }, {
      "message" : "2020-03-24 15:37:32: setAttribute(pattern,Azure Resource Inventory)",
      "severity" : "DEBUG"
    } ],
    "type" : "NONE"
  }, {
    "name" : "Process Detection",
    "status" : "SUCCESS",
    "level" : 2,
    "type" : "NONE"
  }, {
    "name" : "Resource Inventory Identification",
    "status" : "FAILURE",
    "children" : [ {
      "name" : "Check Azure credentials",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:33: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Set Azure discovery name",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:33: setAttribute(azureType,Generic)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:33: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Set Azure query",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:33: setAttribute(azureQuery,https://management.azure.com/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resources?$top=50&api-version=2018-05-01)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:33: Execution time: 15 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Get generic resources paginated and collect tags",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_list,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(cmdb_key_value,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(response,)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: Execution time: 6750 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Filter out empty tag keys",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:40: setAttribute(cmdb_key_value,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Parse resource response",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/appsvc_windows_centralus/providers/Microsoft.Compute/virtualMachines/WMACDSVM%22,%22name%22:%22WMACDSVM_OsDisk_1_54e0588bd99d4bc786d37f6c0843bc0a%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/APPSVC_WINDOWS_CENTRALUS/providers/Microsoft.Compute/disks/WMACDSVM_OsDisk_1_54e0588bd99d4bc786d37f6c0843bc0a%22,%22type%22:%22Microsoft.Compute/disks%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium_LRS%22%7D%7D,%7B%22name%22:%22WMACDSVM%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/appsvc_windows_centralus/providers/Microsoft.Compute/virtualMachines/WMACDSVM%22,%22type%22:%22Microsoft.Compute/virtualMachines%22%7D,%7B%22name%22:%22WMACDSVM/IaaSAntimalware%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22Aporeto-instance1/QualysAgentLinux%22,%22location%22:%22eastus%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/CS-AZURE-POC/providers/Microsoft.Compute/virtualMachines/Aporeto-instance1/extensions/QualysAgentLinux%22,%22type%22:%22Microsoft.Compute/virtualMachines/extensions%22%7D,%7B%22name%22:%22Aporeto-instance-2%22,%22location%22:%22eastus%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/CS-Azure-POC/providers/Microsoft.Compute/virtualMachines/Aporeto-instance-2%22,%22type%22:%22Microsoft.Compute/virtualMachines%22,%22tags%22:%7B%22Name%22:%22Aporeto-pvt%22%7D%7D,%7B%22name%22:%22Aporeto-instance-2/OmsAgentForLinux%22,%22location%22:%22eastus%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/CS-AZURE-POC/providers/Microsoft.Compute/virtualMachines/Aporeto-instance-2/extensions/OmsAgentForLinux%22,%22type%22:%22Microsoft.Compute/v",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22SecurityCenterFree(DefaultWorkspace-ef225faf-3e3f-4892-bc20-1e782cf1fbba-EUS2)%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/DefaultResourceGroup-EUS2/providers/Microsoft.OperationsManagement/solutions/SecurityCenterFree(DefaultWorkspace-ef225faf-3e3f-4892-bc20-1e782cf1fbba-EUS2)%22,%22type%22:%22Microsoft.OperationsManagement/solutions%22,%22plan%22:%7B%22product%22:%22OMSGallery/SecurityCenterFree%22,%22name%22:%22SecurityCenterFree(DefaultWorkspace-ef225faf-3e3f-4892-bc20-1e782cf1fbba-EUS2)%22,%22promotionCode%22:%22%22,%22publisher%22:%22Microsoft%22%7D%7D,%7B%22kind%22:%22v12.0%22,%22name%22:%22nestletest%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/DefaultResourceGroup-EUS2/providers/Microsoft.Sql/servers/nestletest%22,%22type%22:%22Microsoft.Sql/servers%22,%22tags%22:%7B%7D%7D,%7B%22managedBy%22",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22B2CNEWTEST.onmicrosoft.com%22,%22location%22:%22unitedstates%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/IAM/providers/Microsoft.AzureActiveDirectory/b2cDirectories/B2CNEWTEST.onmicrosoft.com%22,%22type%22:%22Microsoft.AzureActiveDirectory/b2cDirectories%22,%22sku%22:%7B%22tier%22:%22A0%22,%22name%22:%22Standard%22%7D,%22tags%22:%7B%7D%7D,%7B%22kind%22:%22StorageV2%22,%22name%22:%22dineshmyname%22,%22location%22:%22southindia%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/IoT-Security-Practice-RG1-dinesh/providers/Microsoft.Storage/storageAccounts/dineshmyname%22,%22type%22:%22Microsoft.Storage/storageAccounts%22,%22sku%22:%7B%22tier%22:%22Standard%22,%22name%22:%22Standard_RAGRS%22%7D,%22tags%22:%7B%7D%7D,%7B%22name%22:%22IoTAcademy%22,%22location%22:%22southindia%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/IoT-Security-",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22kind%22:%22shared%22,%22name%22:%22374a501a-d890-43ec-b3ad-845d606a4788%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Insights/workbooks/374a501a-d890-43ec-b3ad-845d606a4788%22,%22type%22:%22Microsoft.Insights/workbooks%22,%22tags%22:%7B%22hidden-title%22:%22Office%20365%20-%20SIAA%22%7D%7D,%7B%22kind%22:%22shared%22,%22name%22:%224d0fef71-2b13-408e-88d1-59c2d4dc6d47%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Insights/workbooks/4d0fef71-2b13-408e-88d1-59c2d4dc6d47%22,%22type%22:%22Microsoft.Insights/workbooks%22,%22tags%22:%7B%22hidden-title%22:%22Insecure%20Protocols%20-%20SIAA%22%7D%7D,%7B%22kind%22:%22shared%22,%22name%22:%22517bab1b-5d31-4c85-9994-719523a662fb%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/res",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22ThreatIntelligenceDashboard-SIAA%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Portal/dashboards/ThreatIntelligenceDashboard-SIAA%22,%22type%22:%22Microsoft.Portal/dashboards%22,%22tags%22:%7B%22dashboardKey%22:%22ThreatIntelligenceDashboard%22,%22hidden-title%22:%22Threat%20Intelligence%20Dashboard%20-%20SIAA%22,%22workspaceName%22:%22SIAA%22,%22version%22:%221.2%22%7D%7D,%7B%22kind%22:%22StorageV2%22,%22name%22:%22kemisetti%22,%22location%22:%22centralindia%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Storage/storageAccounts/kemisetti%22,%22type%22:%22Microsoft.Storage/storageAccounts%22,%22sku%22:%7B%22tier%22:%22Standard%22,%22name%22:%22Standard_LRS%22%7D,%22tags%22:%7B%22ms-resource-usage%22:%22azure-cloud-shell%22%7D%7D,%7B%22kind%22:%22StorageV2%22,%22name%22:%22phishingema",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22VirusTotal%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/connections/VirusTotal%22,%22type%22:%22Microsoft.Web/connections%22%7D,%7B%22name%22:%22AbuseIPDB%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/customApis/AbuseIPDB%22,%22type%22:%22Microsoft.Web/customApis%22%7D,%7B%22name%22:%22TEST%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/customApis/TEST%22,%22type%22:%22Microsoft.Web/customApis%22%7D,%7B%22name%22:%22VirusTotal%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/SIAA/providers/Microsoft.Web/customApis/VirusTotal%22,%22type%22:%22Microsoft.Web/customApis%22%7D,%7B%22kind%22:%22func",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/virtualMachines/WCAE-DBserver2%22,%22name%22:%22WCAE-DBserver2_OsDisk_1_8d993710f56c43d999ce4d8bd4a012e1%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/disks/WCAE-DBserver2_OsDisk_1_8d993710f56c43d999ce4d8bd4a012e1%22,%22type%22:%22Microsoft.Compute/disks%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium_LRS%22%7D%7D,%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/virtualMachines/WCAE-F5-BigIPVE%22,%22name%22:%22WCAE-F5-BigIPVE_OsDisk_1_236c658cec2e44fba9ceb2b619e74760%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Compute/disks/WCAE-F5-BigIPVE_OsD",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22WCAE-CloudEnv%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Network/virtualNetworks/WCAE-CloudEnv%22,%22type%22:%22Microsoft.Network/virtualNetworks%22%7D,%7B%22kind%22:%22Storage%22,%22name%22:%22wcaergdiag%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAE-RG/providers/Microsoft.Storage/storageAccounts/wcaergdiag%22,%22type%22:%22Microsoft.Storage/storageAccounts%22,%22sku%22:%7B%22tier%22:%22Standard%22,%22name%22:%22Standard_LRS%22%7D,%22tags%22:%7B%7D%7D,%7B%22name%22:%22wcaepanfw2%22,%22location%22:%22eastus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WCAEPANFW2/providers/Microsoft.Compute/virtualMachines/wcaepanfw2%22,%22type%22:%22Microsoft.Compute/virtualMachines%22,%22plan%22:%7B%22product%22:%22vmseries1%22,%22name%22:%22byol%",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22NestleTest/Policy_81%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Automation/automationAccounts/NestleTest/runbooks/Policy_81%22,%22type%22:%22Microsoft.Automation/automationAccounts/runbooks%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22NestleTest/Policy_84%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Automation/automationAccounts/NestleTest/runbooks/Policy_84%22,%22type%22:%22Microsoft.Automation/automationAccounts/runbooks%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22NestleTest/policy_86%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Automation/automationAccounts/NestleTest/runbooks/policy_86%22,%22type%22:%22Microsoft.Automation/automationAccounts/r",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(content,%7B%22value%22:%5B%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/virtualMachines/WMAC-SNOW%22,%22name%22:%22WMAC-SNOW_OsDisk_1_ad9d29f6216949a6a72fee6ec350b1ed%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCENV/providers/Microsoft.Compute/disks/WMAC-SNOW_OsDisk_1_ad9d29f6216949a6a72fee6ec350b1ed%22,%22type%22:%22Microsoft.Compute/disks%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium_LRS%22%7D,%22tags%22:%7B%22Name%22:%22WMAC-SNOW%22%7D%7D,%7B%22managedBy%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/virtualMachines/WMAC-SyslogSrv%22,%22name%22:%22WMAC-SyslogSrv_DataDisk_0%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/disks/WMAC-Sy",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:40: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22WMAC-ePO-WC/MicrosoftMonitoringAgent%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCENV/providers/Microsoft.Compute/virtualMachines/WMAC-ePO-WC/extensions/MicrosoftMonitoringAgent%22,%22type%22:%22Microsoft.Compute/virtualMachines/extensions%22%7D,%7B%22name%22:%22WMAC-ePOSrv%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Compute/virtualMachines/WMAC-ePOSrv%22,%22type%22:%22Microsoft.Compute/virtualMachines%22%7D,%7B%22name%22:%22WMAC-ePOSrv/MicrosoftMonitoringAgent%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCENV/providers/Microsoft.Compute/virtualMachines/WMAC-ePOSrv/extensions/MicrosoftMonitoringAgent%22,%22type%22:%22Microsoft.Compute/virtualMachines/extensions%22%7D,%7B%22name%22:%22WMAC-",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22emailNotificationActionGroup%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/microsoft.insights/actiongroups/emailNotificationActionGroup%22,%22type%22:%22microsoft.insights/actiongroups%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22Migration_AG1%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/microsoft.insights/actiongroups/Migration_AG1%22,%22type%22:%22microsoft.insights/actiongroups%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22Migration_AG2%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/microsoft.insights/actiongroups/Migration_AG2%22,%22type%22:%22microsoft.insights/actiongroups%22,%22tags%22:%7B%7D%7D,%7B%22name%22:%22Test%22,%22location%22:%22global%22,%22id%22:%22/subscriptions/ef225",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22wmac-qulys-vmid493%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/networkInterfaces/wmac-qulys-vmid493%22,%22type%22:%22Microsoft.Network/networkInterfaces%22,%22tags%22:%7B%22Name%22:%22WMAC-Qulys-VMID%22%7D%7D,%7B%22name%22:%22wmac-qulys-vmidcheck283%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/networkInterfaces/wmac-qulys-vmidcheck283%22,%22type%22:%22Microsoft.Network/networkInterfaces%22,%22tags%22:%7B%22Name%22:%22WMAC-Qulys-VMIDCheck%22%7D%7D,%7B%22name%22:%22wmac-snow1189%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/networkInterfaces/wmac-snow1189%22,%22type%22:%22Microsoft.Network/networkInterfaces%22,%22tags%22",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22WMAC-Transit-Route%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/routeTables/WMAC-Transit-Route%22,%22type%22:%22Microsoft.Network/routeTables%22%7D,%7B%22name%22:%22WMACROUTE-INTERNAL%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/routeTables/WMACROUTE-INTERNAL%22,%22type%22:%22Microsoft.Network/routeTables%22%7D,%7B%22name%22:%22WMAC-VGW%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/providers/Microsoft.Network/virtualNetworkGateways/WMAC-VGW%22,%22type%22:%22Microsoft.Network/virtualNetworkGateways%22%7D,%7B%22name%22:%22vNet%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC-POCEnv/p",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(content,%7B%22value%22:%5B%7B%22name%22:%22NestleTest%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC_NestleTest/providers/Microsoft.ContainerRegistry/registries/NestleTest%22,%22type%22:%22Microsoft.ContainerRegistry/registries%22,%22sku%22:%7B%22tier%22:%22Premium%22,%22name%22:%22Premium%22%7D,%22tags%22:%7B%7D%7D,%7B%22name%22:%22WMAC_Nestle-NetAppTest%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC_NestleTest/providers/Microsoft.NetApp/netAppAccounts/WMAC_Nestle-NetAppTest%22,%22type%22:%22Microsoft.NetApp/netAppAccounts%22%7D,%7B%22name%22:%22WMAC_Nestle-NetAppTest/Pool_NetApp_S_4%22,%22location%22:%22westus2%22,%22id%22:%22/subscriptions/ef225faf-3e3f-4892-bc20-1e782cf1fbba/resourceGroups/WMAC_NestleTest/providers/Microsoft.NetApp/netAppAccounts/WMAC_Nestle-NetAppTest/capacityPools/Pool_NetApp_S_4%22,%22type%22:%22Microsoft.NetApp/n",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(name_server,mid)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: Execution time: 1922 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Resource type to lowercase",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: Execution time: 47 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Filter resources according to LDC",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:41: setAttribute(resource_info,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:41: Execution time: 16 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Abort incase no resources in LDC",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:41: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Adjust whitelist",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(pre_resource_whitelist,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 15 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Filter resources according to whitelist",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(merged_resource,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Collect all resources when whitelist is empty",
      "status" : "NOP",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: Step condition is false. step not executed.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Abort incase no resources match whitelist",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Remove duplicate entries",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(merged_resource,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: setAttribute(tmp,)",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Create Generic CI",
      "status" : "SUCCESS",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: setAttribute(cmdb_ci_cmp_resource,........)\r\nThe max object size reached the maximum limit of [2000]. To adjust this use the mid property mid.sm.discolog.max_object_size.",
        "severity" : "DEBUG"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    }, {
      "name" : "Reference Generic CI tags",
      "status" : "FAILURE",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 15:37:42: Relation and/or reference table cmdb_key_value is not a known CI Type. Check the discovery logs for more details.",
        "severity" : "ERROR"
      }, {
        "message" : "2020-03-24 15:37:42: Execution time: 0 ms",
        "severity" : "DEBUG"
      } ],
      "type" : "STEP_TYPE"
    } ],
    "level" : 2,
    "type" : "IDENTIFICATION_SECTION_TYPE"
  }, {
    "name" : "discovery",
    "id" : "discovery",
    "status" : "FAILURE",
    "children" : [ {
      "name" : "Check Processing Success",
      "id" : "Check Processing Success",
      "status" : "FAILURE",
      "level" : 3,
      "messages" : [ {
        "message" : "2020-03-24 08:38:38: Identification Engine: Discovery status is FAILURE, Identification sections in pattern failed: section: Resource Inventory Identification, error: Relation and/or reference table cmdb_key_value is not a known CI Type. Check the discovery logs for more details..  "
      } ],
      "type" : "NONE"
    } ],
    "level" : 2,
    "type" : "NONE"
  } ],
  "level" : 0,
  "messages" : [ {
    "message" : "2020-03-24 15:37:32: Task is running on MID server azure_mid",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  }, {
    "message" : "2020-03-24 15:37:32: setAttribute(cmdb_ci_cmp_resource,[{}])",
    "severity" : "DEBUG"
  } ],
  "type" : "NONE"
}

 

@Randy Tangco 

Labels:
0 Helpfuls
  • 1,298 Views
7 REPLIES 7

Ashutosh Munot1
Kilo Patron
Kilo Patron

‎03-24-2020 11:11 AM

Hi,

You need to really set that property value to like 50,000 and try.


Thanks,
Ashutosh

0 Helpfuls

SriniK
ServiceNow Employee
ServiceNow Employee

‎03-25-2020 09:41 PM

Hi Randy.

 

Yes, please try to increase the value to 10000 and try the discovery, setting a higher value to the property will only be useful when debugging the pattern. The error does not affect the run time of the pattern and can be ignored.

In case the mid server property is added/modified, make sure to

  1. Execute "Sync Patterns to the MID"
  2. Restart the mid server supporting the Pattern.

 

Note: The MID server property, mid.sm.discolog.max_object_size, in the ecc_agent_property table (ecc_agent_property.list) determines how big an object can be return from the MID to the pattern log. If it is larger than the said number, it will be truncated. If this number is very large, huge results could bloat the size of the discovery log.

 

Hope this helps.

 

Regards

SrinivasK

randytangco
Mega Guru

‎03-29-2020 08:28 AM

@Ashutosh Munot , @SriniK .  Thank you for your replies.  The root cause was not in the property size but a missing related record in cmdb_key_value table.

0 Helpfuls

MJN
Tera Contributor
In response to randytangco

‎08-28-2020 01:44 AM

Hi @randytangco ,

How did you fix this issue.I am also facing the same issue.

0 Helpfuls