Skip to content

Configuration Manual for the "Huawei Cloud-DIS" Collector

Before reading this article, please read the following first:

Before using this collector, you must install the 'Integration Core Package' and its corresponding third-party dependency packages

1. Configuration Structure

The configuration structure of this collector is as follows:

Configuration One (Recommended)

Field Type Required Description
regions list Required List of regions to collect data from
regions[#] str Required Region ID. For example: 'cn-north-4'
Refer to the appendix for the complete list

The collector will automatically retrieve all IAM projects under the region and then obtain resources based on IAM projects

Configuration Two (Legacy Compatibility)

Field Type Required Description
region_projects dict Required List of 'Region - Project ID' pairs required for data collection
region_projects[#] str:list Required In the key-value pair:
Key represents the region (e.g., 'cn-north-4')
Value represents the list of project IDs to be collected in that region
Refer to the appendix for the complete list

2. Configuration Example

Specifying Regions

Collect DIS instance data for projects corresponding to the cn-north-4 region.

Python
1
2
3
collector_configs = {
    'regions': ['cn-north-4']
}

3. Data Reporting Format

After data synchronization, you can view the data in the {{( brand_name )}} 'Infrastructure - Resource Catalog'.

An example of reported data is as follows:

JSON
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17
18
19
20
{
  "measurement": "huaweicloud_dis",
  "tags": {
    "RegionId"             : "cn-north-4",
    "project_id"           : "c631f04625xxxxexxxxxx253c62d48585",
    "enterprise_project_id": "0",
    "name"                 : "dis-YoME",
    "status"               : "RUNNING",
    "stream_name"          : "dis-YoME",
    "stream_type"          : "COMMON"
  },
  "fields": {
    "data_type"            : "BLOB",
    "partition_count"      : 1,
    "retention_period"     : 24,
    "auto_scale_enabled"   : false,
    "create_time"          : 1691484876645,
    "message"              : "{Instance JSON Data}"
  }
}

Descriptions of some parameters are as follows:

Field Type Description
create_time integer Channel creation time, a 13-digit timestamp.
retention_period integer Data retention duration, in hours.
status str Current status of the channel.
CREATING: Creating
RUNNING: Running
TERMINATING: Deleting
TERMINATED: Deleted
stream_type str Channel type.
COMMON: Common channel, indicating 1MB bandwidth.
ADVANCED: Advanced channel, indicating 5MB bandwidth.
data_type str Source data type.
BLOB: A set of binary data stored in a database management system.
JSON: An open file format based on readable text used to transmit data objects composed of attribute values or sequential values.
CSV: Tabular data stored in plain text format with default delimiter as a comma.
Default value: BLOB.
auto_scale_enabled bool Whether auto-scaling is enabled.
true: Auto-scaling enabled.
false: Auto-scaling disabled.
Default not enabled.
Default value: false

Fields in tags and fields may change with subsequent updates

The value of tags.name is the instance ID, serving as a unique identifier

The following fields are strings serialized in JSON format

  • fields.message

X. Appendix

Huawei Cloud DIL 'Region ID'

Please refer to the official Huawei Cloud documentation: