Skip to content

Collector «AWS-ElasticMapReduce» Configuration Manual

Before reading this article, please read the following first:

Before using this collector, you must install the «Integration Core Package» and its corresponding third-party dependency packages

1. Configuration Structure

The configuration structure of this collector is as follows:

Field Type Required Description
regions list Required List of regions to collect data from
regions[#] str Required Region ID. For example: 'cn-north-1'
See the full table in the appendix

2. Configuration Example

Collecting instance data from the Beijing region

Python
1
2
3
collector_configs = {
    'regions': ['cn-north-1' ]
}

3. Data Reporting Format

After data synchronization is successful, you can view the data in the «Infrastructure - Resource Catalog» section of {{( brand_name }}}.

Example of reported data:

JSON
 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
{
  "measurement": "aws_emr",
  "tags": {
    "Id"         : "xxxxx",
    "ClusterName": "xxxxx",
    "ClusterArn" : "xxxx",
    "RegionId"   : "cn-north-1",
    "OutpostArn" : "xxxx",
  },
  "fields": {
    "Status" : "{Instance status JSON data}",
    "message": "{Instance JSON data}"
  }
}

Fields in tags and fields may change with subsequent updates

4. IAM Policy Permissions

If users are collecting resources using an assumed IAM role, certain operation permissions need to be enabled

This collector requires the following permissions:

elasticmapreduce:ListClusters

X. Appendix

Please refer to the official AWS documentation: