[aws] [cloudwatch_metrics] Map aws.dimensions field as object (#11883)

Change the mapping type for the `aws.dimensions` field from `flattened` to `object`. Currently, all `*_metrics` data streams but one use the `object` mapping. The `cloudwatch_metrics` data stream uses the `flattened` type instead. We need to unify the mapping of `aws.dimensions` across all metrics-related data streams in the AWS integration. If all data streams use the exact mapping for `aws.dimensions`, users will be able to query and build a dashboard that correlates data across different data streams.

Author: zmoog

packages/aws/changelog.yml

@@ -1,4 +1,9 @@
 # newer versions go on top
+- version: "2.37.0"
+ changes:
+ - description: Map aws.dimensions as object instead of flattened in CloudWatch metrics.
+ type: enhancement
+ link: https://github.com/elastic/integrations/pull/11883
 - version: "2.36.2"
  changes:
  - description: Include pipeline test examples to accommodate the new Cloudtrail format for the `CreateGroup` and `UpdateGroup` event types.

packages/aws/data_stream/cloudwatch_metrics/fields/package-fields.yml

@@ -5,15 +5,15 @@
  type: flattened
  description: |
  Tag key value pairs from aws resources.
- - name: dimensions
- type: flattened
+ - name: dimensions.*
+ type: keyword
+ dimension: true
  description: |
  Metric dimensions.
  - name: dimensions_fingerprint
  type: keyword
  description: |
  Autogenerated ID representing the fingerprint of the aws.dimensions object
- dimension: true
 - name: 'aws.*.metrics.*.*'
  type: object
  object_type: double

packages/aws/docs/cloudwatch.md

@@ -183,7 +183,7 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
 | agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword | |
 | aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | gauge |
 | aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword | |
-| aws.dimensions | Metric dimensions. | flattened | |
+| aws.dimensions.\* | Metric dimensions. | keyword | |
 | aws.dimensions_fingerprint | Autogenerated ID representing the fingerprint of the aws.dimensions object | keyword | |
 | aws.tags | Tag key value pairs from aws resources. | flattened | |
 | cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword | |

packages/aws/manifest.yml

@@ -1,7 +1,7 @@
 format_version: 3.0.0
 name: aws
 title: AWS
-version: 2.36.2
+version: 2.37.0
 description: Collect logs and metrics from Amazon Web Services (AWS) with Elastic Agent.
 type: integration
 categories: