AWS DynamoDb monitoring

SkyWalking leverages Amazon Kinesis Data Filehose with Amazon CloudWatch to transfer the metrics into the Meter System.

Data flow

  1. Amazon CloudWatch fetches metrics from DynamoDB and pushes metrics to SkyWalking OAP Server via Amazon Kinesis data firehose.
  2. The SkyWalking OAP Server parses the expression with MAL to filter/calculate/aggregate and store the results.

Set up

  1. Create CloudWatch metrics configuration for DynamoDB, refer to DynamoDB metrics configuration Create an Amazon Kinesis Data Firehose Delivery Stream, and set AWS Kinesis Data Firehose receiver’s address as HTTP(s) Destination, refer to Create Delivery Stream3. Create a metric stream, set namespace to DynanoDB, and set Kinesis Data Firehose to the firehose you just created.
  2. Config aws-firehose-receiver to receive data.
  3. Create CloudWatch metric stream, and select the Firehose Delivery Stream which has been created above, set Select namespaces to AWS/DynamoDB, Select output format to OpenTelemetry 0.7. refer to CloudWatch Metric Streams

DynamoDB Monitoring

DynamoDB monitoring provides monitoring of the status and resources of the DynamoDB server. AWS user id is cataloged as a Layer: AWS_DYNAMODB Service in OAP. Each DynamoDB table is cataloged as an Endpoint in OAP.

Supported Metrics

Monitoring Panel Unit Metric Name Description Data Source
Read Usage unit/s consumed_read_capacity_units
provisioned_read_capacity_units		 The situation of read capacity units consumed and provisioned over the specified time period Amazon CloudWatch
Write Usage unit/s consumed_write_capacity_units
provisioned_write_capacity_units		 The situation of write capacity units consumed and provisioned over the specified time period Amazon CloudWatch
Successful Request Latency ms get_successful_request_latency
put_successful_request_latency
query_successful_request_latency
scan_successful_request_latency		 The latency of successful request Amazon CloudWatch
TTL Deleted Item count time_to_live_deleted_item_count The count of items deleted by TTL Amazon CloudWatch
Throttle Events read_throttle_events
write_throttle_events		 Requests to DynamoDB that exceed the provisioned read/write capacity units for a table or a global secondary index. Amazon CloudWatch
Throttled Requests read_throttled_requests
write_throttled_requests		 Requests to DynamoDB that exceed the provisioned throughput limits on a resource (such as a table or an index). Amazon CloudWatch
Scan/Query Operation Returned Item Ccount scan_returned_item_count
query_returned_item_count
 The number of items returned by Query, Scan or ExecuteStatement (select) operations during the specified time period. Amazon CloudWatch
System Errors read_system_errors
write_system_errors		 The requests to DynamoDB or Amazon DynamoDB Streams that generate an HTTP 500 status code during the specified time period. Amazon CloudWatch
User Errors user_errors Requests to DynamoDB or Amazon DynamoDB Streams that generate an HTTP 400 status code during the specified time period. Amazon CloudWatch
Condition Checked Fail Requests conditional_check_failed_requests The number of failed attempts to perform conditional writes. Amazon CloudWatch
Transaction Conflict transaction_conflict Rejected item-level requests due to transactional conflicts between concurrent requests on the same items. Amazon CloudWatch

Customizations

You can customize your own metrics/expression/dashboard panel. The metrics definition and expression rules are found in /config/otel-rules/aws-dynamodb. The DynamoDB dashboard panel configurations are found in /config/ui-initialized-templates/aws_dynamodb.