Skip to main content
Sumo Logic

Metric Throttling

Information about how Sumo throttles metric when your metrics ingestion exceeds your data points per minute (DPM)  burst limit.

Metric data volume is measured in Data Points per Minute (DPM). The Account Page in the Sumo web app shows the DPM limit for your account and your average daily DPM for the current billing period.

To allow for spikes in metrics ingestion, Sumo applies a multiplier to your DPM limit to allow you send metrics at a higher rate, referred as your burst rate, before Sumo starts to throttle your sources.

The multiplier depends on your daily DPM account limit.   

DPM Limit DPM Burst Limit
Less than 10K 5 x DPM Limit
Between 10K and 50K 4 x DPM Limit
Between 50K and 100K 3 x DPM Limit
More than 100K 2 x DPM Limit

For example, if your daily DPM limit is 5,000 DPM, your ingest rate can increase to 25,000 DPM before Sumo starts to throttle your metric sources.  

When you exceed your DPM burst limit, Sumo throttles your metric sources—your ingestion will be slowed down until the rate of ingestion returns is within the allowable contracted limits.

Metric throttling behavior varies by source type:

  • Installed collector with host metrics source. Up to 1GB of compressed metrics data is cached on the host. After 1GB of compressed data is reached on disk, older data is evicted (dropped) to make room for new data. For information about changing the size of the cache, see Configure Limits for Collector Caching.

  • Hosted collector with HTTP source. When hosted collectors in your account are sending metric data at a combined rate that is over the burst rate for your account, additional requests will receive a 429 Rate Limit Exceeded response code and the data will not be ingested and and will be dropped.

  • Hosted collector with AWS CloudWatch source. AWS automatically throttles CloudWatch data if the limits that Amazon sets for the associated APIs are exceeded. If you have a high volume of metrics data points in your account, it is likely that Amazon will throttle your CloudWatch data. If no adjustments are made on the Sumo Logic side, throttling on the Amazon side can cause metrics data to be dropped. To prevent this from occurring, Sumo Logic automatically doubles the CloudWatch scan interval if more than one throttling message is received in a single interval. Sumo will poll CloudWatch metrics less frequently until AWS throttling subsides.

Tags recommended by the template: article:topic