Cloud
Also in Self-Managed

benchmark

Logs throughput statistics for processed messages, and provides a summary of those statistics over the lifetime of the processor.

  • Common

  • Advanced

processor:
  label: ""
  benchmark:
    interval: 5s
    count_bytes: true
processor:
  label: ""
  benchmark:
    interval: 5s
    count_bytes: true

Throughput statistics

This processor logs the following rolling statistics at a configurable interval to help you to understand the current performance of your pipeline:

  • The number of messages processed per second.

  • The number of bytes processed per second (optional).

For example:

INFO rolling stats: 1 msg/sec, 407 B/sec

When the processor shuts down, it also logs a summary of the number and size of messages processed during its lifetime. For example:

INFO total stats: 1.00186 msg/sec, 425 B/sec

Fields

count_bytes

Whether to measure the number of bytes per second of throughput. If set to true, structured data must be serialized to count the number of bytes processed, which can unnecessarily degrade performance if serialization is not required elsewhere in your pipeline.

Type: bool

Default: true

interval

How often to emit rolling statistics. Set to 0 to log only summary statistics when the processor shuts down.

Type: string

Default: 5s