amqp_0_9
Connects to an AMQP (0.91) queue. AMQP is a messaging protocol used by various message brokers, including RabbitMQ.
-
Common
-
Advanced
input:
label: ""
amqp_0_9:
urls: [] # No default (required)
queue: "" # No default (required)
consumer_tag: ""
prefetch_count: 10
input:
label: ""
amqp_0_9:
urls: [] # No default (required)
queue: "" # No default (required)
queue_declare:
enabled: false
durable: true
auto_delete: false
arguments: {} # No default (optional)
bindings_declare: [] # No default (optional)
consumer_tag: ""
auto_ack: false
nack_reject_patterns: []
prefetch_count: 10
prefetch_size: 0
tls:
enabled: false
skip_cert_verify: false
enable_renegotiation: false
root_cas: ""
root_cas_file: ""
client_certs: []
TLS is automatically enabled when connecting to an amqps URL. However, you can customize TLS settings if required.
Metadata
This input adds the following metadata fields to each message:
-
amqp_content_type -
amqp_content_encoding -
amqp_delivery_mode -
amqp_priority -
amqp_correlation_id -
amqp_reply_to -
amqp_expiration -
amqp_message_id -
amqp_timestamp -
amqp_type -
amqp_user_id -
amqp_app_id -
amqp_consumer_tag -
amqp_delivery_tag -
amqp_redelivered -
amqp_exchange -
amqp_routing_key -
All existing message headers, including nested headers prefixed with the key of their respective parent.
You can access these metadata fields using function interpolations.
Fields
auto_ack
Set to true to automatically acknowledge messages as soon as they are consumed rather than waiting for acknowledgments from downstream. This can improve throughput and prevent the pipeline from becoming blocked, but delivery guarantees are lost.
Type: bool
Default: false
bindings_declare[]
Declares the bindings of the target queue to make sure they exist and are configured correctly.
Type: array<object>
# Examples:
bindings_declare:
- exchange: foo
key: bar
nack_reject_patterns[]
A list of regular expression patterns to match against errors in messages that Redpanda Connect fails to deliver. When a message has an error that matches a pattern, it is dropped or delivered to a dead-letter queue (if a queue has been configured).
By default, failed messages are negatively acknowledged (nacked) and requeued.
Type: array<string>
Default: []
# Examples:
nack_reject_patterns:
- "^reject me please:.+$"
prefetch_size
The maximum size (in bytes) of pending messages to have consumed at a time.
Type: int
Default: 0
queue_declare
Declares the target queue (queue) to make sure a queue with the specified name exists and is configured correctly. If the queue does not exist, it is created. If the queue already exists, the declaration verifies that the fields specified in this object match its properties.
Type: object
queue_declare.arguments
Arguments for server-specific implementations of the queue (optional). You can use arguments to configure additional parameters for queue types that require them. For more information about available arguments, see the RabbitMQ Client Library.
This input sends every argument value as a string. RabbitMQ requires x-max-length, x-max-length-bytes, x-message-ttl, x-expires, x-consumer-timeout, and x-stream-max-segment-size-bytes to be integers, and x-single-active-consumer to be a boolean, so declaring a queue with any of them fails. Only string arguments, such as x-queue-type, x-overflow, and x-max-age, work.
|
| Argument | Description | Accepted values |
|---|---|---|
|
Declares the type of queue. |
Options: |
|
The maximum number of messages in the queue. |
A non-negative integer. |
|
The maximum size of messages (in bytes) in the queue. |
A non-negative integer. |
|
Sets the queue’s overflow behavior. |
Options: |
|
The duration (in milliseconds) that messages remain in the queue before they expire and are discarded. |
A string that represents the number of milliseconds. For example, |
|
The duration (in milliseconds) after which the queue automatically expires. |
A positive integer that represents the number of milliseconds. |
|
The duration (in configurable units) that streamed messages are retained on disk before they are discarded. |
Options: |
|
The maximum size (in bytes) of the segment files held on disk. |
A positive integer. Default: |
|
The version of the classic queue to use. |
Options: |
|
The duration (in milliseconds) that a consumer can remain idle before it is automatically canceled. |
A positive integer that represents the number of milliseconds. For example, |
|
When set to |
A boolean. |
Type: object<string>
# Examples:
arguments:
x-overflow: reject-publish
x-queue-type: quorum
queue_declare.auto_delete
Whether the declared queue auto-deletes when there are no active consumers.
Type: bool
Default: false
tls
Configure Transport Layer Security (TLS) settings to secure network connections. This includes options for standard TLS as well as mutual TLS (mTLS) authentication where both client and server authenticate each other using certificates. Key configuration options include enabled to enable TLS, client_certs for mTLS authentication, root_cas/root_cas_file for custom certificate authorities, and skip_cert_verify for development environments.
Type: object
tls.client_certs[]
A list of client certificates for mutual TLS (mTLS) authentication. Configure this field to enable mTLS, authenticating the client to the server with these certificates.
You must set tls.enabled: true for the client certificates to take effect.
Certificate pairing rules: For each certificate item, provide either:
-
Inline PEM data using both
certandkeyor -
File paths using both
cert_fileandkey_file.
Mixing inline and file-based values within the same item is not supported.
Type: array<object>
Default: []
# Examples:
client_certs:
- cert: foo
key: bar
# ---
client_certs:
- cert_file: ./example.pem
key_file: ./example.key
tls.client_certs[].cert
The plaintext certificate to use for TLS authentication. Must be paired with the corresponding private key in the key field when using inline PEM data for mTLS client certificates.
Type: string
Default: ""
tls.client_certs[].cert_file
The path to a file containing the certificate to use for TLS authentication. Must be paired with the corresponding private key file in the key_file field when using file-based configuration for mTLS client certificates.
Type: string
Default: ""
tls.client_certs[].key
Private key for mTLS client certificate as inline PEM data. Must correspond to the client certificate specified in the cert field. Use this field together with cert when providing certificate data inline rather than through files.
|
This field contains sensitive information that usually shouldn’t be added to a configuration directly. For more information, see Manage Secrets before adding it to your configuration. |
Type: string
Default: ""
tls.client_certs[].key_file
Path to private key file for mTLS client certificate in PEM format. Must correspond to the client certificate specified in the cert_file field. Use this field together with cert_file when loading certificate data from files.
Type: string
Default: ""
tls.client_certs[].password
The password to use for the private key (specified in the key or key_file fields), if it is password-protected. The PKCS#1 and PKCS#8 formats are supported. Supports environment variable interpolation for secure password management.
The pbeWithMD5AndDES-CBC algorithm is obsolete and not supported for the PKCS#8 format. This algorithm does not authenticate the ciphertext, making it vulnerable to padding oracle attacks that can let an attacker recover the plaintext.
|
This field contains sensitive information that usually shouldn’t be added to a configuration directly. For more information, see Manage Secrets before adding it to your configuration. |
Type: string
Default: ""
# Examples:
password: foo
# ---
password: ${KEY_PASSWORD}
tls.enable_renegotiation
Whether to allow the remote server to repeatedly request renegotiation. Enable this option if you’re seeing the error message local error: tls: no renegotiation.
Type: bool
Default: false
tls.enabled
Whether to enable TLS for secure connections. Set to true to enable TLS encryption. Required to be true for other TLS options (like client_certs, root_cas, etc.) to take effect.
Type: bool
Default: false
tls.root_cas
Specify a root certificate authority to use (optional). This is a string that represents a certificate chain from the parent-trusted root certificate, through possible intermediate signing certificates, to the host certificate. Use either this field for inline certificate data or root_cas_file for file-based certificate loading.
|
This field contains sensitive information that usually shouldn’t be added to a configuration directly. For more information, see Manage Secrets before adding it to your configuration. |
Type: string
Default: ""
# Examples:
root_cas: |-
-----BEGIN CERTIFICATE-----
...
-----END CERTIFICATE-----
tls.root_cas_file
Specify the path to a root certificate authority file (optional). This is a file, often with a .pem extension, which contains a certificate chain from the parent-trusted root certificate, through possible intermediate signing certificates, to the host certificate. Use either this field for file-based certificate loading or root_cas for inline certificate data.
Type: string
Default: ""
# Examples:
root_cas_file: ./root_cas.pem
tls.skip_cert_verify
Whether to skip server-side certificate verification. Set to true only for testing environments as this reduces security by disabling certificate validation. When using self-signed certificates or in development, this may be necessary, but should never be used in production. Consider using root_cas or root_cas_file to specify trusted certificates instead of disabling verification entirely.
Type: bool
Default: false
urls[]
A list of AMQP 0.9.1 broker URLs to connect to, in the form amqp://user:password@host:port/vhost. Each URL is tried in order until a connection is established, and that URL is then used until the connection is closed. When tls is enabled and a URL has no user credentials, the connection authenticates with the SASL EXTERNAL mechanism using the client certificate.
If an item in the list contains commas, it is split into multiple URLs.
Type: array<string>
# Examples:
urls:
- "amqp://guest:guest@127.0.0.1:5672/"
# ---
urls:
- "amqp://127.0.0.1:5672/,amqp://127.0.0.2:5672/"
# ---
urls:
- "amqp://127.0.0.1:5672/"
- "amqp://127.0.0.2:5672/"