> ## Documentation Index
> Fetch the complete documentation index at: https://docs-xcor.paloaltonetworks.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Confluent Cloud DataSet destination plugin

> Configure the Confluent Cloud DataSet destination plugin in Palo Alto Networks Telemetry Pipeline to send logs to Confluent Cloud.

export const entity_0 = "Confluent Cloud destination plugin"

export const plugin_0 = "Confluent Cloud destination plugin"

<Info>
  This information is for Palo Alto Networks Telemetry Pipeline, which is a standalone
  product separate from Palo Alto Networks Cortex XCOR.
</Info>

The Confluent Cloud [destination plugin](/ingest/pipeline/plugins/destination-plugins)
(name: `kafka`, alias: `confluent_cloud_output`) lets you send your telemetry
pipeline data to Confluent Cloud.

## Supported telemetry types

The {plugin_0} for Palo Alto Networks Telemetry Pipeline supports these telemetry types:

| Logs | Metrics | Traces |
| :-: | :-: | :-: |
| <Icon icon="circle-check" color="green" /> | <Icon icon="ban" color="red" /> | <Icon icon="ban" color="red" /> |

## Configuration parameters

Use the parameters in this section to configure the {entity_0}. The
Palo Alto Networks Telemetry Pipeline web interface uses the items in the **Name** column to
describe these parameters. [Pipeline configuration files](/ingest/pipeline/v2/configure/config-files)
use the items in the **Key** column as YAML keys.

### General

| Name | Key | Description | Default |
| - | - | - | - |
| **Confluent Cloud Bootstrap Servers** | `brokers` | Required. The Confluent Cloud bootstrap servers can be found within the cluster configuration settings. | `SERVERNAME.confluent.cloud:9092` |
| **Confluent Cloud Topic** | `topics` | Required. The Confluent Cloud Topic to send information to. | *none* |
| **Confluent Cloud API Key** | `rdkafka.sasl.username` | Required. Confluent Cloud API Key. | *none* |
| **Confluent Cloud API Secret** | `rdkafka.sasl.password` | Required. The Confluent Cloud API Secret. | *none* |
| **Format** | `format` | Specifies a data format. Accepted values: `json`, `msgpack`. | `json` |

### Advanced

| Name | Key | Description | Default |
| - | - | - | - |
| **Message Key** | `message_key` | Optional key to store the message. | *none* |
| **Message Key Field** | `message_key_field` | If set, the value of `Message_Key_Field` in the record will indicate the message key. If not set nor found in the record, `Message_Key` will be used if set. | *none* |
| **Timestamp Key** | `timestamp_key` | Sets the key to store the record timestamp. | *none* |
| **Timestamp Format** | `timestamp_format` | Sets the format. Accepted values: `double`, `iso8601`. | `double` |
| **Body Key** | `body_key` | Specifies the key that contains the body. | *none* |
| **Queue Full Retries** | `queue_full_retries` | Palo Alto Networks Telemetry Pipeline queues data into `rdkafka` library. If the underlying library can't flush the records the queue might fill and block new addition of records. This option sets the number of local retries to enqueue the data. The interval between each retry is 1 second. Setting `queue_full_retries` to `0` to set an unlimited number of retries. | `10` |
| **Security Protocol** | `rdkafka.security.protocol` | The security protocol used to communicate with Confluent Cloud. | `SASL_SSL` |
| **SASL Mechanism** | `rdkafka.sasl.mechanism` | The SASL authentication mechanism for the API. | `PLAIN` |

### Extended librdkafka parameters

This plugin uses the [librdkafka](https://github.com/confluentinc/librdkafka)
library. Certain configuration parameters available through the Palo Alto Networks
Telemetry Pipeline UI are based on librdkafka settings. These parameters generally
use the `rdkafka.` prefix.

In addition to the parameters available through the
Palo Alto Networks Telemetry Pipeline UI, you can
customize any of the
[librdkafka configuration properties](https://github.com/confluentinc/librdkafka/blob/master/CONFIGURATION.md)
by adding them to a pipeline configuration file. To do so, append the `rdkafka.`
prefix to the name of that property.

For example, to customize the `socket.keepalive.enable` property, add the
`rdkafka.socket.keepalive.enable` key to your configuration file.


## Related topics

- [Scalyr DataSet destination plugin](/ingest/pipeline/plugins/destination-plugins/scalyr.md)
- [Confluent Cloud source plugin](/ingest/pipeline/plugins/source-plugins/confluent-cloud.md)
- [Google Cloud BigQuery destination plugin](/ingest/pipeline/plugins/destination-plugins/google-bigquery.md)
- [Send telemetry data with destination plugins](/ingest/pipeline/plugins/destination-plugins.md)
- [Axiom destination plugin](/ingest/pipeline/plugins/destination-plugins/axiom.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.