Skip to main content
This information is for Palo Alto Networks Telemetry Pipeline, which is a standalone product separate from Palo Alto Networks Cortex XCOR.
The information on this page applies to pipelines with the Deployment or StatefulSet workload type, but not pipelines with the DaemonSet workload type.
Palo Alto Networks Telemetry Pipeline uses replica pods to scale pipelines. Each pipeline needs at least one replica to function. If a pipeline has more than one replica, any ingested data is balanced between those replicas accordingly. You can assign a fixed number of replicas to a pipeline, or enable horizontal pod autoscaling to automatically add and remove replicas in response to utilization changes.

​
Fixed number of replicas

Use one of the following methods to set a fixed number of replicas for your pipelines:
For replica counts with a volume over 100 TB a day, contact Cortex XCOR Support prior to scaling up to ensure stability.
  1. Sign in to the Palo Alto Networks Telemetry Pipeline web interface.
  2. Open the project that contains the pipeline that you want to modify.
  3. Go to Core Instances, then click the name of the Core Instance associated with the pipeline that you want to modify.
  4. Under Data Pipelines, click the name of the pipeline that you want to modify.
  5. Go to  Advanced Settings.
  6. Increase the Replicas field to the amount you want, and then click Apply.

​
Horizontal pod autoscaling

Requires Core Instance version 2.12.3 or later.
Pipelines support horizontal pod autoscaling (HPA), which enables Palo Alto Networks Telemetry Pipeline to add and remove replicas as needed.

​
Enable horizontal pod autoscaling

To enable HPA, create or modify a pipeline through Pipeline CLI and include the --min-replicas and --max-replicas flags. You must assign a value greater than 0 to --min-replicas, and the value of --max-replicas must be greater than or equal to the value of --min-replicas. For example:
Replace PIPELINE with the name or unique ID of the pipeline you want to modify.

​
Configure horizontal pod autoscaling

To configure HPA, use the following flags when you create or update a pipeline through Pipeline CLI: Scale-up and scale-down policies are optional. If you set a scale-up or scale-down policy, you must specify the type, value, and period for that policy in the same command. For example:

​
Disable horizontal pod autoscaling

To disable HPA, update a pipeline through Pipeline CLI and include the --disable-hpa flag:
This flag resets the minimum and maximum replica counts, scaling policies, and utilization targets for the pipeline, and deletes the autoscaler from the cluster. The pipeline then runs with the fixed number of replicas set by its --replicas value. You can’t combine --disable-hpa with any other HPA flag in the same command. To re-enable HPA later, run the update pipeline command again with the --min-replicas and --max-replicas flags.

​
Pause a pipeline

You can pause a pipeline by setting its replicas to zero, which temporarily prevents that pipeline from routing or processing data. Use one of these methods to pause a pipeline:
  1. Sign in to Palo Alto Networks Telemetry Pipeline.
  2. Open the project that contains the pipeline that you want to pause.
  3. Go to Core Instances, then click the name of the Core Instance associated with the pipeline you want to pause.
  4. Under Data Pipelines, find the pipeline that you want to pause, and then click  Settings >  Pause.
  5. In the dialog that appears, click Yes to confirm your choice.

​
Unpause a pipeline

If a pipeline is paused, use one of these methods to unpause it:
  1. Sign in to Palo Alto Networks Telemetry Pipeline.
  2. Open the project that contains the pipeline that you want to unpause.
  3. Go to Core Instances, then click the name of the Core Instance associated with the pipeline you want to unpause.
  4. Under Data Pipelines, find the pipeline that you want to unpause, and then click  Settings >  Resume.
  5. In the dialog that appears, click Yes to confirm your choice.