Prefer a guided lab? Take Exploring Metrics for
metrics querying and DDx, or take Alert Response and
Troubleshooting when you’re
using DDx during an incident.
Production environment
is strongly correlated to the query, you might use a filter to isolate metrics
from that environment and compare it to further identify correlations. After identifying
the next strongly correlated item, use additional filters to focus on the problem.
DDx provides the following benefits:
- Dimension exploration: Given an arbitrary query with an anomaly, you can quickly visualize all the dimensions available for the metrics present. You can then use this information to understand the surface area of the available for exploration. You can include and exclude dimensions from the results to enable hypothesis testing.
- Automatic correlation analysis: Cortex XCOR automatically explores metrics using variations of your query, and leverages all available dimensions. It also adapts to your data by incorporating new labels and values as they appear. Cortex XCOR compares the results to the original query and surfaces the time series that are most closely correlated with the anomaly.
Access DDx
Metrics DDx isn’t part of the main navigation menus in Cortex XCOR. Because DDx operates on metrics you’ve already visualized elsewhere in Cortex XCOR, you access it through Metrics Explorer, from metrics visualization panels such as services and dashboards, or from individual monitors. To investigate a query or chart with DDx, look for a DDx link. Some panels in Cortex XCOR with a three vertical dots menu might also contain a Metrics DDx link, but not all menus have this link. To access DDx from Metrics Explorer:- In the navigation menu select Explorers > Metrics Explorer.
- In the section of the query that you want to investigate, click DDx to display the Metrics DDx page, prepopulated with that query.
- Create or modify the query if necessary.
- Click Run.
- In the navigation menu select Alerting > Monitors.
- Select a monitor from the list.
- In the monitor navigation bar, click DDx to display the Metrics DDx page, prepopulated with the monitor’s query.
- Generate a query in Metrics Explorer.
- In any chart, click the three vertical dots and then select Metrics DDx. The Metrics DDx page opens with the query box pre-populated by the query used in the panel. If Metrics DDx doesn’t appear, DDx might not support that panel’s query. For example, Metrics DDx operates on one query at a time. If a panel uses multiple queries, it can’t use Metrics DDx.
Query data in DDx
When accessing DDx, Cortex XCOR run any query related to the origin page or panel and displays the results on the Metrics DDx page.Filter data in Metrics DDx
Use pins in label graphs to add a filter:- Hold the pointer over a series in the chart and click it to pin the series.
- In the dialog box, click to add that label value to the filters.
x on the filter’s chip or click
in the filter box. Click Reset filters to remove
included or excluded label filters from the page.
Use X-Ray to expand queries
Cortex XCOR uses derived metrics to reduce query time and complexity. The X-Ray feature lets you explore queries that use derived metrics so you can see which specific metric correlates with the problem you’re seeing. If any metrics used in the query are generated by either a recording rule or derived metric, you can replace your query with one more similar to the raw data by clicking X-Ray. This revised query might contain additional dimensions useful for correlation.Understand Metrics DDx insights
The Metrics DDx page displays information about correlations within your query’s results. To change the time range of displayed query results, use the time range selector or click and drag a time range within a chart. Changing the time range also updates the Metrics DDx analysis. You can pin a time range by clicking the range selector pin, which makes the range persistent as you view other pages in Cortex XCOR. As your investigation continues beyond Metrics DDx, pinning your time range ensures that your focus on other pages remains on the same period.Correlation summary
The Correlation summary is the result of Metrics DDx automatically analyzing the query results and attempting to summarize its findings by listing labels and values with the strongest correlation to the query. The summary also indicates Single cardinality labels by appending a blue dot to them. Single cardinality labels are less valuable for correlation than Multiple cardinality labels because their shapes are the same as the comparison graph. If the summary suggests that a label “is only<no value>”, this indicates that
some time series don’t have this label.
For conciseness, the summary hides other labels and values that have weaker correlations
by default. In such results you can click the Show more link to view those labels
and values.
Query result
The query generates a Query result panel group with a Query results chart, which is the same as the chart that Metrics Explorer would generate from the query. The Query result panel group also includes a Correlation comparison graph, which visualizes the time series used for all correlation comparisons. It aggregates the query to a single metric for comparisons in the Label breakdown, where it helps you determine whether a correlation is present, and if so its nature. By default, Cortex XCOR usessum to aggregate the query. If you use
another aggregation in your query, Cortex XCOR uses that aggregation
over the entire original query. For example, if you use max, then Cortex XCOR
uses that aggregation over the entire query instead of sum.
Label breakdown
Use the Label breakdown section to view, filter, and visualize query results by label and value to help you identify the most correlated data.- The section’s sidebar includes each label as an expandable list containing its values, sorted by default to list the values most strongly correlated to the query. Each label also includes a count of its unique values.
- The section’s panel groups displays charts to visualize labels by their values’ correlation.
Sort labels by correlation
The list of labels is sorted from highest to lowest correlation score by default. Labels with high correlation scores contribute more data to a given chart. Use this sidebar’s indicators of correlation strength to prioritize your investigation and remove values from visualization. To change how the list is sorted, click the sort dropdown, which defaults to listing the Most correlated values first. You can choose to instead sort by Least correlated, or alphabetically by Name. Cortex XCOR indicates the relative correlation scores of each of a label’s values with an icon next to the value that indicates strong (three bars), moderate (two bars), weak (one bar), or no correlation (zero bars). Hold the pointer over the icon to display the value’s precise correlation score, which ranges from 0 to 100.Filter data by labels
When you hold the pointer over a label, additional icons also appear:- Include label includes that label’s data across Metrics DDx. Include labels that indicate a correlation in the query to exclude other labels from visualizations.
- Exclude label excludes that label’s data across Metrics DDx. Exclude labels that don’t indicate a correlation to remove them from visualizations for improved clarity.
Filter the list of labels and values by keyword
You can filter the list of both labels and values by keyword search. Begin typing in the sidebar’s search bar to display only the labels and values that match. Filtering by search doesn’t apply filters that affect the Label breakdown section’s correlation visualizations. You can optionally hide the sidebar by clicking the collapse control, or resize it by clicking and dragging the gap between the sidebar and the visualizations.Visualize correlations
By default, Cortex XCOR renders one graph per label name by grouping the values of each label in the query and rendering them as a correlation graph. For example, thecontainer label might have two values, recommendationservice
and <empty>, which Cortex XCOR displays as <no value>, meaning some
metric series don’t have this label.
To render a graph per value for a selected label, click the One graph per dropdown
and select the label you want to investigate. Single cardinality labels are
not included in the dropdown because they’re the same shape as the comparison graph.
Click the arrow to expand this section.
Toggle Show comparison to overlay the Correlation comparison graph results on
the cardinality label graphs. Single cardinality labels are hidden because they’re
the same shape as the comparison graph.
Toggle Show Y axis to include it in charts. The Y axis is disabled by default
to more strongly focus on making visual comparisons between and within charts.
To change the graph size to suit your display or presentation, select a Small,
Medium, or Large size from the Graph Size selector.
In any Metrics DDx panel, click the three
vertical dots to access additional options. See common panel
elements for an explanation of the other
available tools.