Creating a control coverage Dashboard

It's a good exercise to create a customized control coverage Dashboard to help understand control coverage . Start by choosing a particular control you're interested in, then follow the steps below.

You will be guided through creating a new Dashboard and adding metrics. If this is your first time creating a Dashboard and you would like more information before you start, then you can find more information on the Creating a dashboard page.

Steps to create the control coverage dashboard

Before you start this guide, it is helpful for you to be familiar with the Control Check configuration that is being applied to your Devices. You can access the Control Check catalog by clicking the Control Checks button on the left-hand navigation bar. You can search for all data source coverage Control Checks and access their configuration by selecting them from the catalog.

For each Control Check, you'll see the three pieces of logic.

For details on control check logic, see Understanding control coverage and control checks

1. Click the Dashboards button on the left-hand navigation bar to access the Dashboards menu.

   

2. Click the New Dashboard button.
3. You will see the Dashboard editor view. At the top of the screen, give your Dashboard a title such as "Control coverage - exercise", and the first Section a title such as "Control coverage overview".

4. Next, you'll add five metrics to your Dashboard that will help you to understand the coverage of your chosen control. In this example, we'll use AV. The first metric you'll add is called Devices - you can search for it by entering the term 'Devices' into the search box on the left-hand side and scrolling through the list of metrics.

   

5. Drag the metric over to your Control coverage overview section. You should see a space below the Section title and description that says, "Add metrics by dragging them from the metric catalog."

   

6. Click the down arrow on the right-hand side of the metric so that you can edit its size. At the bottom of the metric editor, you can set the card width to 'Full-width'.

   

7. By default, this metric will appear as a single number without any trend lines, and its title is "Devices". If you'd like to see how the Dashboard looks, click the Save and Preview button on the top menu bar.

   

8. Click the Edit button on the top menu bar to reenter the editor view. Next, search for the metric called Devices expected in <control>, where '<control>' is your chosen control. Drag that metric to your Control coverage overview section underneath Devices.

   

9. We want to add the third and fourth metrics called Devices missing from < Control>, where '<control>' is your chosen Control. One represents the number of devices, and the other represents the percentage of devices. Please select the metric that represents the number of devices first and drag it to your Control coverage overview section underneath Devices expected in < Control>, then do the same with the metric that represents the percentage of devices.

   

10. You can click the Save and Preview button again to see how your Dashboard looks.

    

11. Add another Devices missing from <Control>, where '<control>' is your chosen Control. Drag that metric to the bottom of your Control coverage overview section and click the down arrow on the right-hand side of the metric so that we can edit some of its properties. You're going to edit this metric so that you see the number of devices missing from your chosen control, broken down by Device Type and Device Subtype.

    

12. Change the Custom Title to say "Number of devices missing from <control> by Device Type and Subtype".
13. Click the Add Breakdown Dimension button and select Device Type from the dropdown list.

14. Click on the Add Breakdown Dimension button again and select Device Subtype from the dropdown list that appears.

    

15. You'll notice that you now have the option to change the Visualization Type (via the dropdown under your breakdown dimensions). Select 'Stacked Bar Chart' from the dropdown list.
16. Finally, scroll to the bottom of the metric and set the card width to 'Full-width'.
17. You will add a new Section to your Dashboard that will help you review those Devices that have appeared in your chosen Control but are not expected. First, scroll to the bottom of the screen and click the Add Section button. Give your Section a title such as 'Devices for review'.

18. Find the Devices metric used in step 4 and drag it to your new Section. This time, you're going to edit the filters that are applied to the metric. 

    

19. Open the metric editor view and set the Custom title to 'Devices seen but not expected in <control>'. Click on the Filters button.

    

20. Find the 'In <control>' column by searching for it. Click the column and select "True" from the values section.

    

21. Next, find the 'Expected in <control>' column and select "False" from the values section.

    

22. Click OK. You'll see your two filters underneath the Filters button.
23. Add a Device Subtype Breakdown Dimension (or choose an attribute that you find interesting) and change the Visualization Type to 'Number Trellis Chart.'
24. Finally, set the card width to 'Full-width'.
25. You can continue to Save and preview your Dashboard as a draft or click the Publish button to publish your Dashboard and enable sharing with others. 

Reviewing your control coverage Dashboard

Now that you've finished creating your Dashboard, please open it and look through the metrics in detail. You'll notice that in the first section, three metrics represent the numbers of Devices:

1. The first represents the total number of Devices in your Inventory.
2. The second represents the number of Devices that are expected to be covered by your chosen control (a subset of the total number of Devices in your Inventory).
3. The third represents the number of missing Devices from your chosen control.

There is also a percentage of Devices missing from your chosen control. It is important to notice that this percentage is calculated as follows:

Percentage of missing Devices = 100 * (Number of missing Devices / Number of expected Devices)

You can investigate the missing Devices further by using the stacked bar chart you created at the bottom of the section.

Scroll down to the second section, Devices for review. As mentioned above, this represents Devices that have been seen recently by your chosen Control but that aren't expected to be covered. Since you're not expecting to see these Devices covered by your Control, this indicates that the Control Check logic is not configured correctly (i.e., it doesn't include as many Devices as it should in the Expected logic) or that your source system is not configured as expected (i.e., it is covering more Devices than it should). Use this visualization to investigate further.