You will find a comprehensive data pipeline overview on the Device Inventory page. You will see details about each stage of our data lineage implementation, tracking the transformation of raw records from various security tools into unified device entities. This view helps to build confidence in the data you're being presented and the Control Checks, metrics and Dashboards that sit on top of it.
How to access the data lineage view
- To access the data lineage view, click on Inventory
and then Devices.
- Select the “Devices reduced through Data Pipeline” tab.
Five stages of data pipeline
| Stage | Description |
| Step 1- Total devices from all security tools | This represents the total count of raw device records fetched from all of your connected security tools. |
| Step 2 - Duplicates merged |
At this stage, entity resolution is performed to merge duplicate device records. The output shows the number of devices after this merging process. Hovering over Step 2 will reveal the count of duplicate devices merged during the entity resolution. |
| Step 3 - Business logic applied | At this stage, business logic is applied to the device data. Typically, there is no reduction in the device count after this step. |
| Step 4 - Inactive devices filtered |
At this stage, inactive devices are filtered out of the results based on a specified time frame (e.g. devices that haven't been seen for the last 30 days). Hovering over Step 4 will reveal the counts of inactive devices that have been filtered out of the results. |
| Step 5 - Total unique active devices in Panaseer | This stage shows the final count of active devices that are considered for metrics and Control Checks. It represents the total number of unique and active devices within the Panaseer platform. |
Frequently asked questions
- I am unable to see this feature in my Panaseer instance.
To access this feature, you must be on the latest packaged connectors. For more information about upgrading, please contact your CSM or submit a support ticket .
- The inactive device filter applied in Step 4 is incorrect for me. It says 14 days instead of 30 days.
Please get in touch with your CSM to have the filter logic changed.
-
How often do the device counts get updated?
Our pipeline runs every day to bring in the latest data from your security tools. Your device counts, and the data pipeline view gets updated daily as part of this pipeline.
-
What are all the filters I see in Step 4?
For now, you will see only inactive device filters as part of the data lineage view, as this is the critical filter for your metrics. In future, we will enhance this step to surface all the different filters applied across metrics and Control Checks across various security modules.
-
What happens if there is a technical or API failure?
Users will see an error message in the UI in case of any technical errors. Please contact your CSM immediately.
-
Why are the counts in the inventory widget zero?
The device counts are zero if there are no security tools integrated with your instance of the Panaseer platform.
Comments
0 comments
Please sign in to leave a comment.