Arctera Data Insight
Arctera Data Insight
February 2025
Arctera Data Insight
Legal Notice
Copyright ©2025 Arctera US LLC. All rights reserved.
Arctera and the Arctera Logo are trademarks or registered trademarks of Arctera US LLC
or its affiliates in the U.S. and other countries. Other names may be trademarks of their
respective owners. This product may contain third-party software for which Arctera is
required to provide attribution to the third party (“Third-party Programs”). Some of the
Third-party Programs are available under open source or free software licenses. The License
Agreement accompanying the Software does not alter any rights or obligations you may
have under those open source or free software licenses. Refer to the Third-party Legal
Notices document accompanying this Arctera product or available at:
https://www.arctera.io/license-agreements
The product described in this document is distributed under licenses restricting its use,
copying, distribution, and de-compilation/reverse engineering. No part of this document
may be reproduced in any form by any means without prior written authorization of
Arctera US LLC and its licensors, if any.
The Licensed Software and Documentation are deemed to be commercial computer software
as defined in FAR 12.212 and subject to restricted rights as defined in FAR Section 52.227-19
"Commercial Computer Software - Restricted Rights" and DFARS 227.7202, et seq."
Commercial Computer Software and Commercial Computer Software Documentation," as
applicable, and any successor regulations, whether delivered by Arctera as on premises or
hosted services. Any use, modification, reproduction release, performance, display or
disclosure of the Licensed Software and Documentation by the U.S. Government shall be
solely in accordance with the terms of this Agreement.
Customer service
Customer service information is available at the following URL:
www.arctera.io/support
Customer Service is available to assist with non-technical questions, such as the
following types of issues:
■ Questions regarding product licensing or serialization
■ Product registration updates, such as address or name changes
■ General product information (features, language availability, local dealers)
■ Latest information about product updates and upgrades
■ Information about upgrade assurance and support contracts
■ Advice about technical support options
■ Nontechnical presales questions
■ Issues that are related to CD-ROMs, DVDs, or manuals
Support agreement resources
If you want to contact us regarding an existing support agreement, please contact
the support agreement administration team for your region as follows:
Worldwide [email protected]
Contents
Technical Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
Chapter 2 Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
About Arctera Data Insight Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11
Storage Utilization Trends . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15
Chapter 3 Workspace . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
About Arctera Data Insight Workspace . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
Users . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22
Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23
Chapter 5 Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
About servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Servers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
Data Sources . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Filers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38
Adding filers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39
Viewing configured filers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Editing filer configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
Managing filers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41
Monitored Shares . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
About disabled shares . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Contents 7
SharePoint Online . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
About SharePoint Online account monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Registering Data Insight with Microsoft to enable SharePoint
Online account monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
Configuring application without user impersonation for Office
365 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Creating an application in the SharePoint Admin Center . . . . . . . . . . . . . . 51
Add SharePoint Online accounts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 53
Managing Site Collections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
Monitored Site Collections . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57
OneDrive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 58
Configuring OneDrive account . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Registering Data Insight with Microsoft to enable OneDrive
account monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Configuring application without user impersonation for Office
365 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Add/Edit OneDrive account . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Monitored Cloud Accounts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Chapter 9 Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
Requests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 82
Setting up Classification . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83
Chapter 11 Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
About Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86
Contents 8
Chapter 12 Workflows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
Workflows . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 89
Task . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 90
■ Monitored Content, which shows the total size of storage that is being
monitored. You can see the storage trend as a percentage, indicated by an
upward or downward arrow, below the total size of the monitored content.
■ Devices, which displays total devices or accounts that are being monitored.
■ Repositories, which displays number of Shares, Sites or Accounts that are
being monitored.
■ Scan, which shows number of files scanned till date.
■ Sensitive Content, which displays number of files with classification tags.
■ Top Data Sources tile will list your top data sources and their details like
number of files, storage utilization and classification tags attached to the
device. In the Storage Utilization column, you can see the storage trend as a
percentage, indicated by an upward or downward arrow. For more
information, See “Data Sources” on page ?.
After clicking More Information at the bottom of this tile, you will be redirected
to the Data Sources page.
■ File Aging gives you information about last accessed time of the files. If the
file was not accessed for last 3 years, it will be marked as Obsolete. If the file
was not accessed over 6 months but was accessed in 3 years will be marked
as Stale. If the files was accessed in last 6 months, it will be marked as Active.
File Aging is computed every midnight and you can generate a report to know
more details.
You can use drop-downs on the tile to select specific data source, either file
size or count, and select either all files or files with sensitive data. Once you
select desired values, the information on the tile will be updated accordingly.
Dashboard 14
About Arctera Data Insight Dashboard
■ Access Intelligence will provide information about the activities (audit events)
executed on registered M365 devices. You can filter the data by time or by
sensitive data. The color bar will display information about the type of event,
total number of events and comprehensive file or folder count.
Dashboard 15
Storage Utilization Trends
Note: Only User and Server Administrator roles will have access to the
dashboard
If there is no device added, a message will appear on the page. Click Add Device
on the page to configure a device and start using Data Insight
This feature allows users to track data growth by comparing the current data
volume with a previous baseline, helping to identify patterns of expansion.
Whether monitoring storage usage, database sizes, or other data metrics, it equips
users with clear, actionable information on how much the data has increased
within a specific time-frame. Such tracking is crucial for planning, capacity
management, and understanding system or application behavior over the last 30
days.
Chapter 3
Workspace
This chapter includes the following topics:
■ Data
■ Users
■ Groups
Data
This tab provides in-depth analysis of the configured data sources. The Data tab
will enable you to view the file system hierarchy and analytics for configured
data sources. You can assign a custodian, export the details or refresh the table
from this page.
The Summary section on the right side will display all details of the configured
data source. Refer to the following table for more information.
On folder and file level, there are more details in the Summary. Refer to the
following table for more information.
Workspace 19
Data
Sensitive Yes / No
On the same page, you can view, filter, and download audit events by clicking
the Audit Activities tab. You can find detailed information about each event in
the filter, allowing you to see which task was performed and by which user.
Audit events will also play a crucial role in identifying and resolving any issues
related to a specific data source. Audit events of last 30 days appear by default.
The date range can be changed using the filter. The start and end dates for fetching
audit events can not be more than 365 days. Detailed report of audit events can
be downloaded by clicking the Download icon.
Workspace 20
Data
If you apply filter in Audit Activities, you can have multiple options to sort data.
Use Operations drop-down to select audit action like create, write or write. You
can check the Sensitive Files Only check-box to fetch audit reports of sensitive
only. You can also specify start and end date.
Click Apply and list of audit activities, as per your selected values will appear in
the section.
Workspace 21
Data
Note: The Audit Activities feature is available for SharePoint and OneDrive data
sources only
■ After clicking Actions drop-down, select Delete Files to delete files from the
data source. Enter a unique name and description. If you want to use already
assigned custodian, check the Use assigned custodian box. If you check the
box, existing custodian will be used in this workflow. Click Save to create a
workflow. Once the workflow is created, a task will be created for the
custodian and only after custodian approves that task, file will be deleted
from the data source.
Note: To delete files, you must setup delete configuration and enable it for this
action to work.
■ At Data Source/Share /file/ folder level, you can click Actions to export the
table data or refresh the table. If you click Export on any level, all files and
folders at that level will be exported in the CSV format. For SharePoint data
sources, exported file at repository level will have an additional recycle bin
size column.
■ At repository /folder/file level, you can click Actions to classify the selected
paths or to export and refresh the data. If you select files or folders and click
Classify, a Classification Configuration pop up will appear. Classify only
new or modified files option will be selected by default. This option will
enable you to classify only modified files but if you want to classify all files,
uncheck the box. Click Classify to proceed.
Users
The Users tab will enable you to view a list of users for the configured directory
services. You can search a particular user by using the Search box at the top. You
can also sort users alphabetically by clicking column header Name.
For detailed information about the user, click Expand Profile in the right pane.
Workspace 23
Groups
All details about the user like Name, Login Name, and Email appear in the
Summary tab. Additional information like if the user is Disabled or Deletedwill
appear in the same section on the right side. If the user is disabled or deleted, the
entry will be marked in red with a strike-through. Click Audit Activities to view
all audit entries for all the shares assigned to the user. You can download the
details or filter the data using respective options in the tab.
If you click >> next to the Search by Name field, Deleted and Disable filters will
appear on the page. You can check the required box and list of deleted or disabled
users will be visible in the right pane.
Groups
The Groups tab will enable you to view a list of groups associated with the
configured directory services. You can search a particular group by using the
Search box at the top. You can also sort groups alphabetically by clicking column
header Name.
Group Name and current status of the group, is it Disabled or Deleted, will appear
in the Summary section on the right side. If the group is disabled or deleted, it
will be marked in red with a strikethrough.
For detailed information about a particular group, click Expand Profile in the
right pane.
Workspace 24
Groups
All details about the group like Name, SID, Member of groups, Users and other
group details appear on the page. You can also find additional information like
if the group is part of any other group or member of this group are part of any
other groups.
Chapter 4
Installing Collector Node
This chapter includes the following topics:
5 After brief interval, Setup pop-up appears on the screen. Click Next.
6 On the License Agreement pop-up, review and select I accept the agreement
radio button and click Next.
Installing Collector Node 28
Downloading and Installing Arctera Data Insight Collector
Once you complete the process, the installed server will appear in the Servers
tab. See “Servers” on page 35.
Post-installation
Steps to verify that Data Insight has been installed properly.
■ Check if following services are running
■ ArcteraDataInsightSchedulerService
■ ArcteraDataInsightTokenManagerService
■ ArcteraDataInsightVICClientService
■ ArcteraDataInsightVICServerService
■ Log in to Data Insight with Admin user credentials. Click Servers tab in the
left pane. Newly installed on-prem collector agent name should be visible.
■ Check the following Log locations and confirm that there is no error.
■ <InstallDIR>\log\scheduler\schedulerservice.log
■ <InstallDIR>\log\tokenmanager\tokenmanager.log
■ <InstallDIR>\log\vicclient\vicclient.log
■ <InstallDIR>\log\vic.log
■ About servers
■ Servers
About servers
To monitor on-premises data sources, you’ll need to deploy Arctera Data Insight
collectors on servers within your environment. This approach ensures data
sovereignty by scanning, classifying, and monitoring your on-premises data
sources entirely within your infrastructure. The collectors communicate with
the Arctera Data Insight cloud-based management pane to maintain and update
the metadata index. You can manage connected servers and monitor their health
using the server module.
Servers
You can perform multiple actions on the installed servers by clicking Servers in
the left pane. List of the installed servers, along with Server Name, Role and
Update status is visible on this page. If there are multiple servers installed, you
can search specific server by typing the name in the Search bar and pressing
enter. You can also refresh the list by using the refresh icon next to the search
bar.
Servers 36
Servers
Click Server Name or click server to know more details. The Server Information
page will have Server Name, Role and Product Update information.
By clicking the Actions menu on the right side, and clicking View, you can view
details like roles assigned to the server, server name and product update. You
can also remove server from your environment by clicking Delete. However,
even if you remove the server virtually from the interface, you need to manually
uninstall it from the environment to complete the process. After clicking Delete,
a pop-up will appear on the screen which will have details about uninstalling it
manually.
Click Yes and uninstall the server manually by following the steps. Before
initiating delete, make sure that there are no devices connected to the server. If
there are any devices connected, you will not be able to delete the server from
your environment. Once you initiate delete action, Data Insight will validate the
details and remove the server only after successful validation.
Servers 37
Servers
Note: If you restart the Scheduler service on the collector server node, then
server re-registers itself with cloud node automatically and it will start appearing
on the Servers page. So, if you delete a server from this page, make sure that you
uninstall the collector.
Chapter 6
Data Sources
This chapter includes the following topics:
■ Data Sources
■ Filers
■ SharePoint Online
■ OneDrive
Data Sources
A data source is a location or system that stores and manages data. A data source
can refer to the digital location where data can be stored as a data table, data
object, or another storage format, which can be used to analysis, processing, and
classifying.
Data Insight currently supports following data sources:
■ Generic device
■ SharePoint
■ OneDrive
Filers
Add New Generic Device
Data Insight supports scanning varied file systems for generic devices.
The Filers page will list all the configured generic device. You can click the Action
menu on the right to View, Edit, Delete or Disable an existing generic device.
Data Sources 39
Filers
Credential Details
Credentials required for scanning of shares. Required for scanning of shares from the
filer.
Adding filers
You must add filers that you want Arctera Data Insight to monitor.
To add filers
1 In the console, click Data Sources and click sub menu Filers in the left pane.
The Filers page displays the list of configured filers.
2 On the Filers page, click Add New Generic Device.
3 On the Add New Generic Device pop-up. Refer to the table for details.
Data Sources 40
Filers
Field Details
Discover shares automatically Check the box if you want Data Insight to
discover newly added shares. You can also
exclude specific shares by adding it in the
provided space.
After entering the required information, click Save to complete the process.
Managing filers
On the Filer Details page, you can view detailed information about a configured
filer. To go to the Filer Details page, click Data Sources > Filer in the left pane.
Data Sources 42
Filers
Click the filer that you want to review or click Action menu next to the filer and
click View.
The Configuration tab on the filer details page displays the following information
about a filer:
You can view, edit or disable the filer by navigating to Filers and clicking the
filer or clicking the Action menu on the right side.
You can view events specific to the configured filer such as the status of scans
on the filer.
To disable a filer
1 Follow the path given above and click Disable.
2 Click OK on the confirmation message.
Once you disable a filer, no new scan will be triggered. Data for already scanned
shares will be visible for the disabled filers.
Monitored Shares
To monitor configured shares, click Filers in the left pane and click configured
device. On the filer details page, click Monitored Shares. On this page, all shares
are listed with details like Share Name, Type, Status, and Scanning Schedule.
You can perform various operations on individual or multiple shares. You can
scan, enable and disable shares by selecting the required share/s and using menu
options or Actions menu on the right side of shares. You can also set discovery
of new shares by configuring it at the filer level.
Next to the menu options, there is a Search bar to search share by name. This
option will help you in finding the required share quickly, when the list contains
very large number of shares. You can also refresh the list and toggle selection
list by using subsequent options next to the search bar.
Data Sources 43
SharePoint Online
SharePoint Online
Data Insight provides the ability to monitor the unstructured data that resides
in SharePoint Online, a cloud-based service from Microsoft. Data Insight discovers
the site collections configured for that account. You can also configure Data
Insight to exclude certain site collections from being monitored. This might be a
requirement when you have personal data that you do not want to be monitored.
■ When adding a SharePoint Online account, Data Insight excludes the following
site collections from getting discovered.
■ <companyname>.sharepoint.com/portals/community
■ <companyname>.sharepoint.com/search
■ <companyname>.sharepoint.com/sites/CompliancePolicyCenter
■ <companyname>-my.sharepoint.com
11 On the Request API permissions panel that opens, select Microsoft Graph
and Microsoft 365 respectively, click Application permissions and grant
the permissions as per the table given below:
Group.Read.All
RoleManagement.Read.Directory
Sites.Read.All
User.Read.All
Files.ReadWrite.All
SharePoint
Sites.ReadWrite.All
ActivityFeed.ReadDlp
SharePoint Sites.FullControl.All
Go to the Overview page of the app and click Add redirect URI. The
Authentication page opens
14 Click Add a platform
15 On the Configure platforms panel that opens, click Web
16 Click Configure to save it.
Once the app is created, anybody in the organization can access the app. As per
Microsoft recommendation, restrict the access to specific users.
Data Sources 47
SharePoint Online
For information on how to require the user assignment for an app via the Azure
portal, refer to Configure an application to require user assignment Azure
documentation
For information on how to assign users or groups to an app via the Azure portal,
refer to Assign users to an app Azure documentation
Note: This step is done to provide PnP PowerShell Authentication with Service
Principal. If we do not do this then we will get error : Connect-PnPOnline :
AADSTS65001: The user or administrator has not consented to use the
application with ID'31359c7f-bd7e-475c-86db-fdb8c937548e' named 'PnP
Management Shell'. Send an interactive authorization request for this user
and resource
Data Sources 48
SharePoint Online
param (
[parameter(Mandatory=$true)]
[string]$Organization)
Import-Module PnP.PowerShell
$url = 'https://'+$Organization+'-admin.sharepoint.com'
Write-Output $url
$userCredential = Get-Credential
Connect-PnPOnline -Url $url -Credential $userCredential
get-PnPTenant
Set-PnPTenant -DisableCustomAppAuthentication $false
<AppPermissionRequests AllowAppOnlyPolicy="true">
<AppPermissionRequest Scope="http://sharepoint/content/tenant"
Right="FullControl"/>
</AppPermissionRequests>
Data Sources 50
SharePoint Online
8 Click Create
9 Click Trust It
You will be redirected to the SharePoint admin center.
3 In the Edit pane, click Add owner and select a user having Minimum Privilege
user credentials.
4 Click Save.
<AppPermissionRequests AllowAppOnlyPolicy="true">
<AppPermissionRequest Scope="http://sharepoint/content/tenant"
Right="FullControl"/>
</AppPermissionRequests>
8 Click Create
9 Click Trust It
You will be redirected to the SharePoint admin center.
Data Sources 53
SharePoint Online
The configuration details page appears. You can check Connection Details, Site
Collections Configuration, and Scanning Details. Click Monitored Site
Collections to see the site collection details. You can select site collection for
SharePoint Online and initiate scan, discover, enable or disable shares from this
tab.
To add a new SharePoint Online account
1 In the left pane, click Data Sources > SharePoint.
The SharePoint page displays the list of configured Online accounts.
2 Click Add SharePoint Online Account.
Data Sources 54
SharePoint Online
3 Use the dialog box to add a new SharePoint Online account to Data Insight.
Refer the table below for details:
Field Description
SharePoint Online Account Enter the SharePoint Online URL that you want Data Insight
URL to monitor. For example,
https://myaccount.sharepoint.com
Data Sources 55
SharePoint Online
Field Description
Add one client ID, Client Secret Key, authorize the app and
click Add More Apps to add another set of client
credentials.
Data Sources 56
SharePoint Online
Field Description
Automatically discover and This check box is selected by default. This option allows
add site collections in this you to automatically include all site collections in the
SharePoint Online account selected SharePoint Online account for the purpose of
monitoring.
Exclude following site Enter the details of the site collections which should not be
collections from discovery included during discovery.
Enable Scanning for this This check box will be selected by default and option will
SharePoint Online account be grayed out.
Data Sources 57
SharePoint Online
Field Description
Monitor SharePoint accesses This check box will be selected by default and option will
to this SharePoint Online be grayed out.
account
You can perform various operations on individual or multiple sites. You can
enable or disable Site / Site Collection by selecting the required site/s and using
menu options on the top ribbon or Actions menu on the right side of shares. If
you enable already disabled site, full scan will be initiated. You can also initiate
incremental scan or discover site collections from this page. In case of scanning,
you can opt to scan selected or all filtered records.
Next to the menu options, there is a Search bar to search site by name. This option
will help you in finding the required site quickly, when the list contains very
large number of sites. You can also refresh the list and toggle selection list by
using subsequent options next to the search bar.
You can sort the list alphabetically by clicking the arrow next to Title.
OneDrive
Data Insight monitors Microsoft OneDrive cloud accounts to provide information
about who owns the data, and what data should be archived or deleted. OneDrive
uses the Open Authorization 2 (OAuth2) protocol to permit access to a third-party
application.
In the Data Insight configuration, the OneDrive tenant account (your organization's
OneDrive account) corresponds to a file server and the individual user accounts
correspond to repository on a Data Source. To scan the OneDrive tenant account
and the underlying user accounts, Data Insight uses the access token provided
by the Microsoft app. To get the access token from the app, you must provide
the credentials of an Office 365 Minimum Privilege user on the redirect URL
page.
Click Data Sources > OneDrive, to open OneDrive page. On this page, configured
OneDrive accounts will be listed. You can see OneDrive Account URL, number
of monitored account and status. Click the Action menu to view, edit, enable or
disable the configured account.
Data Sources 59
OneDrive
Prerequisite
An Office 365 user with the Microsoft Global administrator role or with a role
which has lesser admin privileges than the Global administrator can create and
register an application with Microsoft. However, the user must be granted the
following four roles at the minimum:
1. Application Administrator : To create a Microsoft application
2. User Administrator: To get the access to OneDrive account of all the users
in tenant
Data Sources 60
OneDrive
Note: To assign the first three roles, refer to the Azure documentation and to
create a custom role (View-Only Audit Logs), access Azure Portal with Global
Administrator credentials and create a custom role (View-Only Audit Logs) and
assign it to the created user .
13 On the Request API permissions panel that opens, select Microsoft Graph
and Office 365 respectively, click Application permissions and grant the
permissions as per the table given below:
Group.Read.All
RoleManagement.Read.Directory
Sites.Read.All
User.Read.All
ActivityFeed.ReadDlp
SharePoint Sites.FullControl.All
Note: This step is done to provide PnP PowerShell Authentication with Service
Principal. If we do not do this then we will get error : Connect-PnPOnline :
AADSTS65001: The user or administrator has not consented to use the
application with ID'31359c7f-bd7e-475c-86db-fdb8c937548e' named 'PnP
Management Shell'. Send an interactive authorization request for this user
and resource
param (
[parameter(Mandatory=$true)]
[string]$Organization)
Import-Module PnP.PowerShell
$url = 'https://'+$Organization+'-admin.sharepoint.com'
Write-Output $url
$userCredential = Get-Credential
Connect-PnPOnline -Url $url -Credential $userCredential
get-PnPTenant
Set-PnPTenant -DisableCustomAppAuthentication $false
<AppPermissionRequests AllowAppOnlyPolicy="true">
<AppPermissionRequest Scope="http://sharepoint/content/tenant"
Right="FullControl"/>
</AppPermissionRequests>
Data Sources 65
OneDrive
8 Click Create
9 Click Trust It
You will be redirected to the SharePoint admin center.
3 In the Edit pane, click Add owner and select a user having Minimum Privilege
user credentials.
4 Click Save.
Field Description
Microsoft This is a free-form field. Enter a name that Data Insight uses to identify
OneDrive account your OneDrive account. The name that you enter in this field
name represents the name of the OneDrive tenant account.
Client ID The client ID is the unique application ID assigned when you create
and register an app with Microsoft. You can add up to 5 client IDs .
Client Secret Key
Client Secret Key: In the OneDrive App, navigate to the Certificates
Tenant ID
& secrets page. There is a code in the Value column under the Client
secret section. You need to use that code as a Client Secret Key while
configuring a OneDrive account in Data Insight.
If you have missed copying the code, go back to the Certificates &
secrets page in the SharePoint app and click + New client secret.
Copy the code in the Value column and use it as a Client Secret Key
in Data Insight.
You can add up to 5 client secret keys. Follow the procedure described
in the following topic to get these details:
Note: Microsoft servers might briefly block certain client credentials
for initiating frequent requests. In such scenarios, Data Insight fails
to retrieve data from the Microsoft servers. To eliminate such delay,
you can add up to 5 client credentials to the OneDrive Online account.
If one account is blocked by Microsoft, another client credential will
be used to fetch data.
Add one client ID, Client Secret Key, authorize the app and click Add
More Apps to add another set of client credentials.
Data Sources 67
OneDrive
Field Description
2 Data Insight can now access the user, folder and file metadata
and the information about the activities performed on these file
and folders. .
Discover cloud Select the check box to automatically discover all user accounts that
accounts are part of the OneDrive account.
automatically
Discovery of cloud user accounts takes place as soon as you add a
new user account.
Note: By default, discovery for new cloud accounts will happen every
Saturday at 2 AM.
Exclude following Enter the details of the cloud user accounts which should not be
cloud accounts included during discovery. This option is available when you select
from discovery Discover cloud accounts automatically check box. Specify comma
separated patterns that you want to ignore. Patterns can have 0 or
more wildcard * characters.
Enable Microsoft This box will be checked by default and it will be greyed out.
OneDrive account
scanning
Prerequisite
A Office 365 user with the Microsoft Minimum privilege user role or with a role
which has lesser admin privileges than the Minimum privilege user can create
and register an application with Microsoft. However, the user must be granted
the following four roles at the minimum:
1. Application Administrator : To create a Microsoft application
2. User Administrator: To get the access to OneDrive account of all the users
in tenant
3. SharePoint Administrator: To fetch the data in OneDrive and SharePoint
Online
4. Privileged Role Administrator: To give admin consent to Azure Application
5. A custom role (View-Only Audit Logs) in the Exchange Admin Center
To assign the first three roles, refer to the Azure documentation.
Directory Services 71
Registering Data Insight with Microsoft to scan Azure AD
To create and assign the View-Only Audit Logs role to a non-Global admin user
1 Login to Microsoft Admin Portal with the Minimum privilege user role,
navigate to Exchange Admin Center and click Classic Exchange Admin
Center in the left pane.
2 Click Permissions > Admin roles and click the + icon to create a new role.
The Role Group pop-up opens.
3 In the Role Group pop-up, enter a desired role name (ex. AuditReadRole).
Directory Services 72
Registering Data Insight with Microsoft to scan Azure AD
4 In the Roles section, click + and select the role "View-Only Audit Logs" and
click OK.
Directory Services 73
Registering Data Insight with Microsoft to scan Azure AD
5 In the Members section, click + and select the member that you want to
assign the minimum privilege role.
8 In the Client secrets section, click New client secrets to generate the access
token required for calling the required APIs
9 Set the expiry to Never and click Add.
10 Copy the Client Secret Value is generated. You will be required to provide
it later while adding an account in Data Insight.
11 Then you need to grant permissions to the app to use the Microsoft Graph
and Office 365 APIs.
On the left sidebar of your app, click API permissions, and then click Add
a permission.
12 Then click Grant admin consent for.., and confirm.
13 Now add the redirect URI.
Go to the Overview page of the app and click Add redirect URI. The
Authentication page opens
14 Click Add a platform
15 On the Configure platforms panel that opens, click Web
16 Provide the Data Insight Management Server IP address, as a redirect URI
in the following format: https://datainsight.us3.archive.veritas.com
/api/DirectoryServices/azureADRedirect
Note: Property value should be set to true for authenticating via FQDN
and false for authenticating via IP.
Field Description
Azure Active Enter the name of the active directory that you want to scan.
Directory Name
Client ID The client ID is the unique application ID assigned when you create
and register an app with Microsoft. You can add up to 5 client IDs.
Directory Services 76
Add/Edit Azure active directory service
Field Description
Client Secret Key Client Secret Key: In the Azure active directory, navigate to the
Certificates & secrets page. There is a code in the Value column under
the Client secret section. You need to use that code as a Client Secret
Key while configuring Azure active directory in Data Insight.
If you have missed copying the code, go back to the Certificates &
secrets page in the Azure active directory and click + New client
secret. Copy the code in the Value column and use it as a Client Secret
Key in Data Insight.
You can add up to 5 client secret keys. Follow the procedure described
in the following topic to get these details:
Note: Microsoft servers might briefly block certain client credentials
for initiating frequent requests. In such scenarios, Data Insight fails
to retrieve data from the Microsoft servers. To eliminate such delay,
you can add up to 5 client credentials to the Azure active directory.
If one account is blocked by Microsoft, another client credential will
be used to fetch data.
Add one client ID, Client Secret Key, authorize the app and click Add
More Apps to add another set of client credentials.
2 Data Insight can fetch users and groups present in Azure active
directory.
Note: After authorization, do not update the same set of client and
secret key.
Remove App Click Remove App to remove the application from your account.
If you are editing Azure active directory service, you will not be able to change
the Tenant ID. However, Data Insight allows you to add more applications and
change the following:
■ Azure Active Directory Name
Directory Services 77
Add/Edit Azure active directory service
■ Client ID
■ Client Secret key
■ Re-authorize or remove existing application
Chapter 8
Health and Monitoring
This chapter includes the following topics:
■ Scan Status
Scan Status
The Scan Status tab provides an overview of the status of the scans for all storage
devices that are being monitored by Arctera Data Insight. The scans include the
scans running on the configured data sources like SharePoint online or generic
device.
This page will help you in finding out granular details about every individual
scan. It will have information like status, start time, total time taken for completing
the scan, scan type ( full or incremental), and origin of the scan (auto or manual).
Note: In case of SharePoint Online and OneDrive: After adding a device, first
scan will be a full scan.
Refer to the table below to know more about the scan schedules and types.
■ Requests
■ Configuration
■ Setting up Classification
Requests
To view all classification requests, click Classify in the left pane and click
Requests. This page lists all the classification requests with the subsequent details
like Submitted files, Classified files, Tagged File Size, Status and so on. If there
are multiple requests, you can search specific request using the Search bar at the
top of the page. You can click the Refresh icon to refresh the list and use the
toggle selection icon to select the list columns.
Status messages and description is as follows:
Field Description
This page will also enable you to Cancel classification request, Download Failed
Paths in CSV format, and reclassify failed paths by clicking the Action menu on
the right.
■ Workspace tab
■ For repository, folder or file level request.
4 Classify only new or modified files since last classification time box will
be checked by default. If checked, only the new or modified files since last
classification run will be classified. Uncheck the box to classify all available
files.
5 Click Upload File to submit the classification requests.
To initiate classification from the Workspace tab,
1 Navigate to Workspace tab.
2 Click + sign next to the data source.
3 If you want to initiate classification at the folder level, select desired folder
or folders.
4 For selecting files, click + next to the folder and select file or files.
5 Click Actions and select Classify.
6 Classify only new or modified files since last classification time box will
be checked by default. If it is checked, only the new or modified files will be
classified. Uncheck the box to classify all available files. It is recommended
to opt for this option as classification process will consume considerably
more time for classifying all available files.
7 Click Classify.
Configuration
This page will display classification configuration settings. Check Enable
Classification to enable classification of the configured data source. Note that
large files (50 MB or more) will not be classified.
You can select file groups that you want to exclude from classification requests
by clicking the drop-down and selecting required groups. The file extensions
excluded in file groups will not be downloaded for classification.
For specifying Safeguard Settings, navigate to Classification in the left pane and
then click Configuration.
Setting up Classification
For more information about setting up classification, click Steps for setting up
classification
Chapter 10
File Groups
This chapter includes the following topics:
Note: Only Server Administrator will be able to create and manage file group.
Note: Do not add . while adding the extension. If you want to add pdf or
jpeg, do not add .pdf or .jpeg. Add pdf or jpeg only. In addition to this, note
that extension with * . and _ are not supported. For example _501 or _eml
Note: You can delete extensions from custom file group only.
7 You can add Extensions, copy or delete the custom file group by clicking
Action menu on the right.
You can create multiple file groups, as per the data your sources are expected to
generate. Using the predefined file groups or creating custom file groups will help
in report generation and excluding unsupported extensions while classification.
For more details
To know more about Reports See “About Reports” on page 86.
Chapter 11
Reports
This chapter includes the following topics:
■ About Reports
About Reports
The Reports page will display list of all requests. It will display details like Run
Id, Name, Description, Label,Status, Start Time and End time. You can filter
columns headers like Name, Description or Label by clicking the Toggle Selection
List icon at the top right corner of the page. The File List Report will have list of
files based on the filters applied during report creation.
After a request is successful, click the Action menu and click Download to
download the file or click Delete to delete the request.
3 Enter the required details in the right pane. From the File Group
Configuration section, you can include or exclude file groups by selecting
File Groups from the drop-down.
4 Check the Share with users box if you want to share this report with all
users in the selected file group. If unchecked, only the report creator has
access to the report.
5 Click Submit to complete the process.
Once you create a report, it will be visible on the Reports page. You can download
or delete the report by clicking the Action menu on the right.
Chapter 12
Workflows
This chapter includes the following topics:
■ Workflows
■ Task
Workflows
This page lists all the workflows created in the Workspace tab. You can view
details like Name, Type, Status, Start Time on this page. You can select columns
like Name, Description or Start Time by clicking the Toggle Selection List icon
at the top right corner of the page.
Note: Only the Server Admin can monitor workflow status from this page.
You can search a particular workflow by using the Search box at the top. You
can search by Name, Description, Status and Created By fields.
You can also click Action menu next to the workflow to view more details,
download or delete the workflow.
To know more, See “About Arctera Data Insight Workspace ” on page 17.
Workflows 90
Task
You can also create a workflow using through Workspace or by uploading a CSV
file from this page.
To create a workflow,
1 Click Create Workflow in the top ribbon.
2 In the Create Workflow pop-up, enter a unique name, description and select
type of workflow from the drop-down.
There are two types of workflows, Ownership Confirmation and Delete
Files. If you want to assign or change a custodian to the data source or folder,
create a Ownership Conformation workflow. After this workflow is
successfully executed, a custodian will be assigned or changed for the data
source or folder.
If you have configured Delete Action for a specific SharePoint or OneDrive
accounts, Delete Files option will be available for selection. If you want to
delete files from this account but do not see that option, navigate to Data
Remediation > Delete Files Configuration in the left pane and configure
delete action.
Task
This page lists all the tasks assigned to logged in user. You can view details like
Workflow Name, Type, Status, Start Time on this page. This page will list all
pending workflows requests for the user.
Workflows 91
Task
You can search a particular task by using the Search box at the top. You can filter
columns headers like Type, Status or Start Time by clicking the Toggle Selection
List icon at the top right corner of the page.
You can also click Action menu (three dots) next to the task to view more details
or download it.
5 Click Authorize. This invokes the application and authorizes it after providing
valid credentials.
6 click Add More Apps if you want to add another set of client credentials.
7 If you want to exclude any sites from delete action, select sites from the
drop-down.
8 Enable Action checkbox will be checked by default. Uncheck this box if you
want to create a delete action configuration but intend keep it disabled. You
can check the box later to enable this delete action.
9 Click Save to complete the process.
After you complete the process, Delete option will appear for the configured
SharePoint or OneDrive account.
If you click Edit, Edit Configured Delete Action pop-up appears. Edit the desired
field and click Save to confirm. If you click Delete, click Yes on the confirmation
pop-up to permanently remove the delete action.
To know more about workflow, See “Workflows” on page 89.
Chapter 14
Users and Access
This chapter includes the following topics:
■ Credentials
You can edit user role and enable/ disable specific user by clicking the kebab
menu in line with the user details. The Administrator user from Arctera View
Compliance and Governance Portal will be the Server Administrator in Arctera
Data Insight . When the Server Administrator logs in for the first time, all other
users will be in Unassigned role. You will not be able to add users in Data Insight.
All users created in Arctera View Compliance and Governance Portal will be
synced in Data Insight
Users and Access 95
Users and Roles
All users can see assigned tasks and take action on it.
Note: The logged in user will not be able to edit or disable own account.
5 For Product Administrator and User roles, you can grant or revoke access
to data sources and repositories.
Credentials
About credentials
An authentication credential can be stored as a named credential in a central
credential store. It can be defined once, and then referenced by any number of
filers, and shares. Passwords are encrypted before they are stored. The saved
credential store simplifies management of user name and password changes. You
can add, delete or edit stored credentials.
On the Credentials tab, you can :
■ Add Credentials
■ Search Credentials by using the Search bar at the top.
■ Use the Refresh icon to refresh the list.
■ Delete or edit saved credentials by using the Action menu on the right.
To add credential
1 Click Credentials under Users and Access in the left pane.
List of saved credentials appear.
2 Click Add Credential
3 Enter the following information:
To delete credential
1 Click Credentials under Users and Access in the left pane.
2 Click the Action menu (three dots) on the right side of the credentials and
click Delete.
3 Click OK on the confirmation pop-up to delete credential.
4 A credential can be deleted only if it is not currently used for filers or shares.
To edit credential
1 Click Credentials under Users and Access in the left pane.
2 Click the Action menu (three dots) on the right side of the credentials and
click Edit.
3 Make required changes and click Save to complete the process.