Disk Space Usage Analysis

Azure Data Expert allows one to analyze disk space usage in one or more Microsoft Azure cloud storage accounts. In order to perform a simple disk space analysis operation, select one or more storage containers in the Azure Data Expert navigator and press the 'Analyze' button located on the main toolbar.

Azure Data Expert Disk Space Analysis

Azure Data Expert will scan the selected storage containers, analyze disk space usage and display the analysis results dialog showing storage containers, virtual directories and data blobs sorted by the used disk space. The disk space analysis results dialog provides the ability to categorize and filter disk space analysis results by the file extension, file type, size and last modification date.

Azure Data Expert Analysis Results

In addition, the results dialog allows one to display various types of pie charts, download or delete specific directories or data blobs and save disk space analysis reports to a number of standard formats including HTML, PDF, Excel, text, CSV and XML. The user is provided with the ability to browse the virtual directory tree, perform various types of file management operations on virtual directories and data blobs and search data blobs in disk space analysis results by the blob name, file type, file size and the last modification date.

Categorize and Filter Disk Space Analysis Results

The disk space analysis results dialog shows in the top results pane storage containers, virtual directories and data blobs sorted by the amount of used disk space. In order to open a storage container or a virtual directory double click on the required item in the results view. The bottom pane shows categories of data blobs according to the currently selected file categorization mode.

Azure Data Expert Categorize Analysis Results

The user is provided with the ability to categorize and filter the disk space analysis results by the file extension, file type, file size, the last modification time and the last modification date. In order to change the current file categorization mode, click on the file categories combo box and select an appropriate file categorization mode.

Azure Data Expert Filter Analysis Results

For example, in order to categorize the disk space analysis results by the last modification date, click on the file categorization combo box and select the 'Categorize By Modification Date' item. Now, in order to filter disk space analysis results by a specific date, double click on the required date item and the disk space analysis results dialog will display disk space analysis results matching the selected filter. In addition, all types of disk space analysis reports and pie charts will be generated according to the currently selected file categorization mode.

Save Disk Space Analysis Reports

Azure Data Expert allows one to save disk space analysis reports into a number of standard formats including HTML, PDF, Excel, XML, text and CSV. In the simplest case, perform a disk space analysis operation and press the 'Save' button located on the disk space analysis results dialog. On the save report dialog, select an appropriate report format, enter a report file name and press the 'Save' button.

Azure Data Expert Save Disk Space Analysis Report

For the HTML, PDF, Excel, text, CSV and XML report formats, the user is provided with the ability to save a short summary report or a longer detailed report, which may be very long for large storage accounts containing millions of files. By default, Azure DEX will save a short, summary disk space analysis report in the HTML report format, which will include a top-level view of analyzed Azure storage containers and a list of tables showing the disk space usage and the number of files per file extension, file type, modification date, etc.

Azure Data Expert Disk Space Analysis HTML Report

A detailed disk space analysis report includes a list of file categories according to the currently selected second-level file categorization mode followed by an hierarchy of Azure storage containers and virtual directories sorted by the amount of the used disk space. In order to configure the number of hierarchy levels exported to the detailed disk space analysis report, press the 'Advanced Options' button located on the 'Save Report' dialog and customize the report for your specific needs.

Microsoft Excel Reports

Sometimes, it may be required to perform additional analysis of disk space usage results using external tools such as Microsoft Excel. In order to export disk space analysis results to the Excel report format, perform a disk space analysis operation, press the 'Save' button located on the disk space analysis results dialog, select the 'Excel Summary' report format for a short summary report or the 'Excel Report' format for a detailed disk space analysis report.

Azure Data Expert Save Disk Space Analysis Excel Report

A summary Excel report will include a top-level list of analyzed Azure storage containers and a number of tables with pie charts showing the used disk space and the number of files per file extension, file category, top-level directory name, file modification date, etc.

Azure Data Expert Disk Space Analysis Excel Report

A detailed Excel report will include a list of file categories according to the currently selected file categorization mode and an hierarchy of directories and files sorted by the amount of the used disk space, which may be very long for large storage accounts containing millions of files. In order to control how many directory levels and how many files per directory are exported in the detailed report, press the 'Advanced Options' button located on the 'Save Report' dialog and customize the disk space analysis report for your specific needs.

Graphical PDF Reports

One of the most useful ways to export disk space analysis results is to use the PDF summary or the PDF report formats. Both of these report formats include various types of graphical pie charts showing disk space usage and the number of files per file extension, file category, last modification time, top-level directory name, etc. In order to save disk space analysis results to a PDF report file, press the 'Save' button located on the disk space analysis results dialog and select the 'PDF Summary' report format for a short, summary report or the 'PDF Report' format for a detailed disk space analysis report.

Azure Data Expert Save Disk Space Analysis PDF Report

A summary PDF report will include a top-level list of analyzed Azure storage containers sorted by the amount of the used disk space followed by a number of pie charts showing the disk space usage and the number of files per file extension, file category, last modification date, top-level directory name, etc. A detailed PDF report will include an hierarchy of storage containers, virtual directories and files sorted according to the used disk space, which may be very long for large storage accounts containing millions of files.

Azure Data Expert Disk Space Analysis PDF Report

In addition to the directory tree sorted by the used disk space, detailed PDF reports include pie charts showing the disk space usage per file category and the number of files per file category according to the currently selected file categorization mode. For example, if the second-level file categories mode is set to categorize disk space analysis results by the file extension, the PDF report will display pie charts showing the used disk space and the number of files per file extension.

Analyze Specific Types of Files

Azure DEX Pro provides the ability to analyze specific types of files or groups of files by the file type, category, size, name, extension, last modification date, etc. The user is provided with the ability to configure a number of file matching rules for each disk space analysis operation allowing one to analyze the required files and precisely focus on the required data. For example, the user can analyze all types of images with the file size more that 10 MB that were modified during the last month.

Azure Data Expert Disk Space Analysis Rules

In order to configure one or more file matching rules for a disk space analysis operation, open the analysis command dialog, press the 'Options' button, select the 'Rules' tab, press the 'Add' button and select the required rule type. During the disk space analysis process, Azure Data Expert will scan storage containers and evaluate the analyzed data blobs using the specified file matching rules. Data blobs matching the specified rules will be displayed in the disk space analysis results and data blobs not matching the specified rules will be excluded from the disk space analysis results.

Azure Data Expert Negative File Matching Rules

In addition to positive file matching rules allowing one to include specific files in the disk space analysis process, Azure Data Expert provides negative file matching rules allowing one to exclude specific files from the disk space analysis process. For example, in order to exclude all types of images from the disk space analysis process, add a file category rule, select the 'Images, Pictures and Graphic Files' file category and select the 'Not Categorized' rule operator. During the disk space analysis process, Azure Data Expert will evaluate the processed files and skip all types of image files.

Exclude Directories From the Analysis Process

Sometimes, it may be required to exclude one or more subdirectories from the disk space analysis process. For example, if you need to analyze a storage container excluding one or two special directories, you may specify the storage container to be analyzed and add the directories that should be skipped to the exclude list.

Azure Data Expert Analysis Exclude Directories

In order to add one or more directories to the exclude list, open the disk space analysis command dialog, press the 'Options' button, select the 'Exclude' tab and press the 'Add' button. All files and subdirectories located in the specified exclude directory will be excluded from the disk usage analysis process. In addition, advanced users are provided with a number of exclude directories macro commands allowing one to exclude multiple directories using a single macro command.

Azure Data Expert provides the following exclude directories macro commands:

  • $BEGINS <Text String> - this macro command excludes all directories beginning with the specified text string.
  • $CONTAINS <Text String> - this macro command excludes all directories containing the specified text string.
  • $ENDS <Text String> - this macro command excludes directories ending with the specified text string.
  • $REGEX <Regular Expression> - this macro command excludes all directories matching the specified regular expression.

For example, the exclude macro command '$CONTAINS Temporary Files' will exclude all directories with 'Temporary Files' at any place in the full directory path and the exclude macro command '$REGEX \.(TMP|TEMP)$' will exclude all directories ending with '.TMP' or '.TEMP'.