Settings For DFS Files Pattern¶

Settings allow you to edit how data is processed and analyzed for a specific file pattern in your connected source datastore. This includes grouping data, excluding certain fields from scans, adjusting general behaviors, and adding metadata. File patterns have no incremental or partitioning settings, because the incremental strategy for files is automatic.

Step 1: Click on the vertical ellipse next to the file pattern of your choice and select Settings from the dropdown list.

A modal window will appear for File Pattern Settings.

Step 2: Modify the file pattern settings based on:

• Group Criteria

• Excluding

• General

• Additional Metadata

Group Criteria¶

Group Criteria allow you to organize data into specific groups for more precise analysis. By grouping fields, you can gain better insights and enhance the accuracy of your profiling.

For information about Group Criteria, you can refer to the documentation on Grouping..

Excluding¶

Excluding allows you to choose specific fields from a file pattern that you want to exclude from data checks. This helps focus on the fields that matter most for validation while ignoring others that are not relevant to the current analysis.

For information about Excluding, you can refer to the documentation on Excluding Settings..

General¶

You can control how file patterns behave by checking or unchecking options to make data processing easier and more consistent. These settings help the system automatically adjust file structures for better integration and analysis.

• Inferring Data Types: When enabled, the system automatically determines the correct data type for each field and applies it. This keeps data consistent and reduces errors, saving you time on manual fixes.

• First Row as Field Names: Turning this on uses the first row of a file as headers, making it simple to map and organize data in the right format.

• Treating Empty Values as Nulls: The "Treat empty values as nulls" setting controls how empty fields in files like Excel and CSV are handled. If enabled (true), empty fields are treated as NULL (missing data). If disabled (false), they are stored as empty strings (""), meaning the field exists but is blank. This affects reporting, calculations, and data processing, as NULL values are ignored while empty strings may still be counted.

Step 3: Once you have configured the file pattern settings, click on the Save button.

After clicking on the Save button, your table is successfully updated and a success flash message will appear stating "File Pattern has been successfully updated".