Export Metadata
Qualytics’ metadata export feature lets you capture the changing states of your data. You can export metadata for Quality Checks, Field Profiles, and Anomalies from selected profiles into an enrichment datastore so that you can perform deeper analysis, identify trends, detect issues, and make informed decisions based on your data.
To keep things organized, the exported files use specific naming patterns:
- Anomalies: Saved as
_<enrichment_prefix>_anomalies_export. - Quality Checks: Saved as
_<enrichment_prefix>_checks_export. - Field Profiles: Saved as
_<enrichment_prefix>_field_profiles_export.
Note
Ensure that an enrichment datastore is already set up and properly configured to accommodate the exported data. This setup is essential for exporting anomalies, quality checks, and field profiles successfully.
Let’s get started 🚀
Step 1: Select a source datastore from the side menu from which you would like to export the metadata.
For demonstration purposes, we have selected the “COVID-19 Data” Snowflake source datastores.
Step 2: After selecting your preferred datastore, a bottom-up menu will appear on the right side of the interface. Click on “Export Metadata” alongside the Enrichment Datastore.
Step 3: After clicking “Export Metadata,” a modal window will appear providing you the options to select the assets you want to export to your Enrichment Datastore—whether it's anomalies, quality checks, or field profiles.
For demonstration purposes, we have opted to export all three assets: Anomalies, Quality Checks, and Field Profiles.
Step 4: Once you have selected the assets, click the “Next” button to continue.
Step 5: Select the profiles you wish to export. You can choose specific profiles or export them all at once. After selection, click on the Export button.
For demonstration purposes, we have checked the “All” option.
Step 6: After clicking “Export,” the process starts, and a message will confirm that the metadata will be available in your Enrichment Datastore shortly.
Review Exported Metadata
Step 1: Once the metadata has been exported, navigate to the “Enrichment Datastores” located on the left menu.
Step 8: In the “Enrichment Datastores” section, select the datastore where you exported the metadata. The exported metadata will now be visible in the selected datastore.
Step 9: Click on the exported files to view the metadata. For demonstration purposes, we have selected the “export_field_profiles” file to review the metadata.
The exported metadata is displayed in a table format, showing key details about the field profiles from the datastore. It typically includes columns that indicate the uniqueness of data, the completeness of the fields, and the data structure. You can use this metadata to check data quality, prepare for analysis, ensure compliance, and manage your data.
