Skip to content

Datastores Overview

Datastores are the foundation of data quality management in Qualytics. A datastore represents a connection to your data, whether it's a relational database (JDBC), a distributed file system (DFS), or a cloud storage service.

In this section you will find:

  • Source: Learn the fundamentals (JDBC and DFS), set up connections, browse supported connectors, use multi-schema creation, and add, edit, or delete datastores.
  • Enrichment: Link a datastore to an enrichment destination so scan results, source record examples, remediation snapshots, and exports are written to your own infrastructure.
  • Data Quality Score: Configure the decay period and dimension weights to measure and track the health of your data over time.
  • Grouping: Organize datastores into custom groups by environment, team, domain, or priority for easier navigation in the tree view.
  • Data Catalog Links: See how a datastore links to its asset in a connected data catalog, correct the link, and run a scoped synchronization.
  • Tags: Assign tags to datastores to categorize, filter operations by tag, and influence quality score weighting.
  • Tips & Tricks: Discover right-click options and keyboard shortcuts to navigate and manage datastores faster.

Source

Understanding

  • Getting Started

    Understand what a datastore is, the architecture behind it, and how to get started.

    Getting Started

  • JDBC

    Connect relational databases using JDBC connectors like PostgreSQL, Snowflake, Oracle, and more.

    Understanding JDBC

  • DFS

    Connect distributed file systems like Amazon S3, Azure Data Lake Storage, and Google Cloud Storage.

    Understanding DFS

Connections

  • Connection Introduction

    Learn what connections are, their role in datastore setup, and key concepts.

    Introduction

  • How Connections Work

    Connection lifecycle, authentication methods, secrets management, and network requirements.

    How It Works

  • Available Connectors

    Browse the full list of supported JDBC and DFS connectors.

    View Connectors

Multiple-Schema

  • Multiple-Schema Introduction

    Discover and onboard multiple schemas from a single connection in one step.

    Introduction

  • How Multi-Schema Works

    Schema discovery flow, name templates, catalog/schema hierarchy, and validation.

    How It Works

  • Supported Connectors (Multi-Schema)

    Which connectors support multi-schema discovery and their catalog/schema mappings.

    Supported Connectors

  • Multi-Schema Permissions

    Roles and team permissions required for multi-schema creation and validation.

    Permissions

  • Multi-Schema FAQ

    Connectors, enrichment linking, naming, batch limits, and troubleshooting.

    FAQ

How-tos

  • Add with New Connection

    Create a new source datastore by setting up a new connection from scratch.

    New Connection

  • Add with Existing Connection

    Create a new source datastore by reusing credentials from an existing connection.

    Existing Connection

  • Edit Datastore

    Modify your datastore's connection scope, teams, or other properties.

    Edit

  • Delete Datastore

    Remove a datastore from Qualytics. The physical data stays in your infrastructure.

    Delete

  • Datastore API

    Create, update, delete, bulk create, link enrichment, and manage datastores programmatically.

    API

  • Datastore FAQ

    Connections, creating, managing, enrichment, operations, and troubleshooting.

    FAQ

Enrichment

  • Getting Started

    How enrichment datastores receive outputs, with pages covering both the source and destination sides.

    Getting Started

Deep Dive

  • Introduction

    Why link a destination, what each operation writes, and the side effects of linking.

    Introduction

  • How It Works

    Settings, automatic sync and profile after each write, display names, lineage, last write, and unlinking.

    How It Works

  • Enrichment Purposes

    The six purposes, where the badge appears, and what a written container shows.

    Purposes

  • Enrichment Outputs

    Physical names and columns of the Scan, Remediation, and Materialize outputs.

    Enrichment Outputs

  • Export Outputs

    The four export outputs, their columns, and how to unpack their JSON fields.

    Export Outputs

  • Schema Changelog

    Column changes to the written outputs, by platform version.

    Schema Changelog

  • Permissions

    Roles and team permissions for linking, editing settings, unlinking, and working inside a destination.

    Permissions

How-tos

  • Link an Enrichment Destination

    Link an existing datastore as the destination, or create one from inside the dialog.

    Link

  • Link on Datastore Creation

    Link or create the destination in the second step of the Add Datastore page.

    Link on Creation

  • Unlink an Enrichment Destination

    Remove the link from a datastore.

    Unlink

  • View the Relationship Diagram

    See how the written outputs join each other, from the destination's How-tos panel.

    Relationship Diagram

Reference

  • Supported Connectors

    Which connectors a destination can live on.

    Supported Connectors

  • Enrichment API

    Link, unlink, change settings, create a destination, and read written outputs programmatically.

    API

  • Enrichment FAQ

    Where destinations live in the tree, what the badges mean, missing last writes, renamed outputs, and auto-sync.

    FAQ

Data Quality Score

  • Getting Started

    Overview of quality scores, dimensions, settings, weighting, and all how-to pages.

    Getting Started

  • Introduction

    Score hierarchy, the 8 dimensions, decay period, weights, independent settings, and recalculations.

    Introduction

  • Permissions

    Roles and team permissions for viewing scores and editing settings.

    Permissions

  • Settings

    Configure decay period and dimension weights for your datastore.

    Settings

  • Quality Score API

    Retrieve and update score settings and access historical score snapshots.

    API

  • Quality Score FAQ

    Baseline, dimensions, decay, independent settings, troubleshooting, and more.

    FAQ

Grouping

  • Getting Started

    Overview of datastore grouping, permissions, and all how-to pages.

    Getting Started

  • Introduction

    How groups work, key characteristics, favorites interaction, and best practices.

    Introduction

  • Permissions

    Two permission layers for group management and datastore assignment.

    Permissions

  • Create a Group

    Create a new datastore group with a custom name and icon.

    Create

  • Edit a Group

    Rename a group or change its icon.

    Edit

  • Delete a Group

    Remove a group. Datastores in the group become ungrouped.

    Delete

  • Assign a Datastore to a Group

    Assign a datastore to an existing group from the tree view.

    Assign to Group

  • Unassign a Datastore from a Group

    Unassign a datastore from its current group. The datastore moves to the ungrouped list at the bottom of the tree.

    Unassign

  • Filter by Group

    Filter the Datastores listing page to show only datastores in specific groups.

    Filter by Group

  • Grouping API

    Create, update, delete groups and assign/unassign datastores programmatically.

    API

  • Grouping FAQ

    Groups vs tags, favorites, permissions, limits, filter behavior, and more.

    FAQ

  • Getting Started

    How datastores link to assets in connected data catalogs, and everything in this section.

    Getting Started

  • Introduction

    What Data Catalog Links are, where they apply, and which datastores offer them.

    Introduction

  • How It Works

    Manual and automatic links, anchoring, and what relinking changes.

    How It Works

  • Synchronization

    What Pull and Push exchange, and the datastore-scoped sync next to the integration-wide one.

    Synchronization

  • Permissions

    The team permission and roles behind viewing, linking, and synchronizing.

    Permissions

  • Link Asset

    Link a datastore to its counterpart asset, by search or by pasting the asset's URL.

    Link Asset

  • Change Asset

    Point the link at a different catalog asset.

    Change Asset

  • Unlink Asset

    Remove a manual link and hand the match back to the automatic synchronization.

    Unlink Asset

  • Link Another Catalog

    Link the same datastore in one more connected catalog.

    Link Another Catalog

  • Sync a Catalog

    Start a synchronization scoped to the datastore, straight from the dialog.

    Sync a Catalog

  • API

    Read, set, and clear catalog links programmatically, search catalog assets, and start scoped syncs.

    API

  • FAQ

    Common questions about availability, manual links, unlinking, and synchronization.

    FAQ

Tags

  • Getting Started

    Overview of datastore tags, permissions, and all how-to pages.

    Getting Started

  • Introduction

    Tag inheritance, operation filtering, quality score impact, and weight modifiers.

    Introduction

  • Permissions

    Roles and team permissions for viewing, assigning, and unassigning tags.

    Permissions

  • Assign a Tag

    Assign an existing tag to a datastore from the tree view footer.

    Assign

  • Unassign a Tag

    Remove a tag from a datastore without deleting the tag itself.

    Unassign

  • Tags API

    Assign, unassign, and query tags on datastores via the datastore update endpoint.

    API

  • Tags FAQ

    Inheritance, permissions, weight modifiers, storage, re-linking, and troubleshooting.

    FAQ

Tips & Tricks

  • Right Click Options

    Quick actions available via right-click on datastores in the tree view, listing, and breadcrumb.

    Right Click Options

  • Keyboard Shortcuts

    Speed up common datastore actions with keyboard shortcuts and the Command Bar.

    Keyboard Shortcuts