Skip to content

Source Datastores Overview

Source Datastores are the foundation of data quality management in Qualytics. A source datastore represents a connection to your data — whether it's a relational database (JDBC), a distributed file system (DFS), or a cloud storage service.

In this section you will find:

  • Datastore — Learn the fundamentals (JDBC and DFS), set up connections, browse supported connectors, use multi-schema creation, and add, edit, or delete datastores.
  • Operations — Run Sync, Profile, Scan, and External Scan operations to catalog your data, infer quality checks, and detect anomalies.
  • Enrichment Datastore — Link an enrichment datastore to persist scan results, anomalies, source record examples, and remediation data to your own infrastructure.
  • Data Quality Score — Configure scoring weights, decay periods, and thresholds to measure and track the health of your data over time.
  • Grouping — Organize datastores into custom groups by environment, team, domain, or priority for easier navigation in the tree view.
  • Tags — Assign tags to datastores to categorize, filter operations by tag, and influence quality score weighting.
  • Tips & Tricks — Discover right-click options and keyboard shortcuts to navigate and manage datastores faster.

Datastore

Understanding

  • Getting Started

    Understand what a datastore is, the architecture behind it, and how to get started.

    Getting Started

  • JDBC

    Connect relational databases using JDBC connectors like PostgreSQL, Snowflake, Oracle, and more.

    Understanding JDBC

  • DFS

    Connect distributed file systems like Amazon S3, Azure Data Lake Storage, and Google Cloud Storage.

    Understanding DFS

Connections

  • Connection Introduction

    Learn what connections are, their role in datastore setup, and key concepts.

    Introduction

  • How Connections Work

    Connection lifecycle, authentication methods, secrets management, and network requirements.

    How It Works

  • Available Connectors

    Browse the full list of supported JDBC and DFS connectors.

    View Connectors

Multiple-Schema

  • Multiple-Schema Introduction

    Discover and onboard multiple schemas from a single connection in one step.

    Introduction

  • How Multi-Schema Works

    Schema discovery flow, name templates, catalog/schema hierarchy, and validation.

    How It Works

  • Supported Connectors (Multi-Schema)

    Which connectors support multi-schema discovery and their catalog/schema mappings.

    Supported Connectors

  • Multi-Schema Permissions

    Roles and team permissions required for multi-schema creation and validation.

    Permissions

  • Multi-Schema FAQ

    Connectors, enrichment linking, naming, batch limits, and troubleshooting.

    FAQ

Managing

  • Add with New Connection

    Create a new source datastore by setting up a new connection from scratch.

    New Connection

  • Add with Existing Connection

    Create a new source datastore by reusing credentials from an existing connection.

    Existing Connection

  • Edit Datastore

    Modify your datastore's connection scope, teams, or other properties.

    Edit

  • Delete Datastore

    Permanently remove a datastore and all its associated data.

    Delete

  • Datastore API

    Create, update, delete, bulk create, link enrichment, and manage datastores programmatically.

    API

  • Datastore FAQ

    Connections, creating, managing, enrichment, operations, and troubleshooting.

    FAQ

Operations

  • Sync

    Detect new, changed, or removed containers and fields in the source datastore.

    Sync

  • Profile

    Analyze records to assess data quality, generate metadata, and infer quality checks.

    Profile

  • Scan

    Enforce data quality checks and identify anomalies at the record and schema levels.

    Scan

  • External Scan

    Run scan operations using externally provided data files.

    External Scan

Enrichment Datastore

  • Getting Started

    Overview of enrichment datastores, supported connectors, and all managing pages.

    Getting Started

  • Introduction

    How enrichment works, settings, remediation strategies, side effects, and sharing.

    Introduction

  • Permissions

    Roles and team permissions for linking, unlinking, and configuring enrichment.

    Permissions

  • Link Enrichment Datastore

    Link a source datastore to an enrichment datastore through the Settings menu or tree footer.

    Link

  • Link on Datastore Creation

    Link an enrichment datastore during the datastore creation wizard.

    Link on Creation

  • Unlink Enrichment Datastore

    Remove the enrichment link from a source datastore.

    Unlink

  • Supported Enrichment Datastores

    Which connectors support enrichment and their write-back capabilities.

    Supported Connectors

  • Enrichment API

    Link, unlink, and update enrichment settings programmatically.

    API

  • Enrichment FAQ

    Remediation strategies, prefix conflicts, storage, re-linking, and troubleshooting.

    FAQ

Data Quality Score

  • Getting Started

    Overview of quality scores, dimensions, settings, weighting, and all managing pages.

    Getting Started

  • Introduction

    Score hierarchy, the 8 dimensions, decay period, weights, independent settings, and recalculations.

    Introduction

  • Permissions

    Roles and team permissions for viewing scores and editing settings.

    Permissions

  • Settings

    Configure decay period and dimension weights for your datastore.

    Settings

  • Quality Score API

    Retrieve and update score settings and access historical score snapshots.

    API

  • Quality Score FAQ

    Baseline, dimensions, decay, independent settings, troubleshooting, and more.

    FAQ

Grouping

  • Getting Started

    Overview of datastore grouping, permissions, and all managing pages.

    Getting Started

  • Introduction

    How groups work, key characteristics, favorites interaction, and best practices.

    Introduction

  • Permissions

    Two permission layers for group management and datastore assignment.

    Permissions

  • Create a Group

    Create a new datastore group with a custom name and icon.

    Create

  • Edit a Group

    Rename a group or change its icon.

    Edit

  • Delete a Group

    Remove a group — datastores in the group become ungrouped.

    Delete

  • Assign a Datastore to a Group

    Assign a datastore to an existing group from the tree view.

    Assign to Group

  • Unassign a Datastore from a Group

    Unassign a datastore from its current group. The datastore moves to Ungrouped.

    Unassign

  • Filter by Group

    Filter the Source Datastores listing page to show only datastores in specific groups.

    Filter by Group

  • Grouping API

    Create, update, delete groups and assign/unassign datastores programmatically.

    API

  • Grouping FAQ

    Groups vs tags, favorites, permissions, limits, filter behavior, and more.

    FAQ

Tags

  • Getting Started

    Overview of datastore tags, permissions, and all managing pages.

    Getting Started

  • Introduction

    Tag inheritance, operation filtering, quality score impact, and weight modifiers.

    Introduction

  • Permissions

    Roles and team permissions for viewing, assigning, and unassigning tags.

    Permissions

  • Assign a Tag

    Assign an existing tag to a source datastore from the tree view footer.

    Assign

  • Unassign a Tag

    Remove a tag from a source datastore without deleting the tag itself.

    Unassign

  • Tags API

    Assign, unassign, and query tags on datastores via the datastore update endpoint.

    API

  • Tags FAQ

    Inheritance, permissions, weight modifiers, storage, re-linking, and troubleshooting.

    FAQ

Tips & Tricks

  • Right Click Options

    Quick actions available via right-click on datastores in the tree view, listing, and breadcrumb.

    Right Click Options

  • Keyboard Shortcuts

    Speed up common datastore actions with keyboard shortcuts and the Command Bar.

    Keyboard Shortcuts