How AI Managed Checks Work

This page explains how Profile turns observed data patterns into most AI Managed checks, how your settings control the process, and what later Profile runs can change. AI Managed Volumetric and Freshness checks follow the Observability measurement process instead.

Profile-Generated Checks

For AI Managed checks generated by Profile, Qualytics:

1. Reads the containers (tables or files) you selected.
2. Calculates field-level statistics such as minimum and maximum values, averages, distinct counts, distribution shape, and completeness.
3. Uses those observations to generate and validate candidate checks.

The Profile scope and read settings determine the evidence used to propose these checks. Run Profile on a schedule that reflects how often the source changes and when your team needs refreshed statistics and Profile-generated coverage.

How Profile Generates Checks

Profile uses the settings you choose to control check generation:

1. AI Effort controls how broadly Qualytics explores observed patterns and check types. You can also turn check generation off.
2. Candidate checks are based on structural and behavioral observations from the Profile operation.
3. Validation and backtesting confirm that a candidate check fits the profiled data before it is created.
4. Oversight determines whether new checks become active automatically or remain drafts for your team to review.

The result is a set of checks grounded in observed behavior rather than generic assumptions. These checks establish a baseline that your team can review alongside business requirements. See Profile Operation for the available settings.

Starting Coverage

AI Managed checks provide broad starting coverage without requiring every rule to be written manually. Data stewards and domain experts extend that baseline with Authored checks for policies, exceptions, and business relationships that observed patterns cannot establish on their own.

Maintenance Over Time

Profile-generated AI Managed checks are kept up to date by future Profile runs:

• If Profile still supports the same rule, the AI Managed check remains in the managed set.
• If Profile no longer supports the rule, the check is deprecated and removed during that Profile run.
• If you edit how the check evaluates data, it becomes Authored and Profile leaves it unchanged. See AI Managed Checks Introduction for the conversion rules.

This means a Profile-generated AI Managed check has two ways to leave your active set: either Qualytics removes it because the data no longer supports it, or you take ownership by editing it. Profile never modifies or removes an Authored check.

Where AI Managed Checks Appear in the UI

AI Managed checks show up in the same Checks list as Authored checks, but with two visual cues:

• The Check Summary header displays a purple AI badge (four-point star icon). Hovering it reveals the tooltip "Authored by AI and is continuously tuned to your observed data."
• For a Profile-generated check, the Profile operation that created it is referenced in the check details.

You can filter by check type (AI Managed or Authored) from the Checks tab to focus on one set or the other.