Skip to content

Run the Entity Resolution Recipe

Take a profiled table from suspected duplicates to a deduplicated golden set in your enrichment destination, from the Recipes page to the Complete step. For what each step does and why, see Build and Validate and Scan and Remediate.

Prerequisites

The table must be profiled, and the source datastore needs a linked enrichment destination before the Scan step. You need the Editor team permission on the source datastore to complete every step. See Permissions.

Steps

Step 1: Navigate to the Recipes page by clicking Recipes on the left side panel.

Step 2: On the Entity Resolution card, click Get Started. The recipe opens on the Select Asset step.

Step 3: Select a Datastore, click Existing Table, and pick the profiled table to deduplicate. Check its columns in Fields Preview, then click Next.

Step 4: On Distinction Field, pick the field that identifies a record uniquely, such as an ID column. Apply the AI suggestion if one is offered. To add blocking fields, click Blocking Fields, select them, and click Next; otherwise click Next directly.

Step 5: On Compare Fields, click Apply all to accept the suggested fields, or click Add target field and choose a field, its Comparison type, and its options. Adjust the Weight distribution if needed, then click Next.

Step 6: On Match Threshold, keep the default of 0.75 or move the slider, then click Next.

Step 7: On Review, confirm the configuration. Click any card to go back and change it. Click Next. The recipe creates the check as a Draft and opens Validate.

Step 8: Click Validate. When the dry run finishes, review the Entities identified, Duplicate records, and Records Preview. To change something, go back to the step, edit it, and click Validate again. When the results look right, click Scan & Remediate.

Step 9: On Scan, click Scan and wait for the full scan to finish. If the step asks you to link an enrichment destination first, see Link an Enrichment Destination from the Scan Step. Review the results, then click Next. If the scan found no duplicates, the recipe moves straight to the Complete step.

Step 10: On Remediate, for each entity tick the record to keep in the Keep as golden column. To let AgentQ propose them, click Get AI suggestions and then Accept per entity or Accept AI suggested golden records for all. Use Next unresolved to find entities that still need a choice. When every entity is resolved, click Next.

Step 11: On Materialize, tick Excluded Records if you also want the dropped duplicates written to a companion table. Check the table names and the Preview, then click Materialize. When it finishes, the recipe moves to the Complete step.

Step 12: The Complete step confirms Entity Resolution Completed. Use the cards under Everything this run produced to open the golden set, the excluded duplicates, the check, the anomaly, and the scan.