Computed Table vs Computed File
You reached this page from the Computed Tables sub-tree. If you already know you want a warehouse-backed derived table, keep reading; if the raw data lives in files on object storage, jump to Computed File vs Computed Table instead.
When a Computed Table fits
A Computed Table is the right choice when:
- The source data lives in a JDBC warehouse (Snowflake, PostgreSQL, Redshift, SQL Server, Oracle, BigQuery, Databricks, and similar).
- You want to reuse the warehouse's own SQL dialect and its query planner (index-aware, statistics-aware, cost-based).
- The transformation needs joins across multiple base tables or views in the same datastore.
- You want the query to run inside the warehouse itself, not pull data into a separate engine.
- You do not need Qualytics to profile the source container before you build the Computed Table.
When a Computed File fits instead
Switch to a Computed File if:
- The source data lives in files on object storage (Amazon S3, Google Cloud Storage, Azure Data Lake Storage).
- The files are Parquet, ORC, Avro, CSV, TSV, PSV, JSON, Excel, Delta, or Iceberg.
- You want to normalize columns, cast types, or flatten nested arrays (via lateral views +
EXPLODE) using Spark SQL. - You are OK with a single-source restriction (one
source_container_idper Computed File, no joins inside the container itself).
Side-by-side comparison
| Feature | Computed Table (JDBC) | Computed File (DFS) |
|---|---|---|
| Source datastore | JDBC warehouse | DFS (S3, GCS, Azure Data Lake Storage) |
| Query language | Warehouse's own SQL dialect | Spark SQL |
| Number of source containers | Any base tables and views in the datastore | One source_container_id |
| Joins inside the container | Yes, across base tables of the same datastore | No, use a Computed Join |
| Source pre-profile required | No | Yes, at least once |
DISTINCT in the projection |
Allowed if the warehouse allows it | Not allowed, use GROUP BY |
| Fully-qualified name requirement | SQL Server, Oracle, Redshift | Not applicable |
| Execution runtime | Warehouse engine | Qualytics's analytical engine |
| Materialized on storage | No (metadata-only definition run on demand) | No (metadata-only definition run on demand) |