Tables to Tables configuration file
This is the description of the JSON configuration file of a Tables to Tables data operation.
The configuration file is in JSON format. It contains the following sections:
Global parameters: General information about the data operation.
Workflow task parameters: Information about the different tasks of the workflow.
Here is an example of TTT configuration file:
General information about the data operation.
A Tables to Tables workflow can include four types of tasks:
create_gbq_table: This type of task allows you to create the skeleton of a table based on a DDL file. You could compare it to the baking pan of your table.
sql: This type of task allows you to fill that baking pan using a SQL query or a SQL script from a file.
copy_gbq_table: This type of task allows you to duplicate a table named X into another table named Y.
expectation: This type of task allows you to perform data quality tests. See expectations for more details.
delete_gbq_table: This type of task allows you to delete a table or a partition of a table.
For each workflow sub-object, parameters will differ depending on the task type.
Refer to this page to know how to create the DDL and SQL files corresponding to these tasks.
SQL task parameters
Table Creation task parameters
Table copy task parameters
Table Deletion task parameters
Last updated