Skip to content

flowetl.operators.create_foreign_staging_table_operator

Class CreateForeignStagingTableOperator

CreateForeignStagingTableOperator(*, filename: str, fields: Dict[str, str], program: Union[str, NoneType] = None, header: bool = True, delimiter: str = ',', quote: str = '"', escape: str = '"', null: str = '', encoding: Union[str, NoneType] = None, **kwargs) -> None
Source: flowetl/operators/create_foreign_staging_table_operator.py

Executes sql code in a specific Postgres database :param sql: the sql code to be executed. (templated) :type sql: Can receive a str representing a sql statement, a list of str (sql statements), or reference to a template file. Template reference are recognized by str ending in '.sql' :param postgres_conn_id: reference to a specific postgres database :type postgres_conn_id: str :param autocommit: if True, each command is automatically committed. (default value: False) :type autocommit: bool :param parameters: (optional) the parameters to render the SQL query with. :type parameters: mapping or iterable :param database: name of database which overwrite defined one in connection :type database: str

Attributes

Methods

dag

dag
Source: airflow/models/baseoperator.py

Returns the Operator's DAG if set, otherwise raises an error

dag_id

dag_id
Source: airflow/models/baseoperator.py

Returns dag id if it has one or an adhoc + owner

deps

deps
Source: airflow/models/baseoperator.py

Returns the list of dependencies for the operator. These differ from execution context dependencies in that they are specific to tasks and can be extended/overridden by subclasses.

downstream_list

downstream_list
Source: airflow/models/baseoperator.py

@property: list of tasks directly downstream

downstream_task_ids

downstream_task_ids
Source: airflow/models/baseoperator.py

@property: list of ids of tasks directly downstream

log

log
Source: airflow/utils/log/logging_mixin.py

logger

logger
Source: airflow/utils/log/logging_mixin.py

priority_weight_total

priority_weight_total
Source: airflow/models/baseoperator.py

Total priority weight for the task. It might include all upstream or downstream tasks. depending on the weight rule. - WeightRule.ABSOLUTE - only own weight - WeightRule.DOWNSTREAM - adds priority weight of all downstream tasks - WeightRule.UPSTREAM - adds priority weight of all upstream tasks

schedule_interval

schedule_interval
Source: airflow/models/baseoperator.py

The schedule interval of the DAG always wins over individual tasks so that tasks within a DAG always line up. The task still needs a schedule_interval as it may not be attached to a DAG.

task_type

task_type
Source: airflow/models/baseoperator.py

@property: type of the task

upstream_list

upstream_list
Source: airflow/models/baseoperator.py

@property: list of tasks directly upstream

upstream_task_ids

upstream_task_ids
Source: airflow/models/baseoperator.py

@property: list of ids of tasks directly upstream