Skip to content

flowetl.sensors.file_flux_sensor

Class FileFluxSensor

FileFluxSensor(*, conn_id: str, flux_check_interval: int, filename: str, **kwargs) -> None
Source: flowetl/sensors/file_flux_sensor.py

The file flux sensor monitors a file for a short time to check if it is still being modified.

Attributes

Parameters

  • conn_id: str

    Connection to use

  • flux_check_interval: int

    Number of seconds to wait between checks that a file is stable

  • filename: str

    jinja templated string providing the path to the file to check

  • kwargs: dict

    Passed to airflow.operators.sensors.SqlSensor

  • See Also

  • --------

  • airflow.operators.sensors.SqlSensor

Methods

dag

dag
Source: airflow/models/baseoperator.py

Returns the Operator's DAG if set, otherwise raises an error

dag_id

dag_id
Source: airflow/models/baseoperator.py

Returns dag id if it has one or an adhoc + owner

deps

deps
Source: airflow/sensors/base_sensor_operator.py

Adds one additional dependency for all sensor operators that checks if a sensor task instance can be rescheduled.

downstream_list

downstream_list
Source: airflow/models/baseoperator.py

@property: list of tasks directly downstream

downstream_task_ids

downstream_task_ids
Source: airflow/models/baseoperator.py

@property: list of ids of tasks directly downstream

log

log
Source: airflow/utils/log/logging_mixin.py

logger

logger
Source: airflow/utils/log/logging_mixin.py

priority_weight_total

priority_weight_total
Source: airflow/models/baseoperator.py

Total priority weight for the task. It might include all upstream or downstream tasks. depending on the weight rule. - WeightRule.ABSOLUTE - only own weight - WeightRule.DOWNSTREAM - adds priority weight of all downstream tasks - WeightRule.UPSTREAM - adds priority weight of all upstream tasks

reschedule

reschedule
Source: airflow/sensors/base_sensor_operator.py

schedule_interval

schedule_interval
Source: airflow/models/baseoperator.py

The schedule interval of the DAG always wins over individual tasks so that tasks within a DAG always line up. The task still needs a schedule_interval as it may not be attached to a DAG.

task_type

task_type
Source: airflow/models/baseoperator.py

@property: type of the task

upstream_list

upstream_list
Source: airflow/models/baseoperator.py

@property: list of tasks directly upstream

upstream_task_ids

upstream_task_ids
Source: airflow/models/baseoperator.py

@property: list of ids of tasks directly upstream