ai_flow.operators.flink package

Submodules

ai_flow.operators.flink.flink_operator module

class ai_flow.operators.flink.flink_operator.FlinkOperator(name: str, application: str, target: Optional[str] = None, application_args: Optional[List[Any]] = None, executable_path: Optional[str] = None, application_mode: bool = False, stop_with_savepoint: bool = False, kubernetes_cluster_id: Optional[str] = None, command_options: Optional[str] = None, jobs_info_poll_interval: int = 1, **kwargs)

Bases: ai_flow.model.operator.AIFlowOperator

FlinkOperator is used to submit Flink job with flink command line.

Parameters

• name – The name of the operator.

• application – The application file to be submitted, like app jar, python file.

• target – The deployment target for the given application, which is equivalent to the “execution.target” config option.

• application_args – Args of the application.

• executable_path – The path of flink command.

• application_mode – Whether runs an application in Application Mode.

• stop_with_savepoint – Whether stops the flink job with a savepoint.

• kubernetes_cluster_id – Cluster id when submit flink job to kubernetes.

• command_options – The options that passes to command-line, e.g. -D, –class and –classpath.

• jobs_info_poll_interval – Seconds to wait between polls of job status in application mode (Default: 1)

• name – The operator’s name.

• kwargs – Operator’s extended parameters.

await_termination(context: ai_flow.model.context.Context, timeout: Optional[int] = None)

Wait for a task instance to finish. :param context: The context in which the operator is executed. :param timeout: If timeout is None, wait until the task ends.

If timeout is not None, wait for the task to end or the time exceeds timeout(seconds).

start(context: ai_flow.model.context.Context)

Start a task instance.

stop(context: ai_flow.model.context.Context)

Stop a task instance.