Google Cloud Dataflow · Arazzo Workflow
Google Cloud Dataflow Drain Running Job
Version 1.0.0
Confirm a streaming job is running, request a drain, then poll until it is drained.
View Spec
View on GitHub
Apache BeamBatch ProcessingBig DataData ProcessingETLStream ProcessingArazzoWorkflows
Provider
Workflows
drain-running-job
Confirm running, request drain, and poll until JOB_STATE_DRAINED.
Reads a job to confirm it is running, updates its requested state to JOB_STATE_DRAINING, then polls until it reaches JOB_STATE_DRAINED.
1
confirmRunning
getLocationJob
Read the job and confirm it is currently in the JOB_STATE_RUNNING state before requesting a drain.
2
requestDrain
updateLocationJob
Update the job's requested state to JOB_STATE_DRAINING so it stops ingesting new data while finishing in-flight work.
3
pollUntilDrained
getLocationJob
Poll the job until it reports the terminal JOB_STATE_DRAINED state, retrying while it is still draining.