Google Cloud Dataflow · Arazzo Workflow
Google Cloud Dataflow Snapshot Streaming Job
Version 1.0.0
Confirm a streaming job is running, take a snapshot, then read the snapshot back.
View Spec
View on GitHub
Apache BeamBatch ProcessingBig DataData ProcessingETLStream ProcessingArazzoWorkflows
Provider
Workflows
snapshot-streaming-job
Confirm a streaming job is running, snapshot it, and read the snapshot.
Reads a job to confirm it is running, creates a snapshot of the streaming pipeline, then retrieves the created snapshot to confirm its state.
1
confirmRunning
getLocationJob
Read the job and confirm it is currently in the JOB_STATE_RUNNING state before creating a snapshot.
2
createSnapshot
snapshotLocationJob
Create a snapshot of the running streaming job, capturing its state for later reuse with the supplied retention window.
3
confirmSnapshot
getLocationSnapshot
Read the newly created snapshot back to confirm its state, source job, and creation metadata.