Expand description
Work queue port — distributed task execution Work queue port — distributed task execution interface
Defines the abstractions required to distribute pipeline node execution across multiple workers (local threads, remote processes, or serverless workers such as Spin components).
§Architecture
DagExecutor
│ (wave N ready)
▼
WorkQueuePort::enqueue(tasks…)
│
├─► Worker 1: dequeue → execute node → acknowledge
├─► Worker 2: dequeue → execute node → acknowledge
└─► Worker N: dequeue → execute node → acknowledge
│
collect_results(pipeline_id) → Vec<(node_name, ServiceOutput)>Structs§
- Work
Task - A single unit of work: one pipeline node that needs to be executed.
Enums§
- Task
Status - Lifecycle status of a
WorkTask.
Traits§
- Work
Queue Port - Port: distributed work queue for pipeline node execution.