Module work_queue

Module work_queue 

Source
Expand description

Work queue port — distributed task execution Work queue port — distributed task execution interface

Defines the abstractions required to distribute pipeline node execution across multiple workers (local threads, remote processes, or serverless workers such as Spin components).

§Architecture

DagExecutor
    │  (wave N ready)
    ▼
WorkQueuePort::enqueue(tasks…)
    │
    ├─► Worker 1: dequeue → execute node → acknowledge
    ├─► Worker 2: dequeue → execute node → acknowledge
    └─► Worker N: dequeue → execute node → acknowledge
    │
collect_results(pipeline_id) → Vec<(node_name, ServiceOutput)>

Structs§

WorkTask
A single unit of work: one pipeline node that needs to be executed.

Enums§

TaskStatus
Lifecycle status of a WorkTask.

Traits§

WorkQueuePort
Port: distributed work queue for pipeline node execution.