Skip to main content

Module distributed_redis

Module distributed_redis 

Source
Expand description

Redis Streams work queue adapter (feature = “redis”) Redis Streams WorkQueuePort adapter

Production-grade distributed work queue backed by Redis Streams with consumer groups, dead-letter queues, and stuck-task reclamation.

§Feature gate

Requires feature = "redis" (shared with RedisCache).

§Architecture

XADD  {stream}        ─► Consumer Group ─► XREADGROUP (workers)
                                          ─► XACK on success
                                          ─► XADD {stream}:dlq on exhausted retries
HSET  {stream}:results:{task_id}         ─► acknowledge stores output
HSET  {stream}:tasks:{task_id}           ─► task metadata (pipeline_id, node_name, attempt)

Structs§

RedisWorkQueue
Redis Streams backed WorkQueuePort adapter.
RedisWorkQueueConfig
Configuration for RedisWorkQueue.