Module policy 

Robots policy value type + decision — recon/production reconciliation (T111). Single robots policy value type — closes guide failure mode #9.

Recon and production paths must agree on the policy applied to every URL they touch. The guide calls this out as the ninth failure mode of agent-built scrapers: “Two robots.txt policies, never reconciled. Exploration ignores it; the deliverable obeys it.”

This module exposes a single RobotsPolicy enum plus its decision type RobotsDecision. Both recon and production consume the same value through RobotsPolicyGuard (in ports/robots_policy.rs), so the policy choice can be asserted at pipeline-build time and again at execute time.

Enums

RobotsDecision

The verdict returned by a RobotsPolicyGuard for a single URL.

RobotsPolicy

How a pipeline treats robots.txt across recon and production.