Struct ScrapeExchangeAdapter 

pub struct ScrapeExchangeAdapter { /* private fields */ }

Pipeline adapter wrapping ScrapeExchangeClient that implements DataSinkPort and ScrapingService.

Use this type when wiring a pipeline output into Scrape Exchange; the raw client is available via ScrapeExchangeAdapter::client() for direct API access.

Example

use stygian_graph::adapters::scrape_exchange::{ScrapeExchangeAdapter, ScrapeExchangeConfig};
use stygian_graph::ports::data_sink::{DataSinkPort, SinkRecord};
use serde_json::json;

let config = ScrapeExchangeConfig {
    api_key_id: "key_id".to_string(),
    api_key_secret: "secret".to_string(),
    base_url: "https://scrape.exchange/api/".to_string(),
};
// let adapter = ScrapeExchangeAdapter::new(config).await?;

Implementations

impl ScrapeExchangeAdapter

pub async fn new( config: ScrapeExchangeConfig, ) -> Result<Self, ScrapeExchangeError>

Create a new adapter and establish an authenticated session.

Errors

Returns ScrapeExchangeError if authentication fails.

Example

use stygian_graph::adapters::scrape_exchange::{ScrapeExchangeAdapter, ScrapeExchangeConfig};
// let adapter = ScrapeExchangeAdapter::new(config).await?;

pub fn client(&self) -> &ScrapeExchangeClient

Access the underlying REST client.

Example

let items = adapter.client().query("me", "web", "pages").await;

Trait Implementations

impl DataSinkPort for ScrapeExchangeAdapter

fn publish<'life0, 'life1, 'async_trait>( &'life0 self, record: &'life1 SinkRecord, ) -> Pin<Box<dyn Future<Output = Result<SinkReceipt, DataSinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Validate and publish a SinkRecord to Scrape Exchange.

Errors

• DataSinkError::ValidationFailed — local validation rejected the record.
• DataSinkError::RateLimited — API returned 429.
• DataSinkError::Unauthorized — API returned 401/403.
• DataSinkError::PublishFailed — any other HTTP error.

fn validate<'life0, 'life1, 'async_trait>( &'life0 self, record: &'life1 SinkRecord, ) -> Pin<Box<dyn Future<Output = Result<(), DataSinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait, 'life1: 'async_trait,

Validate the record locally without publishing.

Errors

DataSinkError::ValidationFailed if the record is structurally invalid.

fn health_check<'life0, 'async_trait>( &'life0 self, ) -> Pin<Box<dyn Future<Output = Result<(), DataSinkError>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Check that the Scrape Exchange API is reachable.

Errors

DataSinkError::PublishFailed if the health endpoint is unreachable.

impl ScrapingService for ScrapeExchangeAdapter

fn execute<'life0, 'async_trait>( &'life0 self, input: ServiceInput, ) -> Pin<Box<dyn Future<Output = DomainResult<ServiceOutput>> + Send + 'async_trait>>

where Self: 'async_trait, 'life0: 'async_trait,

Query Scrape Exchange for data matching the URL’s path components.

Expects input.url to be of the form scrape-exchange://uploader/platform/entity or a full API URL path. Falls back to using the whole URL string as an item-ID lookup.

Errors

Returns a StygianError wrapping any API transport failure.

fn name(&self) -> &'static str

Service name for identification in logs and metrics