Module scrape_exchange 

Scrape Exchange REST API client for uploading and querying scraped data.

Implements a typed client for the Scrape Exchange platform with JWT authentication, automatic token refresh, and endpoints for:

• Publishing scraped records via DataSinkPort
• Querying published data
• Item-level lookups
• Rate-limited retry logic

Feature

This adapter is feature-gated behind scrape-exchange.

Example

use stygian_graph::adapters::scrape_exchange::{ScrapeExchangeClient, ScrapeExchangeConfig};
use std::time::Duration;

let config = ScrapeExchangeConfig {
    api_key_id:     "your_key_id".to_string(),
    api_key_secret: "your_secret".to_string(),
    base_url:       "https://scrape.exchange/api/".to_string(),
};

let client = ScrapeExchangeClient::new(config).await?;
// client.health_check().await?;

Structs

FeedConfig

Configuration for the Scrape Exchange WebSocket feed adapter.

FeedFilter

Server-side filter options for the Scrape Exchange real-time message feed.

ScrapeExchangeAdapter

Pipeline adapter wrapping ScrapeExchangeClient that implements DataSinkPort and ScrapingService.

ScrapeExchangeClient

Scrape Exchange REST API client with JWT auth and automatic token refresh.

ScrapeExchangeConfig

Configuration for Scrape Exchange API client.

ScrapeExchangeFeed

Adapter that subscribes to the Scrape Exchange real-time WebSocket feed, implementing StreamSourcePort.

Enums

FeedMessageType

Which message content to request from the feed.

ScrapeExchangeError

Errors from Scrape Exchange API client.