Module crawler 

Crawler result objects — port of sdk/go/result_crawler.go.

Modules

status

Crawler status constants.

Structs

CrawlContent

Typed content wrapper for a single crawled URL (Crawl::read).

CrawlerArtifact

WARC or HAR artifact downloaded from the crawler endpoint.

CrawlerContents

GET /crawl/{uuid}/contents bulk-JSON envelope.

CrawlerContentsLinks

Pagination links returned with bulk contents.

CrawlerStartResponse

Response from POST /crawl.

CrawlerState

Inner state block of CrawlerStatus.

CrawlerStatus

Response from GET /crawl/{uuid}/status.

CrawlerUrlEntry

One entry in the streaming urls list.

CrawlerUrls

Streaming response from GET /crawl/{uuid}/urls.

Enums

CrawlerArtifactType

Artifact type — warc or har.