Module crawler

Crawler result objects — port of sdk/go/result_crawler.go.

Modules

• status
  Crawler status constants.

Structs

• CrawlContent
  Typed content wrapper for a single crawled URL (Crawl::read).
• CrawlerArtifact
  WARC or HAR artifact downloaded from the crawler endpoint.
• CrawlerContents
  GET /crawl/{uuid}/contents bulk-JSON envelope.
• CrawlerContentsLinks
  Pagination links returned with bulk contents.
• CrawlerStartResponse
  Response from POST /crawl.
• CrawlerState
  Inner state block of CrawlerStatus.
• CrawlerStatus
  Response from GET /crawl/{uuid}/status.
• CrawlerUrlEntry
  One entry in the streaming urls list.
• CrawlerUrls
  Streaming response from GET /crawl/{uuid}/urls.

Enums

• CrawlerArtifactType
  Artifact type — warc or har.