CrawlRequests contain a Discovery and instructions for a Crawl. An important distinction to make between a Discovery is that a Discovery exists elsewhere, while a CrawlRequest contains data returned from the Discovery. Additionally, a CrawlRequest contains behavioral instructions and conditions.

For a list of all members of this type, see CrawlRequest Members .

System.Object
   AStorable
      ADisallowed
         CrawlRequest

Thread Safety

Public static (Shared in Visual Basic) members of this type are safe for multithreaded operations. Instance members are not guaranteed to be thread-safe.

Requirements

Namespace: Arachnode.SiteCrawler.Value

Assembly: Arachnode.SiteCrawler (in Arachnode.SiteCrawler.dll)

See Also

CrawlRequest Members | Arachnode.SiteCrawler.Value Namespace

---