Adds the crawl request to be crawled.

Overload List

Adds the crawl request to be crawled.

internal static bool AddCrawlRequestToBeCrawled(CrawlRequest,bool,ArachnodeDAO)

When used publicly, this method is used to insert CrawlRequests into the main CrawlRequest PriorityQueue. When used internally, this method is used by Crawls to insert Files and Images into their own PriorityQueues. When crawling, Crawls prioritize Files and Images above HyperLinks. This method allows the Cache to manage the Discovery associated with the CrawlRequest.

internal static bool AddCrawlRequestToBeCrawled(PriorityQueue<CrawlRequest>,CrawlRequest,bool,ArachnodeDAO,bool)

See Also

Cache Class | Arachnode.SiteCrawler.Core Namespace

---