When used publicly, this method is used to insert CrawlRequests into the main CrawlRequest PriorityQueue. When used internally, this method is used by Crawls to insert Files and Images into their own PriorityQueues. When crawling, Crawls prioritize Files and Images above HyperLinks. This method allows the Cache to manage the Discovery associated with the CrawlRequest.
Was the CrawlRequest added to the PriorityQueue to be crawled?
Cache Class | Arachnode.SiteCrawler.Core Namespace | Cache.AddCrawlRequestToBeCrawled Overload List