Crawl Constructor
|
Initializes a new instance of the Crawl class. |
Crawler | Gets the crawler. |
CrawlInfo | Gets the crawl info. |
Partner | Gets the partner Crawl. Each Crawl has a partner that it can take CrawlRequests from should the Crawl become stuck on a WebPage that is slow to respond, or that is streaming large volumes of content... |
BeginCrawl | Overloaded. Begins a Crawl. This method bypasses the Cache. //HACK: This is only for testing! |
Equals (inherited from Object) | |
GetHashCode (inherited from Object) | |
GetType (inherited from Object) | |
ToString (inherited from Object) |
Finalize (inherited from Object) | |
MemberwiseClone (inherited from Object) |
ArachnodeDAO | |
Thread | Gets or sets the thread. |
UnassignedDiscoveries | Gets or sets the unassigned discoveries. |
UncrawledCrawlRequests | Gets the uncrawled crawl requests. |
WebClient |
BeginCrawl | Overloaded. Begins the crawl. |
ProcessCrawlRequest | Processes the crawl request. |
SaveCrawlRequestsToDatabase | Saves the crawl requests to database. |
Crawl Class | Arachnode.SiteCrawler.Components Namespace