arachnode.net

Crawl Members

Crawl overview

Public Instance Constructors

Crawl Constructor Initializes a new instance of the Crawl class.

Public Instance Properties

Crawler Gets the crawler.
CrawlInfo Gets the crawl info.
Partner Gets the partner Crawl. Each Crawl has a partner that it can take CrawlRequests from should the Crawl become stuck on a WebPage that is slow to respond, or that is streaming large volumes of content...

Public Instance Methods

BeginCrawlOverloaded. Begins a Crawl. This method bypasses the Cache. //HACK: This is only for testing!
Equals (inherited from Object) 
GetHashCode (inherited from Object) 
GetType (inherited from Object) 
ToString (inherited from Object) 

Protected Instance Methods

Finalize (inherited from Object) 
MemberwiseClone (inherited from Object) 

Internal Instance Properties

ArachnodeDAO
Thread Gets or sets the thread.
UnassignedDiscoveries Gets or sets the unassigned discoveries.
UncrawledCrawlRequests Gets the uncrawled crawl requests.
WebClient

Internal Instance Methods

BeginCrawlOverloaded. Begins the crawl.
ProcessCrawlRequest Processes the crawl request.
SaveCrawlRequestsToDatabase Saves the crawl requests to database.

See Also

Crawl Class | Arachnode.SiteCrawler.Components Namespace