Arachnode.SiteCrawler.Value Namespace
Namespace Hierarchy
Classes
| Class |
Description |
|
CrawlInfo
|
|
|
CrawlRequest
|
CrawlRequests contain a Discovery and instructions for a Crawl. An important distinction to make between a Discovery is that a Discovery exists elsewhere, while a CrawlRequest contains data returned from the Discovery. Additionally, a CrawlRequest contains behavioral instructions and conditions. |
|
Discoveries
|
A helper class used by Crawl and DiscoveryManager. |
|
Discovery
|
A Discovery is an AbsoluteUri, whether discovered by a user or by a Crawl. An important distinction to make between a Discovery is that a Discovery exists elsewhere, while a CrawlRequest contains data returned from the Discovery. Additionally, a CrawlRequest contains behavioral instructions and conditions. |
|
ManagedFile
|
|
|
ManagedImage
|
|
|
ManagedWebPage
|
|
|
Politeness
|
Politeness class used by Rules and the RulesEngine. |