Public Instance Constructors
CrawlRequest
|
Overloaded. Initializes a new instance of the CrawlRequest class. |
Public Instance Properties
 Crawl | Gets or sets the crawl. |
| Created | Gets or sets the created. |
| CurrentDepth | The current depth. |
| Data | The binary stream of data downloaded by the WebClient. |
| DataType | The DataType of the CrawlRequest. |
| DecodedHtml | Gets or sets the decoded HTML. If you wish to create custom plug-ins that index, say, .doc or .pdf files, assign this property the content you wish to index and it will be indexed by ManageLuceneDotNetIndexes.cs. |
| Discoveries | The Discoveries of the DataType. |
| Discovery | The submitted discovery. |
| Encoding | Gets or sets the encoding. |
| HtmlDocument | The HtmlDocument of the HtmlDocument. |
| IsDisallowed (inherited from ADisallowed) | Is the Discovery/CrawlRequest disallowed? If the Discovery/CrawlRequest is disallowed a Rule may/must update this field. |
| IsDisallowedReason (inherited from ADisallowed) | The reason the Discovery/CrawlRequest is disallowed. If the Discovery is disallowed a Rule may/must update this field. |
| IsStorable (inherited from AStorable) | Is the Discovery/CrawlRequest storable? If the Discovery/CrawlRequest is storable a Rule may/must update this field. |
| ManagedDiscovery | Gets or sets the managed discovery. |
| MaximumDepth | The maximum depth to which this CrawlRequest should crawl. |
| Parent | Gets or sets the parent. (Which Discovery discovered this CrawlRequest...) |
| Politeness | The Politeness of the CrawlRequest. |
| Priority | The Priority of the CrawlRequest. A higher number indicates a higher priority. |
| ProcessData | Gets or sets a value indicating whether [process data]. If ProcessData == false, the CrawlRequest was not allowed to DownloadString from the WebClient as the LastModified HttpRequestHeader was older than LastDiscovered in the database. |
| RenderType | |
| RenderTypeForChildren | |
| RestrictCrawlTo | Gets or sets the restrict crawl to. |
| RestrictDiscoveriesTo | Gets or sets the restrict discoveries to. |
| Tag | Gets or sets the Tag. |
| WebClient | The WebClient of the CrawlRequest. |
Public Instance Methods
| Equals (inherited from Object) | |
| GetHashCode (inherited from Object) | |
| GetType (inherited from Object) | |
| ToString | Returns a String that represents the current Object. |
Protected Instance Methods
 Finalize (inherited from Object) | |
| MemberwiseClone (inherited from Object) |
Internal Instance Constructors
CrawlRequest
|
Overloaded. Initializes a new instance of the CrawlRequest class. |
Internal Instance Properties
 OutputIsDisallowedReason (inherited from ADisallowed) | If the Discovery/CrawlRequest is disallowed a Rule may/must update this field. |
See Also
CrawlRequest Class | Arachnode.SiteCrawler.Value Namespace