The properties of the CrawlRequest class are listed below. For a complete list of CrawlRequest class members, see the CrawlRequest Members topic.
Public Instance Properties
 Crawl | Gets or sets the crawl. |
| Created | Gets or sets the created. |
| CurrentDepth | The current depth. |
| Data | The binary stream of data downloaded by the WebClient. |
| DataType | The DataType of the CrawlRequest. |
| DecodedHtml | Gets or sets the decoded HTML. If you wish to create custom plug-ins that index, say, .doc or .pdf files, assign this property the content you wish to index and it will be indexed by ManageLuceneDotNetIndexes.cs. |
| Discoveries | The Discoveries of the DataType. |
| Discovery | The submitted discovery. |
| Encoding | Gets or sets the encoding. |
| HtmlDocument | The HtmlDocument of the HtmlDocument. |
| IsDisallowed (inherited from ADisallowed) | Is the Discovery/CrawlRequest disallowed? If the Discovery/CrawlRequest is disallowed a Rule may/must update this field. |
| IsDisallowedReason (inherited from ADisallowed) | The reason the Discovery/CrawlRequest is disallowed. If the Discovery is disallowed a Rule may/must update this field. |
| IsStorable (inherited from AStorable) | Is the Discovery/CrawlRequest storable? If the Discovery/CrawlRequest is storable a Rule may/must update this field. |
| ManagedDiscovery | Gets or sets the managed discovery. |
| MaximumDepth | The maximum depth to which this CrawlRequest should crawl. |
| Parent | Gets or sets the parent. (Which Discovery discovered this CrawlRequest...) |
| Politeness | The Politeness of the CrawlRequest. |
| Priority | The Priority of the CrawlRequest. A higher number indicates a higher priority. |
| ProcessData | Gets or sets a value indicating whether [process data]. If ProcessData == false, the CrawlRequest was not allowed to DownloadString from the WebClient as the LastModified HttpRequestHeader was older than LastDiscovered in the database. |
| RenderType | |
| RenderTypeForChildren | |
| RestrictCrawlTo | Gets or sets the restrict crawl to. |
| RestrictDiscoveriesTo | Gets or sets the restrict discoveries to. |
| Tag | Gets or sets the Tag. |
| WebClient | The WebClient of the CrawlRequest. |
Internal Instance Properties
 OutputIsDisallowedReason (inherited from ADisallowed) | If the Discovery/CrawlRequest is disallowed a Rule may/must update this field. |
See Also
CrawlRequest Class | Arachnode.SiteCrawler.Value Namespace