arachnode.net

Politeness Members

Politeness overview

Public Instance Constructors

Politeness Constructor Initializes a new instance of the Politeness class.

Public Instance Properties

CrawlDelay Gets or sets the crawl delay.
DisallowedPaths Gets or sets the disallowed paths.
DisallowedPathsSince Gets or sets the disallowed paths since.
Host Gets or sets the host.
WebPageRequestsSince Gets or sets the web page requests since.
WebRequests Gets or sets the web requests.

Public Instance Methods

Equals (inherited from Object) 
GetHashCode (inherited from Object) 
GetType (inherited from Object) 
ToString (inherited from Object) 

Protected Instance Methods

Finalize (inherited from Object) 
MemberwiseClone (inherited from Object) 

See Also

Politeness Class | Arachnode.SiteCrawler.Value Namespace