The methods of the RobotsDotText class are listed below. For a complete list of RobotsDotText class members, see the RobotsDotText Members topic.
Public Instance Methods
 AssignSettings | |
| Equals (inherited from Object) | |
| GetHashCode (inherited from Object) | |
| GetType (inherited from Object) | |
| IsDisallowed | Overloaded. Determines whether the specified crawl request is disallowed. |
| Stop | Stops this instance. |
| ToString (inherited from Object) |
Protected Instance Methods
 Finalize (inherited from Object) | |
| MemberwiseClone (inherited from Object) |
See Also
RobotsDotText Class | Arachnode.SiteCrawler.Rules Namespace