For a list of all members of this type, see RobotsDotText Members .

System.Object
   ABehavior
      ACrawlRule
         RobotsDotText

Thread Safety

Public static (Shared in Visual Basic) members of this type are safe for multithreaded operations. Instance members are not guaranteed to be thread-safe.

Requirements

Namespace: Arachnode.SiteCrawler.Rules

Assembly: Arachnode.SiteCrawler (in Arachnode.SiteCrawler.dll)

See Also

RobotsDotText Members | Arachnode.SiteCrawler.Rules Namespace

---