arachnode.net

RobotsDotText.IsDisallowed Method

Determines whether the specified crawl request is disallowed.

Overload List

Determines whether the specified crawl request is disallowed.

public override bool IsDisallowed(CrawlRequest,ArachnodeDAO)

Determines whether the specified crawl request is disallowed.

public override bool IsDisallowed(Discovery,ArachnodeDAO)

See Also

RobotsDotText Class | Arachnode.SiteCrawler.Rules Namespace