arachnode.net

DiscoveryManager.IsCrawlRestricted Method

Determines whether the specified crawl request is restricted.

internal static bool IsCrawlRestricted(
CrawlRequest crawlRequest,
string absoluteUri
);

Parameters

crawlRequest: The crawl request.
absoluteUri: The absolute URI.

Return Value

true if the specified crawl request is restricted; otherwise, false.

See Also

DiscoveryManager Class | Arachnode.SiteCrawler.Managers Namespace