arachnode.net

ArachnodeDAO.GetCrawlRequests Method

Returns a DataTable containing the database representation of a CrawlRequest. This procedure creates CrawlRequests for the Engine to process from rows in table 'CrawlRequests'.

public CrawlRequestsDataTable GetCrawlRequests(
   int _maximumNumberOfCrawlRequestsToCreatePerBatch,
   bool createCrawlRequestsFromDatabaseCrawlRequests,
   bool createCrawlRequestsFromDatabaseFiles,
   bool assignCrawlRequestPrioritiesForFiles,
   bool createCrawlRequestsFromDatabaseHyperLinks,
   bool assignCrawlRequestPrioritiesForHyperLinks,
   bool createCrawlRequestsFromDatabaseImages,
   bool assignCrawlRequestPrioritiesForImages,
   bool createCrawlRequestsFromDatabaseWebPages,
   bool assignCrawlRequestPrioritiesForWebPages
);

Parameters

_maximumNumberOfCrawlRequestsToCreatePerBatch
See: ApplicationSettings.MaximumNumberOfCrawlRequestsToCreatePerBatch
createCrawlRequestsFromDatabaseCrawlRequests
See: ApplicationSettings.CreateCrawlRequestsFromDatabaseCrawlRequests
createCrawlRequestsFromDatabaseFiles
See: ApplicationSettings.CreateCrawlRequestsFromDatabaseFiles
assignCrawlRequestPrioritiesForFiles
if set to true [assign crawl request priorities for files].
createCrawlRequestsFromDatabaseHyperLinks
See: ApplicationSettings.CreateCrawlRequestsFromDatabaseHyperLinks
assignCrawlRequestPrioritiesForHyperLinks
if set to true [assign crawl request priorities for hyper links].
createCrawlRequestsFromDatabaseImages
if set to true [create crawl requests from database images].
assignCrawlRequestPrioritiesForImages
if set to true [assign crawl request priorities for images].
createCrawlRequestsFromDatabaseWebPages
See: ApplicationSettings.CreateCrawlRequestsFromDatabaseWebPages
assignCrawlRequestPrioritiesForWebPages
if set to true [assign crawl request priorities for web pages].

Return Value

See Also

ArachnodeDAO Class | Arachnode.DataAccess Namespace