hu.juranyi.zsolt.pubsearch.crawl

Class Crawler

java.lang.Object

java.lang.Thread

hu.juranyi.zsolt.pubsearch.crawl.ACrawler

hu.juranyi.zsolt.pubsearch.crawl.Crawler

All Implemented Interfaces:

java.lang.Runnable

public class Crawler
extends ACrawler

Controls the whole publication searching procedure. For every known publication database: builds up the search URL and starts PubListCrawler to crawl them.

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields inherited from class hu.juranyi.zsolt.pubsearch.crawl.ACrawler

crawlers, sched, time

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
Crawler(MainTab caller, java.lang.String authorFilter, java.lang.String titleFilter, int transLev, int dbThreadLimit, int ppThreadLimit) Sets up the crawler.

Method Summary

Methods

Modifier and Type	Method and Description
protected void	crawl() Gets publication database list, sets up search URL and starts the crawl for all of them.
void	run() Calls crawl(), and measures running time in 'time' field.

Methods inherited from class hu.juranyi.zsolt.pubsearch.crawl.ACrawler

getTime, interrupt, launch, scheduleCrawlers, waitForCrawlers

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Crawler

public Crawler(MainTab caller,
       java.lang.String authorFilter,
       java.lang.String titleFilter,
       int transLev,
       int dbThreadLimit,
       int ppThreadLimit)

Sets up the crawler.

Parameters:

caller - The caller MainTab object, that Crawler will notify at the end.

authorFilter - Search for this author.

titleFilter - Filter for this title.

transLev - 0: only search results, 1: referrer publications also 2: referrer of referrers also will be grabbed.

dbThreadLimit - Maximum count of PubListCrawler threads = databases crawled at the same time.

ppThreadLimit - Maximum count of PubPageCrawler threads = publication pages crawled at the same time.

Method Detail

run

public void run()

Description copied from class: ACrawler

Calls crawl(), and measures running time in 'time' field.

Specified by:

run in interface java.lang.Runnable

Overrides:

run in class ACrawler

crawl

protected void crawl()

Gets publication database list, sets up search URL and starts the crawl for all of them. Waits for the child threads then notifies 'caller'.

Specified by:

crawl in class ACrawler