hu.juranyi.zsolt.pubsearch.crawl

Class PubPageCrawler

java.lang.Object

java.lang.Thread

hu.juranyi.zsolt.pubsearch.crawl.ACrawler

hu.juranyi.zsolt.pubsearch.crawl.PubPageCrawler

All Implemented Interfaces:

java.lang.Runnable

public class PubPageCrawler
extends ACrawler

Processes a pubpage (page which contains details of a publication): extracts basic information and starts the list crawler for referring publications if needed (if transitivity level is above 0).

Nested Class Summary

Nested classes/interfaces inherited from class java.lang.Thread

java.lang.Thread.State, java.lang.Thread.UncaughtExceptionHandler

Field Summary

Fields inherited from class hu.juranyi.zsolt.pubsearch.crawl.ACrawler

crawlers, sched, time

Fields inherited from class java.lang.Thread

MAX_PRIORITY, MIN_PRIORITY, NORM_PRIORITY

Constructor Summary

Constructors

Constructor and Description
PubPageCrawler(PDatabase pdb, java.lang.String page, int transLev, boolean refPubMode, boolean download) Sets up the pubpage crawling.

Method Summary

Methods

Modifier and Type	Method and Description
protected void	crawl() Downloads the page if needed, grabs BibTeX if any, extracts authors, title and year, and crawls referring publications if transitivity level is above 0.
Publication	getPublication()

Methods inherited from class hu.juranyi.zsolt.pubsearch.crawl.ACrawler

getTime, interrupt, launch, run, scheduleCrawlers, waitForCrawlers

Methods inherited from class java.lang.Thread

activeCount, checkAccess, clone, countStackFrames, currentThread, destroy, dumpStack, enumerate, getAllStackTraces, getContextClassLoader, getDefaultUncaughtExceptionHandler, getId, getName, getPriority, getStackTrace, getState, getThreadGroup, getUncaughtExceptionHandler, holdsLock, interrupted, isAlive, isDaemon, isInterrupted, join, join, join, resume, setContextClassLoader, setDaemon, setDefaultUncaughtExceptionHandler, setName, setPriority, setUncaughtExceptionHandler, sleep, sleep, start, stop, stop, suspend, toString, yield

Methods inherited from class java.lang.Object

equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

PubPageCrawler

public PubPageCrawler(PDatabase pdb,
              java.lang.String page,
              int transLev,
              boolean refPubMode,
              boolean download)

Sets up the pubpage crawling.

Parameters:

pdb - PDatabase object which contains information for database specific crawling.

page - Pubpage URL or HTML content - 'download' parameter will tell.

transLev - 0: only basic information, 1: referrer publications also 2: referrer of referrers also will be grabbed.

refPubMode - If true, it handles the pubpage as pubpage of a referring publication which may need different patterns to be used.

download - If true, URL given in 'page' parameter will be used to download the page, otherwise 'page' will be used as the downloaded HTML content.

Method Detail

getPublication

public Publication getPublication()

crawl

protected void crawl()

Downloads the page if needed, grabs BibTeX if any, extracts authors, title and year, and crawls referring publications if transitivity level is above 0.

Specified by:

crawl in class ACrawler