hu.juranyi.zsolt.pubsearch.crawl

Class HTTPRequestEx

java.lang.Object

hu.juranyi.zsolt.pubsearch.crawl.HTTPRequest

hu.juranyi.zsolt.pubsearch.crawl.HTTPRequestEx

public class HTTPRequestEx
extends HTTPRequest

Extends HTTPRequest to fit the programs requirements: retries download on error, sets up random proxy for every try, and stores downloaded pages in a cache.

Field Summary

Fields inherited from class hu.juranyi.zsolt.pubsearch.crawl.HTTPRequest

error, html, queryString, url

Constructor Summary

Constructors

Constructor and Description
HTTPRequestEx(java.lang.String url) Sets up the HTTPRequestEx object.
HTTPRequestEx(java.lang.String url, java.lang.String queryString) Sets up the HTTPRequestEx object.
HTTPRequestEx(java.lang.String url, java.lang.String queryString, java.lang.String method) Sets up the HTTPRequestEx object.

Method Summary

Methods

Modifier and Type	Method and Description
boolean	submit() Calls submit(5).
boolean	submit(int tries) Calls HTTPRequest's submit() but tries again if it fails.

Methods inherited from class hu.juranyi.zsolt.pubsearch.crawl.HTTPRequest

getBytes, getHtml, setProxy, setProxy, zeroBytes

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HTTPRequestEx

public HTTPRequestEx(java.lang.String url,
             java.lang.String queryString,
             java.lang.String method)

Sets up the HTTPRequestEx object.

Parameters:

url - Request will be sent to this address.

queryString - GET/POST parameters in querystring syntax.

method - "GET" or "POST"

HTTPRequestEx

public HTTPRequestEx(java.lang.String url,
             java.lang.String queryString)

Sets up the HTTPRequestEx object. Method will be GET.

Parameters:

url - Request will be sent to this address.

queryString - GET/POST parameters in querystring syntax.

HTTPRequestEx

public HTTPRequestEx(java.lang.String url)

Sets up the HTTPRequestEx object. Querystring will be empty and method will be GET.

Parameters:

url - Request will be sent to this address.

Method Detail

submit

public boolean submit()

Calls submit(5).

Overrides:

submit in class HTTPRequest

Returns:

True if succeded, false on error.

submit

public boolean submit(int tries)

Calls HTTPRequest's submit() but tries again if it fails. Downloaded pages will be stored in the cache.

Parameters:

tries - Count of tryings.

Returns:

True if succeded, false on error.