hu.juranyi.zsolt.pubsearch.crawl

Class HTTPRequest

java.lang.Object

hu.juranyi.zsolt.pubsearch.crawl.HTTPRequest

Direct Known Subclasses:

HTTPRequestEx

public class HTTPRequest
extends java.lang.Object

Executes a HTTP request and downloads the response. Can be used to download a page or post a GET/POST form. Uses Apache HTTPClient 3.0.1

Field Summary

Fields

Modifier and Type	Field and Description
protected java.lang.String	error
protected java.lang.String	html
protected java.lang.String	queryString
protected java.lang.String	url

Constructor Summary

Constructors

Constructor and Description
HTTPRequest(java.lang.String url) Sets up the HTTPRequest object.
HTTPRequest(java.lang.String url, java.lang.String queryString) Sets up the HTTPRequest object.
HTTPRequest(java.lang.String url, java.lang.String queryString, java.lang.String method) Sets up the HTTPRequest object.

Method Summary

Methods

Modifier and Type	Method and Description
static long	getBytes()
java.lang.String	getHtml()
void	setProxy(java.lang.String proxyIPPORT) Sets up the proxy used by the client.
void	setProxy(java.lang.String proxyIP, int proxyPort) Sets up the proxy used by the client.
boolean	submit() Sends the request then downloads HTML response page.
static void	zeroBytes() Sets the static byte counter to 0.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

url

protected java.lang.String url

queryString

protected java.lang.String queryString

html

protected java.lang.String html

error

protected java.lang.String error

Constructor Detail

HTTPRequest

public HTTPRequest(java.lang.String url,
           java.lang.String queryString,
           java.lang.String method)

Sets up the HTTPRequest object.

Parameters:

url - Request will be sent to this address.

queryString - GET/POST parameters in querystring syntax.

method - "GET" or "POST"

HTTPRequest

public HTTPRequest(java.lang.String url,
           java.lang.String queryString)

Sets up the HTTPRequest object. Method will be GET.

Parameters:

url - Request will be sent to this address.

queryString - GET/POST parameters in querystring syntax.

HTTPRequest

public HTTPRequest(java.lang.String url)

Sets up the HTTPRequest object. Querystring will be empty and method will be GET.

Parameters:

url - Request will be sent to this address.

Method Detail

setProxy

public void setProxy(java.lang.String proxyIP,
            int proxyPort)

Sets up the proxy used by the client.

Parameters:

proxyIP - Proxy IP.

proxyPort - Proxy port.

setProxy

public void setProxy(java.lang.String proxyIPPORT)

Sets up the proxy used by the client.

Parameters:

proxyIPPORT - Proxy IP and port, format: "IP:PORT", for example: "127.0.0.1:8080". If port is not included, sets to 8080 by default.

submit

public boolean submit()

Sends the request then downloads HTML response page. Size will be added to the static byte counter. If the process fails, stores the error message in 'error' field.

Returns:

True if succeded, false on error.

getBytes

public static long getBytes()

zeroBytes

public static void zeroBytes()

Sets the static byte counter to 0.

getHtml

public java.lang.String getHtml()