org.eclipse.smila.connectivity.framework.crawler.web.http
Class Http

java.lang.Object
  org.eclipse.smila.connectivity.framework.crawler.web.http.HttpBase
      org.eclipse.smila.connectivity.framework.crawler.web.http.Http

public class Http
extends HttpBase

Holds the HTTP protocol-specific options.

Field Summary

Fields inherited from class org.eclipse.smila.connectivity.framework.crawler.web.http.HttpBase

_authentication, _connectTimeout, _cookiesEnabled, _headers, _maxLengthBytes, _proxyHost, _proxyLogin, _proxyPassword, _proxyPort, _readTimeout, _referrer, _timeout, _useHttp11, _useProxy, _userAgent, BUFFER_SIZE

Constructor Summary

Http()
Creates a new instance of HTTP.

Method Summary

protected Response	getResponse(java.lang.String urlString) Returns HttpResponse for the given URL.
protected Response	getResponse(java.lang.String urlString, FilterProcessor filterProcessor) Returns HttpResponse for the given URL and filter processor.
void	setConf(Configuration conf) Loads HttpBase and Client configurations.

Methods inherited from class org.eclipse.smila.connectivity.framework.crawler.web.http.HttpBase

getConf, getHeaders, getHttpOutput, getMaxLengthBytes, getReferer, getUseHttp11, getUserAgent, isCookiesEnabled, processGzipEncoded, setCookiesEnabled, setHeaders, setReferer

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Http

public Http()

Creates a new instance of HTTP.

Method Detail

setConf

public void setConf(Configuration conf)

Loads HttpBase and Client configurations.

Overrides:

setConf in class HttpBase

Parameters:

conf - Configuration

getResponse

protected Response getResponse(java.lang.String urlString)
                        throws java.io.IOException

Returns HttpResponse for the given URL.

Specified by:

getResponse in class HttpBase

Parameters:

urlString - String

Returns:

HttpResponse

Throws:

java.io.IOException - if there was a error retrieving URL.

getResponse

protected Response getResponse(java.lang.String urlString,
                               FilterProcessor filterProcessor)
                        throws java.io.IOException

Returns HttpResponse for the given URL and filter processor.

Specified by:

getResponse in class HttpBase

Parameters:

filterProcessor - filterProcessor implementation

urlString - the url string

Returns:

HttpResponse

Throws:

java.io.IOException - if there was a error retrieving URL.