org.eclipse.smila.importing.crawler.web

Class WebFetcherWorker

java.lang.Object

org.eclipse.smila.importing.crawler.web.WebFetcherWorker

All Implemented Interfaces:

Worker

public class WebFetcherWorker
extends java.lang.Object
implements Worker

Fetches binary content from URL and stores the content as record attachment.

Constructor Summary

Constructors

Constructor and Description
WebFetcherWorker()

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	getName()
void	perform(TaskContext taskContext) Performs a computation on the data available in the TaskContext, such as a task for this worker, input and (if configured) output slots.
void	setFetcher(Fetcher fetcher) DS service reference injection method.
void	unsetFetcher(Fetcher fetcher) DS service reference removal method.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WebFetcherWorker

public WebFetcherWorker()

Method Detail

getName

public java.lang.String getName()

Specified by:

getName in interface Worker

Returns:

the name of the worker. The worker function will be executed for tasks tied to this worker name.

perform

public void perform(TaskContext taskContext)
             throws java.lang.Exception

Description copied from interface: Worker

Performs a computation on the data available in the TaskContext, such as a task for this worker, input and (if configured) output slots. An implementor must make sure, calls to this method must be thread-safe!

Specified by:

perform in interface Worker

Parameters:

taskContext - the TaskContext information with which this operation can be performed.

Throws:

java.lang.Exception

setFetcher

public void setFetcher(Fetcher fetcher)

DS service reference injection method.

unsetFetcher

public void unsetFetcher(Fetcher fetcher)

DS service reference removal method.