org.eclipse.smila.importing.crawler.file
Class FileCrawlerWorker

java.lang.Object
  org.eclipse.smila.importing.crawler.file.FileCrawlerWorker

All Implemented Interfaces:

Worker

public class FileCrawlerWorker
extends java.lang.Object
implements Worker

Worker implementation that performs file crawling.

Author:

stuc07

Field Summary

protected Log	_log
static java.lang.String	INPUT_SLOT_DIRS_TO_CRAWL
static int	MAX_FILES_PER_BULK
static java.lang.String	NAME Name of the worker, used in worker description and workflows.
static java.lang.String	OUTPUT_SLOT_DIRS_TO_CRAWL
static java.lang.String	OUTPUT_SLOT_FILES_TO_CRAWL

Constructor Summary

FileCrawlerWorker()

Method Summary

java.lang.String	getName()
void	perform(TaskContext taskContext) Performs a computation on the data available in the TaskContext, such as a task for this worker, input and (if configured) output slots.
void	setFileCrawlerService(FileCrawlerService fileCrawler)
void	unsetFileCrawlerService(FileCrawlerService fileCrawler)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

NAME

public static final java.lang.String NAME

Name of the worker, used in worker description and workflows.

See Also:

Constant Field Values

INPUT_SLOT_DIRS_TO_CRAWL

public static final java.lang.String INPUT_SLOT_DIRS_TO_CRAWL

See Also:

Constant Field Values

OUTPUT_SLOT_DIRS_TO_CRAWL

public static final java.lang.String OUTPUT_SLOT_DIRS_TO_CRAWL

See Also:

Constant Field Values

OUTPUT_SLOT_FILES_TO_CRAWL

public static final java.lang.String OUTPUT_SLOT_FILES_TO_CRAWL

See Also:

Constant Field Values

MAX_FILES_PER_BULK

public static final int MAX_FILES_PER_BULK

See Also:

Constant Field Values

_log

protected final Log _log

Constructor Detail

FileCrawlerWorker

public FileCrawlerWorker()

Method Detail

setFileCrawlerService

public void setFileCrawlerService(FileCrawlerService fileCrawler)

unsetFileCrawlerService

public void unsetFileCrawlerService(FileCrawlerService fileCrawler)

perform

public void perform(TaskContext taskContext)
             throws java.lang.Exception

Performs a computation on the data available in the TaskContext, such as a task for this worker, input and (if configured) output slots. An implementor must make sure, calls to this method must be thread-safe!

Specified by:

perform in interface Worker

Parameters:

taskContext - the TaskContext information with which this operation can be performed.

Throws:

java.lang.Exception

getName

public java.lang.String getName()

Specified by:

getName in interface Worker

Returns:

the name of the worker. The worker function will be executed for tasks tied to this worker name.