Package net.sf.eos.hadoop.mapred.index

Mapreduce task to create a Lucene index in the HDFS.

See:
Description

Class Summary

FsDirectory	Reads a Lucene index stored in Hadoops DFS.
IndexMapper<K extends WritableComparable>
IndexMapReduceDriver
IndexMerger	IndexMerger creates an index for the output corresponding to a single fetcher run.
IndexReducer<K extends WritableComparable>
LuceneOutputFormat<K extends WritableComparable,V extends ObjectWritable>	Support to write a Lucene index in a Hadoop filesystem.

Package net.sf.eos.hadoop.mapred.index Description

Mapreduce task to create a Lucene index in the HDFS.

IndexMapReduceDriver is the main class to start the indexing process. IndexMerger creates a compact, optimized Lucene index from the different indices in the HDFS.

Some code is taken from the Nutch project of the Apache Foundation. This code comes under the terms of the Apache 2 license.

Since:

0.1.0

Author:

Sascha Kohlmann

See Also:

net.sf.eos.lucene