Skip to content

LennMars/TreeReduction

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Outline:
Distributed parallel tree reduction algorithm with Hadoop MapReduce based on:
-Kazuhiko Kakehi, Kiminori Matsuzaki, and Kento Emoto. Efficient parallel tree reductions on distributed memory environments. In Proceedings of the 7th international conference on Computational Science, Part II, ICCS ’07, pp. 601–608, Berlin, Heidelberg, 2007. Springer-Verlag.
-Kazuhiko Kakehi, Kiminori Matsuzaki, Kento Emoto, and Zhenjiang Hu. A practicable framework for tree reductions under distributed memory environments. Technical Report METR 2006-64, Department of Mathematical Informatics, University of Tokyo, 2006.

Requirements:
Scala 2.9.1
Hadoop 0.20.203.1
sbt 0.1

Build:
commons-logging-1.1.1.jar and hadoop-core-0.20.203.0.jar must be placed
in main/lib directory.
-sbt package

Running:
-put scala-library.jar in ${HADOOP}/lib
-main/exec.sh <options> <input>
-ex) ./exec.sh -l input/sample.in

About

process tree-structured data using Hadoop MapReduce

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published