Skip to content

azymnis/pangool-benchmark

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

This project contains implementations in Hadoop, Crunch (with Avro) and Cascading of three problems: "Url Resolution", "Secondary Sort" and "Word count" that matches those that can be found in Pangool examples. With these alternative implementations we can benchmark the performance of Pangool and compare it with these other APIs. 

The version of Cascading used for these implementations is the stable 1.2.5
The version of Crunch used is 0.2.0 (manually) built on 2012-02-02 - Crunch doesn't have a stable / official release yet. (To build Crunch, git clone it and mvn install: mvn install:install-file -DgroupId=com.cloudera.crunch -DartifactId=crunch -Dversion=0.2.0 -Dpackaging=jar -Dfile=/path/to/file).

About

Benchmarks tools for Pangool

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 93.6%
  • Shell 6.4%