Skip to content

USC Version of Hadoop that includes HDFS-RAID. Erasure codes like Locally Repairable Codes (aka Simple Regenerating Code), Reed Solomon Code and XOR code are supported

License

sunzz679/HadoopUSC

 
 

Repository files navigation

This is a version of code that runs on Facebook's clusters and is powered by
Apache Hadoop. It is used for both the warehouse workloads and the realtime
HBase/Scribe workloads.

This code is based on Apache Hadoop 0.20/Apache Hadoop 0.20-append.

FB-CHANGES.txt contains the additional pathches that have been committed to
the original code base.

PLEASE NOTE: 
 
 * This distribution includes cryptographic software that 
   is subject to U.S. export control laws and applicable 
   export and import laws of other countries. BEFORE using 
   any software made available from this site, it is your 
   responsibility to understand and comply with these laws. 
   This software is being exported in accordance with the 
   Export Administration Regulations. As of June 2009, you 
   are prohibited from exporting and re-exporting this 
   software to Cuba, Iran, North Korea, Sudan, Syria and 
   any other countries specified by regulatory update to 
   the U.S. export control laws and regulations. Diversion 
   contrary to U.S. law is prohibited.  

About

USC Version of Hadoop that includes HDFS-RAID. Erasure codes like Locally Repairable Codes (aka Simple Regenerating Code), Reed Solomon Code and XOR code are supported

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 83.1%
  • Shell 6.5%
  • C 2.5%
  • Python 2.2%
  • JavaScript 1.7%
  • C++ 0.9%
  • Other 3.1%