Skip to content

yangwn/HBase-ToHDFS

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

HBase-toHDFS

Problem

We have a HBase table and we would like to export it to Text, Seq, Avro, or Parquet.

How to Run

Set up sample tables

  • hadoop jar HBaseToHDFS.jar CreateTable exportTest c 5

Populate with Sample Data

  • hadoop jar HBaseToHDFS.jar PopulateTable 5 1000 exportTest/output exportTest c 1

Exports the data to text

  • hadoop jar HBaseToHDFS.jar ExportHBaseTableToDelimiteredTxt exportTest c export.text false txt.schema |

Exports the data to Seq

  • hadoop jar HBaseToHDFS.jar ExportHBaseTableToDelimiteredSeq exportTest c export.seq false txt.schema \

Exports the data to Avro

  • hadoop jar HBaseToHDFS.jar ExportHBaseTableToAvro exportTest c export.arvo false avro.schema

Reads a Avro File

  • hadoop jar HBaseToHDFS.jar AvroReader export.avro/part-m-00000 avro.schema 10

Exports the data to Parquet

  • hadoop jar HBaseToHDFS.jar ExportHBaseTableToParquet exportTest c export.parquet false avro.schema

  • hadoop jar HBaseToHDFS.jar ParquetReader export.parquet/part-m-00000 10

About

Reads a HBase table and writes the out as Text, Seq, Avro, or Parquet

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Java 100.0%