How to run the example.
- Download spark-1.4.0-bin-hadoop2.6.tgz
- Unzip it
- Start ./sbin/start-master.sh
- Start ./sbin/start-slave.sh spark://superthree:7077
- Check page http://localhost:8080/
- Under eclipse project, it needs the library spark-assembly-1.4.0-hadoop2.6.0.jar
- jar cvf simpleapp.jar -C bin/ .
- Run spark-submit --class SimpleApp --master spark://superthree:7077 simpleapp.jar /media/gf/Storage/workspace/SparkApp/test > results
- Check result file retults