Hadoop

Two points for being a Michael!

After my trip to the CIO Forum, I became very interested in Big Data, particularly Hadoop as a processing tool.

So, I found this:

http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster

written by another Michael – and very well done.  I cheated a bit and didn’t follow all of his instructions (for Java, etc…) but after 2 tries, got it all to work!

I’ve run my first two Hadoop jobs, and am now calculating some statistics for them.  Meanwhile, I’m building a two-node cluster (and will re-run jobs, gather stats), then hope to graduate to a 10+ node cluster.

Over the years, I’ve collected the retired Mac Minis, and have stored them away for some dark purpose.  This is that time.  This is their moment.  They shall rise and power Hadoop.  For free.

Anyway, off to configs.  I’ve much to do, and so little time to do it…

Leave a Reply