Monday, January 30, 2012

Hadoop Setup

So I gotta install Hadoop on my Mac OS X 10.7 Lion, and I start running into some errors. I'm following the official setup tutorial: http://hadoop.apache.org/common/docs/current/single_node_setup.html. To avoid these, do the following:

  • Modify hadoop-x.x.x/conf/hadoop-env.sh with these lines:
export JAVA_HOME=/System/Library/Java/JavaVirtualMachines/1.6.0.jdk/Contents/Home
export HADOOP_OPTS="-Djava.security.krb5.realm=OX.AC.UK -Djava.security.krb5.kdc=kdc0.ox.ac.uk:kdc1.ox.ac.uk"

The first line allows things to run. The second avoids the weird runtime warning
"Unable to load realm info from SCDynamicStore".
  • Enable ssh to localhost for pseudo-distributed operation:
Go to System Preferences -> Sharing -> Remote Login -> check little checkbox.

That's it. Just follow the rest of the instructions and you'll be set up good :).

No comments:

Post a Comment