init Hadoop single node setup

Author: mhausenblas

.gitignore

@@ -1,3 +1,4 @@
 *.pyc
+.DS_Store
 hb/
-.DS_Store
+tmp/

.mrjob.conf

@@ -4,10 +4,8 @@
             "base_tmp_dir": "./tmp/"
         },
         "hadoop": {
-            "python_archives": ["$BT/aws/src-tree.tar.gz"],
-            "upload_files": ["$BT/config/config.py", "$BT/config/secret.py"],
-            "base_tmp_dir": "/scratch/$USER",
-            "setup_cmds": ["ln -sf $(readlink -f config.py) src-tree.tar.gz/config/config.py", "ln -sf $(readlink -f secret.py) src-tree.tar.gz/config/secret.py", "cd src-tree.tar.gz; make -f Makefile.emr"]
+            "hadoop_home" : "/Users/michau/hadoop-1.0.4",
+            "base_tmp_dir": "/Users/michau/tmp/",
         },
         "emr": {
             "s3_scratch_uri": "s3://walrus/tmp/",

README.md

@@ -85,7 +85,19 @@ In order to query the mrlin datastore in HBase, use the [`mrlin query`](https://
 
 * setup in virtual env: `source hb/bin/activate` then `pip install mrjob`
 * `cp .mrjob.conf ~` before launch
-* run `python mrlin_mr.py README.md`
+* `source hb/bin/activate`
+* run `python mrlin_mr.py README.md` for standalone
+* set up [Hadoop 1.0.4](http://ftp.heanet.ie/mirrors/www.apache.org/dist/hadoop/common/hadoop-1.0.4/hadoop-1.0.4.tar.gz) - if unsure follow a [single-node setup](http://orzota.com/blog/single-node-hadoop-setup-2/)  tutorial
+* `cp .mrjob.conf ~` before launch if you change settings (!)
+* note all changes that were necessary in ` conf/core-site.xml`, `conf/mapred-site.xml`, `conf/hdfs-site.xml`, and `hadoop-env.sh` (provide examples)
+* run `python mrlin_mr.py -r hadoop README.md` for local Hadoop 
+
+
+#### Debug
+
+* `tail -f hadoop-michau-namenode-Michael-Hausenblas-iMac.local.log`
+
+
 
 ## License