clojure-hadoop.gen
gen-conf-methodscljmacro
(gen-conf-methods)Adds the tool-getConf and tool-setConf methods, to the current namespace.
Adds the tool-getConf and tool-setConf methods, to the current namespace.
gen-job-classescljmacro
(gen-job-classes)Creates gen-class forms for Hadoop job classes from the current namespace. Now you only need to write three functions:
(defn mapper-map [this key value mapper-context] ...)
(defn reducer-reduce [this key values reducer-context] ...)
(defn tool-run [& args] ...)
The first two functions are the standard map/reduce functions in any Hadoop job.
The third function, tool-run, will be called by the Hadoop framework to start your job, with the arguments from the command line. It should set up the Job object and call JobClient/runJob, then return zero on success.
You must also call gen-main-method to create the main method.
After compiling your namespace, you can run it as a Hadoop job using the standard Hadoop command-line tools.
Creates gen-class forms for Hadoop job classes from the current namespace. Now you only need to write three functions: (defn mapper-map [this key value mapper-context] ...) (defn reducer-reduce [this key values reducer-context] ...) (defn tool-run [& args] ...) The first two functions are the standard map/reduce functions in any Hadoop job. The third function, tool-run, will be called by the Hadoop framework to start your job, with the arguments from the command line. It should set up the Job object and call JobClient/runJob, then return zero on success. You must also call gen-main-method to create the main method. After compiling your namespace, you can run it as a Hadoop job using the standard Hadoop command-line tools.
gen-main-methodclj
(gen-main-method)Adds a standard main method, named tool-main, to the current namespace.
Adds a standard main method, named tool-main, to the current namespace.
cljdoc is a website building & hosting documentation for Clojure/Script libraries
× close