How to submit a job to a remote JobTracker
One of the first things you start thinking after your very first hadoop jobs is what should I do to submit a job to a remote JobTracker? Cause otherwise you’re restricted to run this jobs using the same user and the same machine where your JobTracker is.
So here there are a few hints on how to do it.
The jobtracker should not only be listening to localhost connections, to do what we’ll update the mapred-site.xml file, like this:
<name >mapred.job.tracker </name >
<value >192.168.1.1:54311 </value >
after that the JobTracker in this location start accepting connection to this port.
you’ve to obviously update all references to localhost, like for example the ones located under master or slaves files.
Next thing to update is the core-site.xml file with
Continue reading →