Geek Answers Handbook

Error starting hadoop Job Tracker

I tried to run a simple program in hadoop using windows-cygwin.

I can run namenode.

Starting jobtracker, however, a crash is ruled out:

FATAL mapred.JobTracker: java.lang.IllegalArgumentException: Does not contain a valid host:port authority: local at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:162) at org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:128) at org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:2560) at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2200) at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2192) at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:2186) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:300) at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:291) at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4978)

I tried all possible methods to solve this problem, but in vain. Any pointers will help me a lot.

Hdfs-site.xml configurations:

  <configuration><br> <property> <name>fs.default.name< /name> <value>hdfs://localhost:9100</value> </property> <property> <name>mapred.job.tracker< /name> <value>localhost:9101< /value> </property> <property> <name>dfs.replication< /name> <value>1</value> </property> </configuration>
+8
hadoop
source share
2 answers

The problem is this: mapred-site.xml and NOT hdfs-site.xml,

 <property> <name>mapred.job.tracker</name> <value>localhost:9101</value> </property>

By the way, why are you trying to run Hadoop on Windows? For development? You do not have a Linux machine or do not want to install it?

One more thing, you usually put this property in the core-site.xml file, not hdfs-site.xml.

 <property> <name>fs.default.name</name> <value>hdfs://localhost:9100</value> </property>
+13
source share

I encountered the same problem when working on the "Pseudo Distributed" examples as on this page: http://hadoop.apache.org/docs/r1.1.2/single_node_setup.html#PseudoDistributed

It turned out that hadoop just didn't collect my conf files. The links above suggest that you are using your hadoop installation (e.g. / Usr / jane / hadoop-1.1.2). I tried to run the examples in a different directory. I'm sure you can configure hadoop to recognize other "conf" directories, but I made an easy route and just started working in my hadoop directory.

This thread helped me figure it out: https://issues.apache.org/jira/browse/HDFS-2515

0
source share

More articles:


All Articles