Geek Answers Handbook

Cant Run with a single hadoop node server

I have a virtual machine with ubuntu installed. It runs hasoop as a single node. Later I installed apache on it. apache pig works fine with local mode, but it is always promERROR 2999: Unexpected internal error. Failed to create DataStorage

I am missing something very obvious. Can someone help me launch this launch?

More details: 1. I assume that hasoop is working fine, because I could run MapReduce jobs in python. 2. -x rides are local, as I expect. 3. When I just type pig, it gives me the following error

Error before Pig is launched
----------------------------
ERROR 2999: Unexpected internal error. Failed to create DataStorage

java.lang.RuntimeException: Failed to create DataStorage
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init (HDataStorage.java:75)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage. (HDataStorage.java:58)
    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init (HExecutionEngine.java:214)
    at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init (HExecutionEngine.java:134)
    at org.apache.pig.impl.PigContext.connect (PigContext.java:183)
    at org.apache.pig.PigServer. (PigServer.java:226)
    at org.apache.pig.PigServer. (PigServer.java:215)
    at org.apache.pig.tools.grunt.Grunt. (Grunt.java:55)
    at org.apache.pig.Main.run (Main.java:452)
    at org.apache.pig.Main.main (Main.java:107)
Caused by: java.io.IOException: Call to localhost / 127.0.0.1: 54310 failed on local exception: java.io.EOFException
    at org.apache.hadoop.ipc.Client.wrapException (Client.java:775)
    at org.apache.hadoop.ipc.Client.call (Client.java:743)
    at org.apache.hadoop.ipc.RPC $ Invoker.invoke (RPC.java:220)
    at $ Proxy0.getProtocolVersion (Unknown Source)
    at org.apache.hadoop.ipc.RPC.getProxy (RPC.javahaps59)
    at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode (DFSClient.java:106)
    at org.apache.hadoop.hdfs.DFSClient. (DFSClient.java:207)
    at org.apache.hadoop.hdfs.DFSClient. (DFSClient.java:170)
    at org.apache.hadoop.hdfs.DistributedFileSystem.initialize (DistributedFileSystem.java:82)
    at org.apache.hadoop.fs.FileSystem.createFileSystem (FileSystem.java:1378)
    at org.apache.hadoop.fs.FileSystem.access $ 200 (FileSystem.java:66)
    at org.apache.hadoop.fs.FileSystem $ Cache.get (FileSystem.java:1390)
    at org.apache.hadoop.fs.FileSystem.get (FileSystem.java:196)
    at org.apache.hadoop.fs.FileSystem.get (FileSystem.java:95)
    at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init (HDataStorage.java:72)
    ... 9 more
Caused by: java.io.EOFException
    at java.io.DataInputStream.readInt (DataInputStream.javahaps75)
    at org.apache.hadoop.ipc.Client $ Connection.receiveResponse (Client.java∗01)
    at org.apache.hadoop.ipc.Client $ Connection.run (Client.java:446)
=================================================== ================================
+2
source share
3 answers

The link helped me understand the possible reason for the failure.

.
1. .
2. PIG_CLASSPATH, $HADOOP_HOME/lib
3. .

.

+3

PIG_CLASSPATH, HADOOP_HOME, Pig ur core-site.xml, mapreduce-site.xml hdfs-site.xml, .

0

Cygwin, Cygwin Path:

. .

-1

More articles:


All Articles