Geek Answers Handbook

Pig Chaos Problem: IPC Version 7 Server Cannot Interact with Client Version 4

I try to run and not run pigs:

$ pig 2013-05-10 18:03:22,972 [main] INFO org.apache.pig.Main - Apache Pig version 0.11.1 (r1459641) compiled Mar 22 2013, 02:13:53 2013-05-10 18:03:22,972 [main] INFO org.apache.pig.Main - Logging error messages to: /Users/barclaydunn/Environment/pig-0.11.1/pig_1368223402970.log 2013-05-10 18:03:23,151 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: hdfs://stage-hadoop101.cluster:8020/hbase 2013-05-10 18:03:23,704 [main] ERROR org.apache.pig.Main - ERROR 2999: Unexpected internal error. Failed to create DataStorage Details at logfile: /Users/barclaydunn/Environment/pig-0.11.1/pig_1368223402970.log

Log content:

  $ cat /Users/barclaydunn/Environment/pig-0.11.1/pig_1368223402970.log Error before Pig is launched ---------------------------- ERROR 2999: Unexpected internal error. Failed to create DataStorage java.lang.RuntimeException: Failed to create DataStorage at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:75) at org.apache.pig.backend.hadoop.datastorage.HDataStorage.<init>(HDataStorage.java:58) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:204) at org.apache.pig.backend.hadoop.executionengine.HExecutionEngine.init(HExecutionEngine.java:117) at org.apache.pig.impl.PigContext.connect(PigContext.java:240) at org.apache.pig.PigServer.<init>(PigServer.java:213) at org.apache.pig.PigServer.<init>(PigServer.java:198) at org.apache.pig.tools.grunt.Grunt.<init>(Grunt.java:47) at org.apache.pig.Main.run(Main.java:535) at org.apache.pig.Main.main(Main.java:157) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.apache.hadoop.util.RunJar.main(RunJar.java:156) Caused by: org.apache.hadoop.ipc.RemoteException: Server IPC version 7 cannot communicate with client version 4 at org.apache.hadoop.ipc.Client.call(Client.java:1070) at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:225) at com.sun.proxy.$Proxy1.getProtocolVersion(Unknown Source) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:396) at org.apache.hadoop.ipc.RPC.getProxy(RPC.java:379) at org.apache.hadoop.hdfs.DFSClient.createRPCNamenode(DFSClient.java:119) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:238) at org.apache.hadoop.hdfs.DFSClient.<init>(DFSClient.java:203) at org.apache.hadoop.hdfs.DistributedFileSystem.initialize(DistributedFileSystem.java:89) at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1386) at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:66) at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1404) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:254) at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:123) at org.apache.pig.backend.hadoop.datastorage.HDataStorage.init(HDataStorage.java:72) ... 14 more ================================================================================

A search for "Server IPC version 7 cannot communicate with client version 4" does not bring anything useful.

+7
source share
2 answers

Set HADOOP_HOME to indicate the interface you are using.

To the start of the pig :

(You can start Pig with different versions of Hadoop by setting HADOOP_HOME to indicate the directory in which you installed Hadoop. If you do not install HADOOP_HOME, by default Pig will work with the built-in version, currently Hadoop 1.0.0.)

IPC 4 is for Hadoop 1.0, while version 7 is for Hadoop 2.0, so it sounds like you are using a pig with a built-in version of howop, but you are trying to talk to a Hadoop 2 cluster.

+5
source

The error "IPC server version 7 cannot communicate with client version 4" can be caused when the cdh3 job tries to contact the cdh4 HDFS.

Check the settings of mapred.job.tracker and fs.default.name

0
source

More articles:


All Articles