Geek Answers Handbook

YARN application terminated with exitCode: -1000 Unable to initialize user directories

I get:

Application application_1427711869990_0001 failed 2 times due to AM Container for appattempt_1427711869990_0001_000002 exited with exitCode: -1000 due to: Not able to initialize user directories in any of the configured local directories for user kailash
.Failing this attempt.. Failing the application.

I could not find anything related to this exit code and its related reason. I am using Hadoop 2.5.0 (Cloudera 5.3.2).

+4
source share
4 answers

This is actually due to permission issues in some local yarn catalogs. I started using LinuxContainerExecutor(in unsafe mode with unsafe-mode.local-user as kailash) and made the appropriate changes. However, due to some (unknown) reason, NodeManager was unable to clear local directories for users, and there were still directories with the previous user (in my case, yarn).

, , yarn.nodemanager.local-dirs ( Cloudera, YARN, yarn-site.xml hadoop conf) / node. :

rm -rf /yarn/nm/usercache/*
+8

, - . yarn.nodemanager.local-dirs, ${hadoop.tmp.dir}/nm-local-dir. , hadoop.tmp.dir core-site.xml, /tmp/hadoop-${user.name}. User.name - UNIX, Hadoop. $HADOOP_INSTALL/etc/hadoop/ .

+1

rm -rf/dn/yarn/nm/usercache/* { }

Please check the configuration inside YARN (including MR2) Local NodeManager directories.

http://i.imgur.com/BHwhUnB.jpg

You need to apply this to data nodes that reported an error using YARN

This is a sample of my case.

http://i.imgur.com/miNx454.jpg

ApplicationMaster reported that C90BFH04.localdomain: 8042, which is node no 4 data. Therefore, I applied only to the YARN directory in node no 4

After that, everything is in order!

0
source

I get below error in sqoop merge, I believe they are related: -

 Application application_1499404558183_0004 failed 2 times due to AM Container for appattempt_1499404558183_0004_000002 exited with exitCode: -1000
For more detailed output, check application tracking page:http://quickstart.cloudera:8088/proxy/application_1499404558183_0004/Then, click on links to logs of each attempt.
Diagnostics: error in opening zip file
java.util.zip.ZipException: error in opening zip file
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:215)
at java.util.zip.ZipFile.<init>(ZipFile.java:145)
at java.util.jar.JarFile.<init>(JarFile.java:154)
at java.util.jar.JarFile.<init>(JarFile.java:118)
0
source

More articles:


All Articles