Geek Answers Handbook

The HDFS record results in the error "CreateSymbolicLink" (1314): the requested privilege is not held by the client. "

Tried to run an example conversion program with Apache Hadoop . An exception is received below when the work to reduce the map was launched. I tried hdfs dfs -chmod 777 /, but this does not fix the problem.

15/03/10 13:13:10 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with
ToolRunner to remedy this.
15/03/10 13:13:10 WARN mapreduce.JobSubmitter: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
15/03/10 13:13:10 INFO input.FileInputFormat: Total input paths to process : 2
15/03/10 13:13:11 INFO mapreduce.JobSubmitter: number of splits:2
15/03/10 13:13:11 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1425973278169_0001
15/03/10 13:13:12 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
15/03/10 13:13:12 INFO impl.YarnClientImpl: Submitted application application_1425973278169_0001
15/03/10 13:13:12 INFO mapreduce.Job: The url to track the job: http://B2ML10803:8088/proxy/application_1425973278169_0001/
15/03/10 13:13:12 INFO mapreduce.Job: Running job: job_1425973278169_0001
15/03/10 13:13:18 INFO mapreduce.Job: Job job_1425973278169_0001 running in uber mode : false
15/03/10 13:13:18 INFO mapreduce.Job:  map 0% reduce 0%
15/03/10 13:13:18 INFO mapreduce.Job: Job job_1425973278169_0001 failed with state FAILED due to: Application application_1425973278169_0001 failed 2 times due
to AM Container for appattempt_1425973278169_0001_000002 exited with  exitCode: 1
For more detailed output, check application tracking page:http://B2ML10803:8088/proxy/application_1425973278169_0001/Then, click on links to logs of each attemp
t.
Diagnostics: Exception from container-launch.
Container id: container_1425973278169_0001_02_000001
Exit code: 1
Exception message: CreateSymbolicLink error (1314): A required privilege is not held by the client.

Stack trace:

ExitCodeException exitCode=1: CreateSymbolicLink error (1314): A required privilege is not held by the client.

    at org.apache.hadoop.util.Shell.runCommand(Shell.java:538)
    at org.apache.hadoop.util.Shell.run(Shell.java:455)
    at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:715)
    at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:211)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)

Shell Output:

1 file(s) moved.

Container exited with a non-zero exit code 1
Failing this attempt. Failing the application.
15/03/10 13:13:18 INFO mapreduce.Job: Counters: 0
+4
source share
7 answers

Win 8.1 + hadoop 2.7.0 (build from sources)

  • run command line in admin mode

  • execute etc \ hadoop \ hadoop-env.cmd

  • run sbin \ start-dfs.cmd

  • run sbin \ start-yarn.cmd

  • now try to complete your task

+12

​​ . namenode, , , . @aoetalks Windows Server 2012 R2, .

:

  • ( Win+R, "Run..." - type gpedit.msc)
  • expand " " - " Windows" - " " - " " - " "
  • " " , . , .
  • , .

, , , . User Account Control: Run all administrators in Admin Approval Mode (.. ). , .

: https://superuser.com/questions/104845/permission-to-make-symbolic-links-in-windows-7

+6

, NameNode Windows 8.

  • . C:\hadoop\logs C:\hadoop\logs\userlogs
  • C:\hadoop\data\dfs\datanode C:\hadoop\data\dfs\namenode.
    Reformat NameNode :
    c:\hadoop\bin>hdfs namenode -format
0

. this . , , UAC ( , "" ) , .

, node Hadoop Hadoop .

0

, . , Java.

  1. java version javac version.
  2. , Java.
0

Windows hdfs-site.xml

<configuration>
   <property>
       <name>dfs.replication</name>
       <value>1</value>
   </property>
   <property>
       <name>dfs.namenode.name.dir</name>
       <value>file:///C:/hadoop-2.7.2/data/namenode</value>
   </property>
   <property>
       <name>dfs.datanode.data.dir</name>
       <value>file:///C:/hadoop-2.7.2/data/datanode</value>
   </property>
</configuration>

cmd : -

  • -all.cmd
  • hdfs namenode –format
  • -all.cmd

jar hadoop jar C:\Hadoop_Demo\wordCount\target\wordCount-0.0.1-SNAPSHOT.jar :///C: /Hadoop/input.txt :///C: /Hadoop/

0

. " " " ".

0

More articles:


All Articles