Geek Answers Handbook

Where are the sample jar-hoops * and the hoop-test * in the Cloudera CDH?

I am looking for jar files to be able to run hadoop jobs related to examples and test banks. Previously, they were under / usr / lib / hadoop, but apparently they were no longer there. Pointers appreciated.

Note : this question was originally for CDH4.2. But some answers include information for later versions.

+7
source share
6 answers

I found them in / usr / local / lib as follows (replace 4.2.1 with the specific cloudera version that you are using):

mrv1: /usr/local/lib/hadoop_mr1/hadoop-examples-2.0.0-mr1-cdh4.0.1.jar mrv2: /usr/local/lib/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.0 .0-cdh4.2.1.jar

So we can run it like: hasoop jar / usr / local / lib / hadoop_mr1 / hadoop-examples-2.0.0-mr1-cdh4.0.1.jar pi 500 40

+2
source

In my single node setup of Hadoop 2.3.0-cdh5.0.2 on CentOS 6.5 (Final), I found examples with mapping in / usr / lib / hadoop -mapreduce / hadoop-mapreduce-examples-2.3.0 -cdh5.0.3.jar (indicated by / usr / lib / hadoop-mapreduce / hadoop-mapreduce-examples.jar). Via http://www.cloudera.com/content/cloudera-content/cloudera-docs/CDH5/latest/CDH5-Installation-Guide/cdh5ig_tips_guidelines.html .

+4
source 
find / -name hadoop-mapreduce-examples*.jar

/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.0.0-cdh4.7.0.jar

/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar

+4
source

So they moved things based on changes to the hadoop directory in the new API.

 ${CDH4_DIR}/share/hadoop/mapreduce/hadoop-mapreduce-examples-*.jar ${CDH4_DIR}/share/hadoop/common/hadoop-common-*-tests.jar

but the directory where most jar files are located is in

 ${CDH4_DIR}/share/hadoop/
0
source

As indicated by another person, depending on the operating system and the installer, you can set the installation location. For CDH4 on RHEL, using the cloudera manager as the installer, examples and test banks can be found in the following places.

/opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar

 '/opt/cloudera/parcels/CDH-4.2.0-1.cdh4.2.0.p0.10/lib/hadoop/hadoop-common-2.0.0-cdh4.2.0-tests.jar'
0
source

I invoke the find command in my environment. Red Hat Linux. Hadoop 2.5.0

find / -name examples.jar / app / hadoop -2.5.0 / share / hadoop / mapreduce / sources / hadoop-mapreduce-examples-2.5.0-sources.jar / app / hadoop -2.5.0 / share / hadoop / mapreduce / sources / hadoop-mapreduce-examples-2.5.0-test-sources.jar

/app/hadoop-2.5.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.5.0.jar

/usr/java/jdk1.6.0_24/demo/jpda/examples.jar

0
source

More articles:


All Articles